feat: publish MoE deep dive

This commit is contained in:
wuyang
2026-07-28 23:32:14 +08:00
parent 761a75d5af
commit 3db826dd4a
17 changed files with 3533 additions and 48 deletions
+1
View File
@@ -286,6 +286,7 @@ const toc = [
这条技术线与 DeepSeekMoE 紧密相连:shared experts 保存公共知识,细粒度 routed experts 促进专业化。
K3 再借 LatentMoE 让“选 16 个专家”的通信和权重读取可承受,并为极端稀疏补上稳定性机制。
</p>
<a class="button primary" href="/moe/#k3">进入 MoE 专题:逐步推导 LatentMoE 与 Quantile Balancing →</a>
</section>
<section class="article-section" id="vision">