feat: publish MoE deep dive
This commit is contained in:
@@ -286,6 +286,7 @@ const toc = [
|
||||
这条技术线与 DeepSeekMoE 紧密相连:shared experts 保存公共知识,细粒度 routed experts 促进专业化。
|
||||
K3 再借 LatentMoE 让“选 16 个专家”的通信和权重读取可承受,并为极端稀疏补上稳定性机制。
|
||||
</p>
|
||||
<a class="button primary" href="/moe/#k3">进入 MoE 专题:逐步推导 LatentMoE 与 Quantile Balancing →</a>
|
||||
</section>
|
||||
|
||||
<section class="article-section" id="vision">
|
||||
|
||||
Reference in New Issue
Block a user