Scaling Laws

Scaling Laws for Looped Mixture of Experts: Combining Recurrence and Sparsity

融合循環與稀疏架構：Looped MoE 的全新縮放定律

This paper introduces Loop Scaling Laws, the first joint framework modeling recurrence and sparsity to design highly parameter-efficient models capable of test-time scaling.