arXivLLM
Scaling Laws for Looped Mixture of Experts: Combining Recurrence and Sparsity
融合循環與稀疏架構：Looped MoE 的全新縮放定律
This paper introduces Loop Scaling Laws, the first joint framework modeling recurrence and sparsity to design highly parameter-efficient models capable of test-time scaling.
2 min read