arXivAI Research
LIFT: Breaking Transformer Feed-Forward Bottlenecks with Latent Information Feedback
LIFT 架構：透過老師監督引入潛在資訊回饋，突破 Transformer 的單向限制
LIFT introduces a novel recurrent-state architecture that propagates deep-to-shallow latent information across generation steps, bypassing the traditional Transformer's feed-forward bottleneck through teacher supervision.
2 min read