Aivora

#post-training-quantization

Post-Training Quantization

1 article

STEPQuant: Spatial-Temporal Quantization for Linear Attention Recurrent States
arXivLLM

STEPQuant: Spatial-Temporal Quantization for Linear Attention Recurrent States

STEPQuant:空間與時間雙重優化,突破線性注意力循環狀態量化瓶頸

STEPQuant is a spatial-temporal post-training quantization framework for Delta-rule recurrent states, achieving over 5x state compression and reducing serving memory by up to 68.7% with minimal accuracy loss.

2 min read