Aivora

#cifar-10

CIFAR-10

1 article

Common-Mode Collapse and Recovery in Direct Feedback Alignment
arXivAI Research

Common-Mode Collapse and Recovery in Direct Feedback Alignment

直接回饋對齊(DFA)中的共模崩潰與恢復機制

This study uncovers the 'common-mode collapse' in Direct Feedback Alignment (DFA) where shared error components cause neuron saturation, and proposes effective mitigation strategies.

2 min read