no code implementations • 26 Sep 2022 • Nurullah Sevim, Ege Ozan Özyedek, Furkan Şahinuç, Aykut Koç
FNet achieves competitive performances concerning the original transformer encoder model while accelerating training process by removing the computational burden of the attention mechanism.
