Search Results for author:
Found 2 papers, 2 papers with code
PartialFormer: Modeling Part Instead of Whole
The design choices in Transformer feed-forward neural networks have resulted in significant computational and parameter overhead.
Ranked #23 on
Machine Translation
on WMT2014 English-German
EIT: Enhanced Interactive Transformer
In this paper, we propose a novel architecture, the Enhanced Interactive Transformer (EIT), to address the issue of head degradation in self-attention mechanisms.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
