Search Results for author: Pu-Chin Chen

Found 1 papers, 0 papers with code

A Simple and Effective Positional Encoding for Transformers

no code implementations EMNLP 2021 Pu-Chin Chen, Henry Tsai, Srinadh Bhojanapalli, Hyung Won Chung, Yin-Wen Chang, Chun-Sung Ferng

Our analysis shows that the gain actually comes from moving positional information to attention layer from the input.

Position

Cannot find the paper you are looking for? You can Submit a new open access paper.