Redesigning the Transformer Architecture with Insights from Multi-particle Dynamical Systems

1 code implementation • NeurIPS 2021 • Subhabrata Dutta, Tanya Gautam, Soumen Chakrabarti, Tanmoy Chakraborty

The Transformer and its variants have been proven to be efficient sequence learners in many different domains.