1 code implementation • 28 Dec 2022 • Tri Dao, Daniel Y. Fu, Khaled K. Saab, Armin W. Thomas, Atri Rudra, Christopher Ré
First, we use synthetic language modeling tasks to understand the gap between SSMs and attention.
1 code implementation • 21 Nov 2022 • Siyi Tang, Jared A. Dunnmon, Liangqiong Qu, Khaled K. Saab, Christopher Lee-Messer, Daniel L. Rubin
Multivariate signals are prevalent in various domains, such as healthcare, transportation systems, and space sciences.