Search Results for author: Khaled K. Saab

Found 3 papers, 3 papers with code

Effectively Modeling Time Series with Simple Discrete State Spaces

1 code implementation16 Mar 2023 Michael Zhang, Khaled K. Saab, Michael Poli, Tri Dao, Karan Goel, Christopher Ré

For expressivity, we propose a new SSM parameterization based on the companion matrix -- a canonical representation for discrete-time processes -- which enables SpaceTime's SSM layers to learn desirable autoregressive processes.

Time Series Classification

Hungry Hungry Hippos: Towards Language Modeling with State Space Models

2 code implementations28 Dec 2022 Tri Dao, Daniel Y. Fu, Khaled K. Saab, Armin W. Thomas, Atri Rudra, Christopher Ré

First, we use synthetic language modeling tasks to understand the gap between SSMs and attention.

 Ranked #1 on Language Modelling on WikiText-103 (using extra training data)

Few-Shot Learning Long-range modeling

Cannot find the paper you are looking for? You can Submit a new open access paper.