Search Results for author: Jessica Grogan

Found 2 papers, 2 papers with code

Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture

1 code implementation • NeurIPS 2023 • Daniel Y. Fu, Simran Arora, Jessica Grogan, Isys Johnson, Sabri Eyuboglu, Armin W. Thomas, Benjamin Spector, Michael Poli, Atri Rudra, Christopher Ré

We ask: are there performant architectures that can scale sub-quadratically along sequence length and model dimension?

4k Image Classification +1

493

Paper
Code

Monarch: Expressive Structured Matrices for Efficient and Accurate Training

1 code implementation • 1 Apr 2022 • Tri Dao, Beidi Chen, Nimit Sohoni, Arjun Desai, Michael Poli, Jessica Grogan, Alexander Liu, Aniruddh Rao, Atri Rudra, Christopher Ré

To address these issues, we propose a class of matrices (Monarch) that is hardware-efficient (they are parameterized as products of two block-diagonal matrices for better hardware utilization) and expressive (they can represent many commonly used transforms).

Language Modelling MRI Reconstruction

173

Paper
Code

Cannot find the paper you are looking for? You can Submit a new open access paper.