Search Results for author: Vincent Tang

Found 2 papers, 2 papers with code

FNetAR: Mixing Tokens with Autoregressive Fourier Transforms

1 code implementation22 Jul 2021 Tim Lou, Michael Park, Mohammad Ramezanali, Vincent Tang

In this note we examine the autoregressive generalization of the FNet algorithm, in which self-attention layers from the standard Transformer architecture are substituted with a trivial sparse-uniformsampling procedure based on Fourier transforms.

Language Modelling Time Series +1

Cannot find the paper you are looking for? You can Submit a new open access paper.