no code implementations • 15 Apr 2024 • Arnaud Pannatier, Evann Courdier, François Fleuret
Autoregressive models, such as the GPT family, use a fixed order, usually left-to-right, to generate sequences.
no code implementations • 20 Oct 2022 • Arnaud Pannatier, Kyle Matoba, François Fleuret
Notably, our model reduces the root mean square error (RMSE) for wind nowcasting from 9. 24 to 7. 98 and for heat diffusion tasks from 0. 126 to 0. 084.
3 code implementations • 7 Mar 2022 • Florian Mai, Arnaud Pannatier, Fabio Fehr, Haolin Chen, Francois Marelli, Francois Fleuret, James Henderson
We find that existing architectures such as MLPMixer, which achieves token mixing through a static MLP applied to each feature independently, are too detached from the inductive biases required for natural language understanding.
1 code implementation • 20 Dec 2021 • Arnaud Pannatier, Ricardo Picatoste, François Fleuret
This paper proposes a simple yet efficient high-altitude wind nowcasting pipeline.