Search Results for author: Arnaud Pannatier

Found 4 papers, 2 papers with code

σ-GPTs: A New Approach to Autoregressive Models

no code implementations15 Apr 2024 Arnaud Pannatier, Evann Courdier, François Fleuret

Autoregressive models, such as the GPT family, use a fixed order, usually left-to-right, to generate sequences.

Language Modelling

Inference from Real-World Sparse Measurements

no code implementations20 Oct 2022 Arnaud Pannatier, Kyle Matoba, François Fleuret

Notably, our model reduces the root mean square error (RMSE) for wind nowcasting from 9. 24 to 7. 98 and for heat diffusion tasks from 0. 126 to 0. 084.

Weather Forecasting

HyperMixer: An MLP-based Low Cost Alternative to Transformers

3 code implementations7 Mar 2022 Florian Mai, Arnaud Pannatier, Fabio Fehr, Haolin Chen, Francois Marelli, Francois Fleuret, James Henderson

We find that existing architectures such as MLPMixer, which achieves token mixing through a static MLP applied to each feature independently, are too detached from the inductive biases required for natural language understanding.

Natural Language Understanding

Efficient Wind Speed Nowcasting with GPU-Accelerated Nearest Neighbors Algorithm

1 code implementation20 Dec 2021 Arnaud Pannatier, Ricardo Picatoste, François Fleuret

This paper proposes a simple yet efficient high-altitude wind nowcasting pipeline.

Cannot find the paper you are looking for? You can Submit a new open access paper.