AI Foundation Models for Weather and Climate: Applications, Design, and Implementation

no code implementations • 19 Sep 2023 • S. Karthik Mukkavilli, Daniel Salles Civitarese, Johannes Schmude, Johannes Jakubik, Anne Jones, Nam Nguyen, Christopher Phillips, Sujit Roy, Shraddha Singh, Campbell Watson, Raghu Ganti, Hendrik Hamann, Udaysankar Nair, Rahul Ramachandran, Kommy Weldemariam

In particular, we are witnessing the rise of AI foundation models that can perform competitively on multiple domain-specific downstream tasks.

Language Modelling Operator learning +4

TensorBank: Tensor Lakehouse for Foundation Model Training

no code implementations • 5 Sep 2023 • Romeo Kienzler, Leonardo Pondian Tizzei, Benedikt Blumenstiel, Zoltan Arnold Nagy, S. Karthik Mukkavilli, Johannes Schmude, Marcus Freitag, Michael Behrendt, Daniel Salles Civitarese, Naomi Simumba, Daiki Kimura, Hendrik Hamann

Storing and streaming high dimensional data for foundation model training became a critical requirement with the rise of foundation models beyond natural language.

Extreme Precipitation Seasonal Forecast Using a Transformer Neural Network

no code implementations • 14 Jul 2021 • Daniel Salles Civitarese, Daniela Szwarcman, Bianca Zadrozny, Campbell Watson

An impact of climate change is the increase in frequency and intensity of extreme precipitation events.