Search Results for author: Cristian Meo

Found 13 papers, 4 papers with code

$α$-TCVAE: On the relationship between Disentanglement and Diversity

no code implementations1 Nov 2024 Cristian Meo, Louis Mahon, Anirudh Goyal, Justin Dauwels

The proposed TC bound is grounded in information theory constructs, generalizes the $\beta$-VAE lower bound, and can be reduced to a convex combination of the known variational information bottleneck (VIB) and conditional entropy bottleneck (CEB) terms.

Attribute Disentanglement +2

Object-Centric Temporal Consistency via Conditional Autoregressive Inductive Biases

no code implementations21 Oct 2024 Cristian Meo, Akihiro Nakano, Mircea Lică, Aniket Didolkar, Masahiro Suzuki, Anirudh Goyal, Mengmi Zhang, Justin Dauwels, Yutaka Matsuo, Yoshua Bengio

Unsupervised object-centric learning from videos is a promising approach towards learning compositional representations that can be applied to various downstream tasks, such as prediction and reasoning.

Object Question Answering +2

Masked Generative Priors Improve World Models Sequence Modelling Capabilities

no code implementations10 Oct 2024 Cristian Meo, Mircea Lica, Zarif Ikram, Akihiro Nakano, Vedant Shah, Aniket Rajiv Didolkar, Dianbo Liu, Anirudh Goyal, Justin Dauwels

Building on the Efficient Stochastic Transformer-based World Models (STORM) architecture, we replace the traditional MLP prior with a Masked Generative Prior (e. g., MaskGIT Prior) and introduce GIT-STORM.

continuous-control Continuous Control +4

Bayesian-LoRA: LoRA based Parameter Efficient Fine-Tuning using Optimal Quantization levels and Rank Values trough Differentiable Bayesian Gates

no code implementations18 Jun 2024 Cristian Meo, Ksenia Sycheva, Anirudh Goyal, Justin Dauwels

In this work, we propose Bayesian-LoRA which approaches low-rank adaptation and quantization from a Bayesian perspective by employing a prior distribution on both quantization levels and rank values.

parameter-efficient fine-tuning Quantization

Precipitation Nowcasting Using Physics Informed Discriminator Generative Models

no code implementations14 Jun 2024 Junzhe Yin, Cristian Meo, Ankush Roy, Zeineh Bou Cher, Yanbo Wang, Ruben Imhoff, Remko Uijlenhoet, Justin Dauwels

The proposed model adopts a GAN structure, featuring a Vector Quantization Generative Adversarial Network (VQ-GAN) and a Transformer as the generator, with a temporal discriminator serving as the discriminator.

Generative Adversarial Network Quantization

Extreme Precipitation Nowcasting using Transformer-based Generative Models

1 code implementation6 Mar 2024 Cristian Meo, Ankush Roy, Mircea Lică, Junzhe Yin, Zeineb Bou Che, Yanbo Wang, Ruben Imhoff, Remko Uijlenhoet, Justin Dauwels

This paper presents an innovative approach to extreme precipitation nowcasting by employing Transformer-based generative models, namely NowcastingGPT with Extreme Value Loss (EVL) regularization.

Discrete Messages Improve Communication Efficiency among Isolated Intelligent Agents

no code implementations26 Dec 2023 Hang Chen, Yuchuan Jang, Weijie Zhou, Cristian Meo, Ziwei Chen, Dianbo Liu

Individuals, despite having varied life experiences and learning processes, can communicate effectively through languages.

Decoder

TC-VAE: Uncovering Out-of-Distribution Data Generative Factors

no code implementations8 Apr 2023 Cristian Meo, Anirudh Goyal, Justin Dauwels

We show that the proposed model is able to uncover OOD generative factors on different datasets and outperforms on average the related baselines in terms of downstream disentanglement metrics.

Disentanglement

Stateful active facilitator: Coordination and Environmental Heterogeneity in Cooperative Multi-Agent Reinforcement Learning

2 code implementations4 Oct 2022 Dianbo Liu, Vedant Shah, Oussama Boussif, Cristian Meo, Anirudh Goyal, Tianmin Shu, Michael Mozer, Nicolas Heess, Yoshua Bengio

We formalize the notions of coordination level and heterogeneity level of an environment and present HECOGrid, a suite of multi-agent RL environments that facilitates empirical evaluation of different MARL approaches across different levels of coordination and environmental heterogeneity by providing a quantitative control over coordination and heterogeneity levels of the environment.

Multi-agent Reinforcement Learning reinforcement-learning +1

Adaptation through prediction: multisensory active inference torque control

1 code implementation13 Dec 2021 Cristian Meo, Giovanni Franzese, Corrado Pezzato, Max Spahn, Pablo Lanillos

Adaptation to external and internal changes is major for robotic systems in uncertain environments.

Active Inference in Robotics and Artificial Agents: Survey and Challenges

no code implementations3 Dec 2021 Pablo Lanillos, Cristian Meo, Corrado Pezzato, Ajith Anil Meera, Mohamed Baioumy, Wataru Ohata, Alexander Tschantz, Beren Millidge, Martijn Wisse, Christopher L. Buckley, Jun Tani

Active inference is a mathematical framework which originated in computational neuroscience as a theory of how the brain implements action, perception and learning.

Bayesian Inference Survey

Multimodal VAE Active Inference Controller

1 code implementation7 Mar 2021 Cristian Meo, Pablo Lanillos

Active inference, a theoretical construct inspired by brain processing, is a promising alternative to control artificial agents.

continuous-control Continuous Control +1

Cannot find the paper you are looking for? You can Submit a new open access paper.