1 code implementation • 15 Apr 2024 • Pablo Ruiz Ponce, German Barquero, Cristina Palmero, Sergio Escalera, Jose Garcia-Rodriguez
For this, we introduce in2IN, a novel diffusion model for human-human motion generation which is conditioned not only on the textual description of the overall interaction but also on the individual descriptions of the actions performed by each person involved in the interaction.
Ranked #1 on Motion Synthesis on InterHuman (using extra training data)
1 code implementation • 23 Feb 2024 • German Barquero, Sergio Escalera, Cristina Palmero
Conditional human motion generation is an important topic with many applications in virtual reality, gaming, and robotics.
1 code implementation • 10 Jan 2024 • Siyang Song, Micol Spitale, Cheng Luo, Cristina Palmero, German Barquero, Hengde Zhu, Sergio Escalera, Michel Valstar, Tobias Baur, Fabien Ringeval, Elisabeth Andre, Hatice Gunes
In dyadic interactions, humans communicate their intentions and state of mind using verbal and non-verbal cues, where multiple different facial reactions might be appropriate in response to a specific speaker behaviour.
1 code implementation • 11 Jun 2023 • Siyang Song, Micol Spitale, Cheng Luo, German Barquero, Cristina Palmero, Sergio Escalera, Michel Valstar, Tobias Baur, Fabien Ringeval, Elisabeth Andre, Hatice Gunes
The Multi-modal Multiple Appropriate Facial Reaction Generation Challenge (REACT2023) is the first competition event focused on evaluating multimedia processing and machine learning techniques for generating human-appropriate facial reactions in various dyadic interaction scenarios, with all participants competing strictly under the same conditions.
1 code implementation • ICCV 2023 • German Barquero, Sergio Escalera, Cristina Palmero
To address these issues, we present BeLFusion, a model that, for the first time, leverages latent diffusion models in HMP to sample from a latent space where behavior is disentangled from pose and motion.
Ranked #1 on Human Pose Forecasting on AMASS (ADE metric)
1 code implementation • 7 Mar 2022 • German Barquero, Johnny Núñez, Zhen Xu, Sergio Escalera, Wei-Wei Tu, Isabelle Guyon, Cristina Palmero
In this work, we present the first systematic comparison of state-of-the-art approaches for behavior forecasting.
no code implementations • 4 Mar 2022 • German Barquero, Johnny Núñez, Sergio Escalera, Zhen Xu, Wei-Wei Tu, Isabelle Guyon, Cristina Palmero
Non-verbal social human behavior forecasting has increasingly attracted the interest of the research community in recent years.