no code implementations • 16 Jan 2024 • Mathis Petrovich, Or Litany, Umar Iqbal, Michael J. Black, Gül Varol, Xue Bin Peng, Davis Rempe
To generate composite animations from a multi-track timeline, we propose a new test-time denoising method.
no code implementations • ICCV 2023 • Mathis Petrovich, Michael J. Black, Gül Varol
We show that maintaining the motion generation loss, along with the contrastive training, is crucial to obtain good performance.
no code implementations • ICCV 2023 • Nikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül Varol
Motivated by the observation that the correspondence between actions and body parts is encoded in powerful language models, we extract this knowledge by prompting GPT-3 with text such as "what are the body parts involved in the action <action name>?
1 code implementation • 9 Sep 2022 • Nikos Athanasiou, Mathis Petrovich, Michael J. Black, Gül Varol
In particular, our goal is to enable the synthesis of a series of actions, which we refer to as temporal action composition.
1 code implementation • 25 Apr 2022 • Mathis Petrovich, Michael J. Black, Gül Varol
In contrast to most previous work which focuses on generating a single, deterministic, motion from a textual description, we design a variational approach that can produce multiple diverse human motions.
Ranked #7 on Motion Synthesis on InterHuman
2 code implementations • ICCV 2021 • Mathis Petrovich, Michael J. Black, Gül Varol
By sampling from this latent space and querying a certain duration through a series of positional encodings, we synthesize variable-length motion sequences conditioned on a categorical action.
no code implementations • 1 Jan 2021 • Mathis Petrovich, Chao Liang, Ryoma Sato, Yanbin Liu, Yao-Hung Hubert Tsai, Linchao Zhu, Yi Yang, Ruslan Salakhutdinov, Makoto Yamada
To show the effectiveness of FROT, we propose using the FROT algorithm for the layer selection problem in deep neural networks for semantic correspondence.
1 code implementation • 25 May 2020 • Mathis Petrovich, Chao Liang, Ryoma Sato, Yanbin Liu, Yao-Hung Hubert Tsai, Linchao Zhu, Yi Yang, Ruslan Salakhutdinov, Makoto Yamada
To show the effectiveness of FROT, we propose using the FROT algorithm for the layer selection problem in deep neural networks for semantic correspondence.
1 code implementation • 21 Feb 2020 • Mathis Petrovich, Makoto Yamada
Regression is an important task in machine learning and data mining.
2 code implementations • 23 Jan 2020 • Dinesh Singh, Héctor Climente-González, Mathis Petrovich, Eiryo Kawakami, Makoto Yamada
Because a large number of parameters in the selection and reconstruction layers can easily result in overfitting under a limited number of samples, we use two tiny networks to predict the large, virtual weight matrices of the selection and reconstruction layers.