no code implementations • 25 Aug 2024 • Xianghui Xie, Jan Eric Lenssen, Gerard Pons-Moll
In this paper, we present a method to track human object interaction without any object shape templates.
no code implementations • 12 Jun 2024 • Yuxuan Xue, Xianghui Xie, Riccardo Marin, Gerard Pons-Moll
Experiments show that our proposed framework outperforms state-of-the-art methods and enables the creation of realistic avatars from a single RGB image, achieving high-fidelity in both geometry and appearance.
no code implementations • 7 Jan 2024 • Xianghui Xie, Xi Wang, Nikos Athanasiou, Bharat Lal Bhatnagar, Chun-Hao P. Huang, Kaichun Mo, Hao Chen, Xia Jia, Zerui Zhang, Liangxian Cui, Xiao Lin, Bingqiao Qian, Jie Xiao, Wenfei Yang, Hyeongjin Nam, Daniel Sungho Jung, Kihoon Kim, Kyoung Mu Lee, Otmar Hilliges, Gerard Pons-Moll
Modeling the interaction between humans and objects has been an emerging research direction in recent years.
no code implementations • CVPR 2024 • Xianghui Xie, Bharat Lal Bhatnagar, Jan Eric Lenssen, Gerard Pons-Moll
We generate 1M+ human-object interaction pairs in 3D and leverage this large-scale data to train our HDM (Hierarchical Diffusion Model), a novel method to reconstruct interacting human and unseen objects, without any templates.
no code implementations • CVPR 2023 • Xianghui Xie, Bharat Lal Bhatnagar, Gerard Pons-Moll
In this work, we propose a novel method to track the 3D human, object, contacts between them, and their relative translation across frames from a single RGB camera, while being robust to heavy occlusions.
1 code implementation • CVPR 2022 • Bharat Lal Bhatnagar, Xianghui Xie, Ilya A. Petrov, Cristian Sminchisescu, Christian Theobalt, Gerard Pons-Moll
We present BEHAVE dataset, the first full body human- object interaction dataset with multi-view RGBD frames and corresponding 3D SMPL and object fits along with the annotated contacts between them.
1 code implementation • 5 Apr 2022 • Xianghui Xie, Bharat Lal Bhatnagar, Gerard Pons-Moll
However, humans are constantly interacting with the surrounding objects, thus calling for models that can reason about not only the human but also the object and their interaction.
Ranked #2 on 3D Object Reconstruction on BEHAVE