no code implementations • 13 Dec 2024 • Zhe Li, Yisheng He, Lei Zhong, Weichao Shen, Qi Zuo, Lingteng Qiu, Zilong Dong, Laurence Tianruo Yang, Weihao Yuan
Generating motion sequences conforming to a target style while adhering to the given content prompts requires accommodating both the content and style.
no code implementations • 9 Oct 2024 • Zhe Li, Weihao Yuan, Yisheng He, Lingteng Qiu, Shenhao Zhu, Xiaodong Gu, Weichao Shen, Yuan Dong, Zilong Dong, Laurence T. Yang
For captioning, we finetune a large language model with the language-informative motion features to develop a strong motion captioning model.
no code implementations • 26 Sep 2024 • Weihao Yuan, Weichao Shen, Yisheng He, Yuan Dong, Xiaodong Gu, Zilong Dong, Liefeng Bo, QiXing Huang
Motion generation from discrete quantization offers many advantages over continuous regression, but at the cost of inevitable approximation errors.
no code implementations • 21 Jun 2024 • Junhao Cai, Yuji Yang, Weihao Yuan, Yisheng He, Zilong Dong, Liefeng Bo, Hui Cheng, Qifeng Chen
To facilitate geometry-aware guidance in physical property estimation, we introduce a novel hybrid framework that leverages 3D Gaussian representation to not only capture explicit shapes but also enable the simulated continuum to render object masks as 2D shape surrogates during training.
no code implementations • 3 Apr 2024 • Yisheng He, Weihao Yuan, Siyu Zhu, Zilong Dong, Liefeng Bo, QiXing Huang
This paper enables high-fidelity, transferable NeRF editing by frequency decomposition.
no code implementations • 19 Mar 2024 • Junhao Cai, Yisheng He, Weihao Yuan, Siyu Zhu, Zilong Dong, Liefeng Bo, Qifeng Chen
Derived from OmniObject3D, OO3D-9D is the largest and most diverse dataset in the field of category-level object pose and size estimation.
no code implementations • 25 Jan 2024 • Minglin Chen, Weihao Yuan, Yukun Wang, Zhe Sheng, Yisheng He, Zilong Dong, Liefeng Bo, Yulan Guo
We propose a novel synchronized generation and reconstruction method to effectively optimize the NeRF.
1 code implementation • CVPR 2022 • Yisheng He, Yao Wang, Haoqiang Fan, Jian Sun, Qifeng Chen
6D object pose estimation networks are limited in their capability to scale to large numbers of object instances due to the close-set assumption and their reliance on high-fidelity object CAD models.
no code implementations • 6 Mar 2022 • Yisheng He, Haoqiang Fan, Haibin Huang, Qifeng Chen, Jian Sun
Instead, we propose a label-free method that learns to enforce the geometric consistency between category template mesh and observed object point cloud under a self-supervision manner.
no code implementations • 30 Sep 2021 • Lei Yang, Yan Zi Wei, Yisheng He, Wei Sun, Zhenhang Huang, Haibin Huang, Haoqiang Fan
In this paper, we introduce a brand new dataset to promote the study of instance segmentation for objects with irregular shapes.
Ranked #1 on Instance Segmentation on iShape
3 code implementations • CVPR 2021 • Yisheng He, Haibin Huang, Haoqiang Fan, Qifeng Chen, Jian Sun
Moreover, at the output representation stage, we designed a simple but effective 3D keypoints selection algorithm considering the texture and geometry information of objects, which simplifies keypoint localization for precise pose estimation.
Ranked #1 on 6D Pose Estimation on LineMOD
3 code implementations • CVPR 2020 • Yisheng He, Wei Sun, Haibin Huang, Jianran Liu, Haoqiang Fan, Jian Sun
Our method is a natural extension of 2D-keypoint approaches that successfully work on RGB based 6DoF estimation.
Ranked #1 on 6D Pose Estimation using RGBD on YCB-Video (Mean ADD-S metric)