no code implementations • 21 Nov 2023 • Tutian Tang, Jiyu Liu, Jieyi Zhang, Haoyuan Fu, Wenqiang Xu, Cewu Lu
By leveraging refractive flow as an intermediate representation, the proposed method circumvents the drawbacks of directly predicting the geometry (e. g. surface normal) from images and helps bridge the sim-to-real gap.
no code implementations • 2 Nov 2023 • Han Xue, Yutong Li, Wenqiang Xu, Huanyu Li, Dongzhe Zheng, Cewu Lu
Training data is collected via a human-centric process with offline and online stages.
no code implementations • 22 May 2023 • Huadai Liu, Rongjie Huang, Xuan Lin, Wenqiang Xu, Maozong Zheng, Hong Chen, Jinzheng He, Zhou Zhao
To mitigate the data scarcity in learning visual acoustic information, we 1) introduce a self-supervised learning framework to enhance both the visual-text encoder and denoiser decoder; 2) leverage the diffusion transformer scalable in terms of parameters and capacity to learn visual scene information.
no code implementations • CVPR 2023 • Wenqiang Xu, Zhenjun Yu, Han Xue, Ruolin Ye, Siqiong Yao, Cewu Lu
We propose a simulation environment, VT-Sim, which supports generating hand-object interaction for both rigid and deformable objects.
1 code implementation • CVPR 2023 • Han Xue, Wenqiang Xu, Jieyi Zhang, Tutian Tang, Yutong Li, Wenxin Du, Ruolin Ye, Cewu Lu
In this work, we present a complete package to address the category-level garment pose tracking task: (1) A recording system VR-Garment, with which users can manipulate virtual garment models in simulation through a VR interface.
no code implementations • ICCV 2023 • Wenqiang Xu, Wenxin Du, Han Xue, Yutong Li, Ruolin Ye, Yan-Feng Wang, Cewu Lu
In this work, we propose a recording system, GarmentTwin, which can track garment poses in dynamic settings such as manipulation.
no code implementations • 20 Aug 2022 • Yang Zhao, Wenqiang Xu, Xuan Lin, Jingjing Huo, Hong Chen, Zhou Zhao
The task of argument mining aims to detect all possible argumentative components and identify their relationships automatically.
no code implementations • 10 Jun 2022 • Yang Zhao, Xuan Lin, Wenqiang Xu, Maozong Zheng, Zhengyong Liu, Zhou Zhao
In recent days, streaming technology has greatly promoted the development in the field of livestream.
no code implementations • CVPR 2022 • Liu Liu, Wenqiang Xu, Haoyuan Fu, Sucheng Qian, Yang Han, Cewu Lu
To bridge the gap, we present AKB-48: a large-scale Articulated object Knowledge Base which consists of 2, 037 real-world 3D articulated object models of 48 categories.
no code implementations • 24 Dec 2021 • Sucheng Qian, Liu Liu, Wenqiang Xu, Cewu Lu
It can obtain a satisfied segmentation result with minimal human clicks (< 10).
no code implementations • 14 Dec 2021 • Han Xue, Liu Liu, Wenqiang Xu, Haoyuan Fu, Cewu Lu
With the full representation of the object shape and joint states, we can address several tasks including category-level object pose estimation and the articulated object retrieval.
no code implementations • 29 Nov 2021 • Jun Lv, Qiaojun Yu, Lin Shao, Wenhai Liu, Wenqiang Xu, Cewu Lu
We apply our system to perform articulated object manipulation tasks, both in the simulation and the real world.
2 code implementations • CVPR 2022 • Kailin Li, Lixin Yang, Xinyu Zhan, Jun Lv, Wenqiang Xu, Jiefeng Li, Cewu Lu
In contrast, data synthesis can easily ensure those diversities separately.
Ranked #3 on hand-object pose on HO-3D (using extra training data)
no code implementations • 7 Jun 2021 • Tutian Tang, Wenqiang Xu, Ruolin Ye, Yan-Feng Wang, Cewu Lu
In addition, we specifically select a subset from COCO val2017 named COCO ContourHard-val to further demonstrate the contour quality improvements.
no code implementations • 7 May 2021 • Liu Liu, Han Xue, Wenqiang Xu, Haoyuan Fu, Cewu Lu
This setting allows varied kinematic structures within a semantic category, and multiple instances to co-exist in an observation of real world.
no code implementations • ICCV 2021 • Ruolin Ye, Wenqiang Xu, Zhendong Xue, Tutian Tang, Yanfeng Wang, Cewu Lu
Besides, we also report the hand and object pose errors with existing baselines and show that the dataset can serve as the video demonstrations for robot imitation learning on the handover task.
2 code implementations • 18 Feb 2021 • Jun Lv, Wenqiang Xu, Lixin Yang, Sucheng Qian, Chongzhao Mao, Cewu Lu
3D hand pose estimation and shape recovery are challenging tasks in computer vision.
1 code implementation • ICCV 2021 • Lixin Yang, Xinyu Zhan, Kailin Li, Wenqiang Xu, Jiefeng Li, Cewu Lu
In this paper, we present an explicit contact representation namely Contact Potential Field (CPF), and a learning-fitting hybrid framework namely MIHO to Modeling the Interaction of Hand and Object.
1 code implementation • 2 Dec 2020 • Tutian Tang, Wenqiang Xu, Ruolin Ye, Lixin Yang, Cewu Lu
First, it learns a dictionary from a large collection of shape datasets, making any shape being able to be decomposed into a linear combination through the dictionary.
1 code implementation • 12 Aug 2020 • Lixin Yang, Jiasen Li, Wenqiang Xu, Yiqun Diao, Cewu Lu
Inside each stage, BiHand adopts a novel bisecting design which allows the networks to encapsulate two closely related information (e. g. 2D keypoints and silhouette in 2D seeding stage, 3D joints, and depth map in 3D lifting stage, joint rotations and shape parameters in the mesh generation stage) in a single forward pass.
no code implementations • 16 Oct 2019 • Wenqiang Xu, Yanjun Fu, Yuchen Luo, Chang Liu, Cewu Lu
Fine-grained recognition task deals with sub-category classification problem, which is important for real-world applications.
1 code implementation • ICCV 2019 • Wenqiang Xu, Haiyang Wang, Fubo Qi, Cewu Lu
In this paper, we propose a novel top-down instance segmentation framework based on explicit shape encoding, named \textbf{ESE-Seg}.
Ranked #3 on Semantic Contour Prediction on Sbd val
1 code implementation • ECCV 2018 • Wenqiang Xu, Yonglu Li, Cewu Lu
Instance segmentation is a problem of significance in computer vision.