Search Results for author: Xuefei Zhe

Found 19 papers, 14 papers with code

Skinned Motion Retargeting with Residual Perception of Motion Semantics & Geometry

1 code implementation CVPR 2023 Jiaxu Zhang, Junwu Weng, Di Kang, Fang Zhao, Shaoli Huang, Xuefei Zhe, Linchao Bao, Ying Shan, Jue Wang, Zhigang Tu

Driven by our explored distance-based losses that explicitly model the motion semantics and geometry, these two modules can learn residual motion modifications on the source motion to generate plausible retargeted motion in a single inference without post-processing.

motion retargeting

Audio2Gestures: Generating Diverse Gestures from Audio

no code implementations17 Jan 2023 Jing Li, Di Kang, Wenjie Pei, Xuefei Zhe, Ying Zhang, Linchao Bao, Zhenyu He

Finally, we demonstrate that our method can be readily used to generate motion sequences with user-specified motion clips on the timeline.

Gesture Generation

Learning Audio-Driven Viseme Dynamics for 3D Face Animation

no code implementations15 Jan 2023 Linchao Bao, Haoxian Zhang, Yue Qian, Tangli Xue, Changhai Chen, Xuefei Zhe, Di Kang

We show that the predicted viseme curves can be applied to different viseme-rigged characters to yield various personalized animations with realistic and natural facial motions.

3D Face Animation

CARD: Semantic Segmentation with Efficient Class-Aware Regularized Decoder

1 code implementation11 Jan 2023 Ye Huang, Di Kang, Liang Chen, Wenjing Jia, Xiangjian He, Lixin Duan, Xuefei Zhe, Linchao Bao

Extensive experiments and ablation studies conducted on multiple benchmark datasets demonstrate that the proposed CAR can boost the accuracy of all baseline models by up to 2. 23% mIOU with superior generalization ability.

Decoder Representation Learning +2

NEURAL MARIONETTE: A Transformer-based Multi-action Human Motion Synthesis System

no code implementations27 Sep 2022 Weiqiang Wang, Xuefei Zhe, Qiuhong Ke, Di Kang, Tingguang Li, Ruizhi Chen, Linchao Bao

Along with the novel system, we also present a new dataset dedicated to the multi-action motion synthesis task, which contains both action tags and their contextual information.

Motion Synthesis Rolling Shutter Correction +1

Learning to Construct 3D Building Wireframes from 3D Line Clouds

1 code implementation25 Aug 2022 Yicheng Luo, Jing Ren, Xuefei Zhe, Di Kang, Yajing Xu, Peter Wonka, Linchao Bao

The network takes a line cloud as input , i. e., a nonstructural and unordered set of 3D line segments extracted from multi-view images, and outputs a 3D wireframe of the underlying building, which consists of a sparse set of 3D junctions connected by line segments.

Semi-signed prioritized neural fitting for surface reconstruction from unoriented point clouds

no code implementations14 Jun 2022 Runsong Zhu, Di Kang, Ka-Hei Hui, Yue Qian, Xuefei Zhe, Zhen Dong, Linchao Bao, Pheng-Ann Heng, Chi-Wing Fu

To guide the network quickly fit the coarse shape, we propose to utilize the signed supervision in regions that are obviously outside the object and can be easily determined, resulting in our semi-signed supervision.

Surface Reconstruction

REALY: Rethinking the Evaluation of 3D Face Reconstruction

1 code implementation18 Mar 2022 Zenghao Chai, Haoxian Zhang, Jing Ren, Di Kang, Zhengzhuo Xu, Xuefei Zhe, Chun Yuan, Linchao Bao

The evaluation of 3D face reconstruction results typically relies on a rigid shape alignment between the estimated 3D model and the ground-truth scan.

3D Face Reconstruction

CAR: Class-aware Regularizations for Semantic Segmentation

1 code implementation arXiv:2203.07160 2022 Ye Huang, Di Kang, Liang Chen, Xuefei Zhe, Wenjing Jia, Xiangjian He, Linchao Bao

Recent segmentation methods, such as OCR and CPNet, utilizing "class level" information in addition to pixel features, have achieved notable success for boosting the accuracy of existing network modules.

Representation Learning Semantic Segmentation

Audio2Gestures: Generating Diverse Gestures from Speech Audio with Conditional Variational Autoencoders

no code implementations ICCV 2021 Jing Li, Di Kang, Wenjie Pei, Xuefei Zhe, Ying Zhang, Zhenyu He, Linchao Bao

In order to overcome this problem, we propose a novel conditional variational autoencoder (VAE) that explicitly models one-to-many audio-to-motion mapping by splitting the cross-modal latent code into shared code and motion-specific code.

Gesture Generation

Orthonormal Product Quantization Network for Scalable Face Image Retrieval

1 code implementation1 Jul 2021 Ming Zhang, Xuefei Zhe, Hong Yan

Experiments are conducted on four commonly-used face datasets under both seen and unseen identities retrieval settings.

Deep Hashing Face Image Retrieval +2

Animatable Neural Radiance Fields from Monocular RGB Videos

1 code implementation25 Jun 2021 Jianchuan Chen, Ying Zhang, Di Kang, Xuefei Zhe, Linchao Bao, Xu Jia, Huchuan Lu

We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos.

3D Human Reconstruction Neural Rendering +2

Model-based 3D Hand Reconstruction via Self-Supervised Learning

1 code implementation CVPR 2021 Yujin Chen, Zhigang Tu, Di Kang, Linchao Bao, Ying Zhang, Xuefei Zhe, Ruizhi Chen, Junsong Yuan

For the first time, we demonstrate the feasibility of training an accurate 3D hand reconstruction network without relying on manual annotations.

Self-Supervised Learning

High-Fidelity 3D Digital Human Head Creation from RGB-D Selfies

2 code implementations12 Oct 2020 Linchao Bao, Xiangkai Lin, Yajing Chen, Haoxian Zhang, Sheng Wang, Xuefei Zhe, Di Kang, HaoZhi Huang, Xinwei Jiang, Jue Wang, Dong Yu, Zhengyou Zhang

We present a fully automatic system that can produce high-fidelity, photo-realistic 3D digital human heads with a consumer RGB-D selfie camera.

Vocal Bursts Intensity Prediction

Deep Class-Wise Hashing: Semantics-Preserving Hashing via Class-wise Loss

1 code implementation12 Mar 2018 Xuefei Zhe, Shifeng Chen, Hong Yan

In this regard, we propose a novel deep supervised hashing model to learn more compact class-level similarity preserving binary codes.

Deep Hashing Image Retrieval +1

Directional Statistics-based Deep Metric Learning for Image Classification and Retrieval

1 code implementation27 Feb 2018 Xuefei Zhe, Shifeng Chen, Hong Yan

Deep distance metric learning (DDML), which is proposed to learn image similarity metrics in an end-to-end manner based on the convolution neural network, has achieved encouraging results in many computer vision tasks.$L2$-normalization in the embedding space has been used to improve the performance of several DDML methods.

General Classification Image Classification +2

Cannot find the paper you are looking for? You can Submit a new open access paper.