Search Results for author: Hongyan Liu

Found 19 papers, 7 papers with code

A New Image Quality Database for Multiple Industrial Processes

no code implementations25 Jan 2024 Xuanchao Ma, Yanlin Jiang, Hongyan Liu, Chengxu Zhou, Ke Gu

Recent years have witnessed a broader range of applications of image processing technologies in multiple industrial processes, such as smoke detection, security monitoring, and workpiece inspection.

Image Quality Assessment

SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis

1 code implementation29 Nov 2023 Ziqiao Peng, Wentao Hu, Yue Shi, Xiangyu Zhu, Xiaomei Zhang, Hao Zhao, Jun He, Hongyan Liu, Zhaoxin Fan

A lifelike talking head requires synchronized coordination of subject identity, lip movements, facial expressions, and head poses.

Talking Face Generation Talking Head Generation

BeatDance: A Beat-Based Model-Agnostic Contrastive Learning Framework for Music-Dance Retrieval

no code implementations16 Oct 2023 Kaixing Yang, Xukun Zhou, Xulong Tang, Ran Diao, Hongyan Liu, Jun He, Zhaoxin Fan

Dance and music are closely related forms of expression, with mutual retrieval between dance videos and music being a fundamental task in various fields like education, art, and sports.

Contrastive Learning Retrieval

SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces

1 code implementation19 Jun 2023 Ziqiao Peng, Yihao Luo, Yue Shi, Hao Xu, Xiangyu Zhu, Jun He, Hongyan Liu, Zhaoxin Fan

To enhance the visual accuracy of generated lip movement while reducing the dependence on labeled data, we propose a novel framework SelfTalk, by involving self-supervision in a cross-modals network system to learn 3D talking faces.

3D Face Animation Lip Reading

Generalizable synthetic MRI with physics-informed convolutional networks

1 code implementation21 May 2023 Luuk Jacobs, Stefano Mandija, Hongyan Liu, Cornelis A. T. van den Berg, Alessandro Sbrizzi, Matteo Maspero

In this study, we develop a physics-informed deep learning-based method to synthesize multiple brain magnetic resonance imaging (MRI) contrasts from a single five-minute acquisition and investigate its ability to generalize to arbitrary contrasts to accelerate neuroimaging protocols.

Generative Adversarial Network

EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation

2 code implementations ICCV 2023 Ziqiao Peng, HaoYu Wu, Zhenbo Song, Hao Xu, Xiangyu Zhu, Jun He, Hongyan Liu, Zhaoxin Fan

Specifically, we introduce the emotion disentangling encoder (EDE) to disentangle the emotion and content in the speech by cross-reconstructed speech signals with different emotion labels.

3D Face Animation Disentanglement

Self-Supervised Interest Transfer Network via Prototypical Contrastive Learning for Recommendation

no code implementations28 Feb 2023 Guoqiang Sun, Yibin Shen, Sijin Zhou, Xiang Chen, Hongyan Liu, Chunming Wu, Chenyi Lei, Xianhui Wei, Fei Fang

In this paper, we propose a cross-domain recommendation method: Self-supervised Interest Transfer Network (SITN), which can effectively transfer invariant knowledge between domains via prototypical contrastive learning.

Contrastive Learning

SHLE: Devices Tracking and Depth Filtering for Stereo-based Height Limit Estimation

1 code implementation22 Dec 2022 Zhaoxin Fan, Kaixing Yang, Min Zhang, Zhenbo Song, Hongyan Liu, Jun He

In stage 1, a novel devices detection and tracking scheme is introduced, which accurately locate the height limit devices in the left or right image.

FuRPE: Learning Full-body Reconstruction from Part Experts

1 code implementation30 Nov 2022 Zhaoxin Fan, Yuqing Pan, Hao Xu, Zhenbo Song, Zhicheng Wang, Kejian Wu, Hongyan Liu, Jun He

These novel elements of FuRPE not only serve to further refine the model but also to reduce potential biases that may arise from inaccuracies in pseudo labels, thereby optimizing the network's training process and enhancing the robustness of the model.

A Cascaded Multi-Task Generative Framework for Detecting Aortic Dissection on 3D Non-contrast-enhanced Computed Tomography

1 code implementation journal 2022 Xiangyu Xiong, Yan Ding, Chuanqi Sun, Zhuoneng Zhang, Xiuhong Guan, Tianjing Zhang, Hao Chen, Hongyan Liu, Zhangbo Cheng, Lei Zhao, Xiaohai Ma, Guoxi Xie

Experiments also showed that the proposed framework could achieve an average accuracy of 0. 831, a sensitivity of 0. 938, and an F1-score of 0. 847 in comparison with seven state-of-the-art classification models used by three radiologists with junior, intermediate, and senior experiences, respectively.

GIDP: Learning a Good Initialization and Inducing Descriptor Post-enhancing for Large-scale Place Recognition

no code implementations23 Sep 2022 Zhaoxin Fan, Zhenbo Song, Hongyan Liu, Jun He

Large-scale place recognition is a fundamental but challenging task, which plays an increasingly important role in autonomous driving and robotics.

Autonomous Driving

Human Pose Driven Object Effects Recommendation

no code implementations17 Sep 2022 Zhaoxin Fan, Fengxin Li, Hongyan Liu, Jun He, Xiaoyong Du

In this paper, we research the new topic of object effects recommendation in micro-video platforms, which is a challenging but important task for many practical applications such as advertisement insertion.

Object

Reconstruction-Aware Prior Distillation for Semi-supervised Point Cloud Completion

no code implementations20 Apr 2022 Zhaoxin Fan, Yulin He, Zhicheng Wang, Kejian Wu, Hongyan Liu, Jun He

Real-world sensors often produce incomplete, irregular, and noisy point clouds, making point cloud completion increasingly important.

Point Cloud Completion

Object Level Depth Reconstruction for Category Level 6D Object Pose Estimation From Monocular RGB Image

no code implementations4 Apr 2022 Zhaoxin Fan, Zhenbo Song, Jian Xu, Zhicheng Wang, Kejian Wu, Hongyan Liu, Jun He

Recently, RGBD-based category-level 6D object pose estimation has achieved promising improvement in performance, however, the requirement of depth information prohibits broader applications.

6D Pose Estimation using RGB Object

RPR-Net: A Point Cloud-based Rotation-aware Large Scale Place Recognition Network

no code implementations29 Aug 2021 Zhaoxin Fan, Zhenbo Song, Wenping Zhang, Hongyan Liu, Jun He, Xiaoyong Du

Third, we apply these kernels to previous point cloud features to generate new features, which is the well-known SO(3) mapping process.

Autonomous Driving Point Cloud Retrieval +2

Deep Learning on Monocular Object Pose Detection and Tracking: A Comprehensive Overview

no code implementations29 May 2021 Zhaoxin Fan, Yazhi Zhu, Yulin He, Qi Sun, Hongyan Liu, Jun He

Therefore, this study presents a comprehensive review of recent progress in object pose detection and tracking that belongs to the deep learning technical route.

Autonomous Driving Object +1

Cannot find the paper you are looking for? You can Submit a new open access paper.