Search Results for author: Xuesong Niu

Found 12 papers, 6 papers with code

SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding

no code implementations17 Jan 2024 Baoxiong Jia, Yixin Chen, Huangyue Yu, Yan Wang, Xuesong Niu, Tengyu Liu, Qing Li, Siyuan Huang

In comparison to recent advancements in the 2D domain, grounding language in 3D scenes faces several significant challenges: (i) the inherent complexity of 3D scenes due to the diverse object configurations, their rich attributes, and intricate relationships; (ii) the scarcity of paired 3D vision-language data to support grounded learning; and (iii) the absence of a unified learning framework to distill knowledge from grounded 3D data.

Scene Understanding Visual Grounding

Neuron Structure Modeling for Generalizable Remote Physiological Measurement

1 code implementation CVPR 2023 Hao Lu, Zitong Yu, Xuesong Niu, Yingcong Chen

We show that most domain generalization methods do not work well in this problem, as domain labels are ambiguous in complicated environmental changes.

Domain Generalization

Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling

1 code implementation ECCV 2020 Xuesong Niu, Zitong Yu, Hu Han, Xiaobai Li, Shiguang Shan, Guoying Zhao

Remote physiological measurements, e. g., remote photoplethysmography (rPPG) based heart rate (HR), heart rate variability (HRV) and respiration frequency (RF) measuring, are playing more and more important roles under the application scenarios where contact measurement is inconvenient or impossible.

Heart Rate Variability

Face Anti-Spoofing with Human Material Perception

no code implementations ECCV 2020 Zitong Yu, Xiaobai Li, Xuesong Niu, Jingang Shi, Guoying Zhao

In this paper we rephrase face anti-spoofing as a material recognition problem and combine it with classical human material perception [1], intending to extract discriminative and robust features for FAS.

Face Anti-Spoofing Face Recognition +1

AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching

no code implementations26 Apr 2020 Zitong Yu, Xiaobai Li, Xuesong Niu, Jingang Shi, Guoying Zhao

Remote photoplethysmography (rPPG), which aims at measuring heart activities without any contact, has great potential in many applications (e. g., remote healthcare).

Data Augmentation Neural Architecture Search +1

RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representation

no code implementations25 Oct 2019 Xuesong Niu, Shiguang Shan, Hu Han, Xilin Chen

Recently, some methods have been proposed for remote HR estimation from face videos; however, most of them focus on well-controlled scenarios, their generalization ability into less-constrained scenarios (e. g., with head movement, and bad illumination) are not known.

Heart rate estimation

Multi-label Co-regularization for Semi-supervised Facial Action Unit Recognition

1 code implementation NeurIPS 2019 Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen

In this work, we propose a semi-supervised approach for AU recognition utilizing a large number of web face images without AU labels and a relatively small face dataset with AU annotations inspired by the co-training methods.

Emotion Recognition Facial Action Unit Detection

Local Relationship Learning With Person-Specific Shape Regularization for Facial Action Unit Detection

no code implementations CVPR 2019 Xuesong Niu, Hu Han, Songfan Yang, Yan Huang, Shiguang Shan

Encoding individual facial expressions via action units (AUs) coded by the Facial Action Coding System (FACS) has been found to be an effective approach in resolving the ambiguity issue among different expressions.

Action Unit Detection Facial Action Unit Detection

VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video

1 code implementation11 Oct 2018 Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen

We also learn a deep HR estimator (named as RhythmNet) with the proposed spatial-temporal representation, which achieves promising results on both the public-domain and our VIPL-HR HR estimation databases.

Representation Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.