Search Results for author: Guoying Zhao

Found 78 papers, 25 papers with code

Sorted Convolutional Network for Achieving Continuous Rotational Invariance

no code implementations23 May 2023 Hanlin Mo, Guoying Zhao

The topic of achieving rotational invariance in convolutional neural networks (CNNs) has gained considerable attention recently, as this invariance is crucial for many computer vision tasks such as image classification and matching.

Data Augmentation Image Classification

Prior Information based Decomposition and Reconstruction Learning for Micro-Expression Recognition

no code implementations3 Mar 2023 Jinsheng Wei, Haoyu Chen, Guanming Lu, Jingjie Yan, Yue Xie, Guoying Zhao

To solve this issue, driven by the prior information that the category of ME can be inferred by the relationship between the actions of facial different components, this work designs a novel model that can conform to this prior information and learn ME movement features in an interpretable way.

Graph Representation Learning Micro Expression Recognition +1

PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformer

no code implementations7 Feb 2023 Zitong Yu, Yuming Shen, Jingang Shi, Hengshuang Zhao, Yawen Cui, Jiehua Zhang, Philip Torr, Guoying Zhao

As key modules in PhysFormer, the temporal difference transformers first enhance the quasi-periodic rPPG features with temporal difference guided global attention, and then refine the local spatio-temporal representation against interference.

Advancing 3D finger knuckle recognition via deep feature learning

1 code implementation7 Jan 2023 Kevin H. M. Cheng, Xu Cheng, Guoying Zhao

However, this approach results in a large feature dimension, and the trained classification layer is required for comparing probe samples, which limits the introduction of new classes.

Uncertain Facial Expression Recognition via Multi-task Assisted Correction

no code implementations14 Dec 2022 Yang Liu, Xingming Zhang, Janne Kauttonen, Guoying Zhao

Specifically, a confidence estimation block and a weighted regularization module are applied to highlight solid samples and suppress uncertain samples in every batch.

Action Unit Detection Facial Expression Recognition (FER)

Data Leakage and Evaluation Issues in Micro-Expression Analysis

1 code implementation21 Nov 2022 Tuomas Varanka, Yante Li, Wei Peng, Guoying Zhao

Micro-expressions have drawn increasing interest lately due to various potential applications.

Micro-Expression Recognition

RIC-CNN: Rotation-Invariant Coordinate Convolutional Neural Network

no code implementations21 Nov 2022 Hanlin Mo, Guoying Zhao

Using MNIST dataset, we first evaluate the rotation invariance of RIC-CNN and compare its performance with most of existing rotation-invariant CNN models.

Data Augmentation

Exploring Interactions and Regulations in Collaborative Learning: An Interdisciplinary Multimodal Dataset

no code implementations11 Oct 2022 Yante Li, Yang Liu, KhÁnh Nguyen, Henglin Shi, Eija Vuorenmaa, Sanna Jarvela, Guoying Zhao

Collaborative learning is an educational approach that enhances learning through shared goals and working together.

Learning Optimal K-space Acquisition and Reconstruction using Physics-Informed Neural Networks

no code implementations CVPR 2022 Wei Peng, Li Feng, Guoying Zhao, Fang Liu

While most of these methods focus on designing novel reconstruction networks or new training strategies for a given undersampling pattern, e. g., Cartesian undersampling or Non-Cartesian sampling, to date, there is limited research aiming to learn and optimize k-space sampling strategies using deep neural networks.

Image Reconstruction

Gaussian-Hermite Moment Invariants of General Multi-Channel Functions

no code implementations3 Jan 2022 Hanlin Mo, Hua Li, Guoying Zhao

Then, we design a structural framework to generate Gaussian-Hermite moment invariants for these two transform models systematically.

Image Classification Template Matching

Review of Face Presentation Attack Detection Competitions

no code implementations21 Dec 2021 Zitong Yu, Jukka Komulainen, Xiaobai Li, Guoying Zhao

Face presentation attack detection (PAD) has received increasing attention ever since the vulnerabilities to spoofing have been widely recognized.

Face Anti-Spoofing Face Presentation Attack Detection

Geometry-Contrastive Transformer for Generalized 3D Pose Transfer

1 code implementation14 Dec 2021 Haoyu Chen, Hao Tang, Zitong Yu, Nicu Sebe, Guoying Zhao

Specifically, we propose a novel geometry-contrastive Transformer that has an efficient 3D structured perceiving ability to the global geometric inconsistencies across the given meshes.

Pose Transfer

PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer

1 code implementation CVPR 2022 Zitong Yu, Yuming Shen, Jingang Shi, Hengshuang Zhao, Philip Torr, Guoying Zhao

Remote photoplethysmography (rPPG), which aims at measuring heart activities and physiological signals from facial video without any contact, has great potential in many applications (e. g., remote healthcare and affective computing).

AniFormer: Data-driven 3D Animation with Transformer

1 code implementation20 Oct 2021 Haoyu Chen, Hao Tang, Nicu Sebe, Guoying Zhao

Instead, we introduce AniFormer, a novel Transformer-based architecture, that generates animated 3D sequences by directly taking the raw driving sequences and arbitrary same-type target meshes as inputs.


Looking Back on Learned Experiences For Class/task Incremental Learning

no code implementations ICLR 2022 Mozhgan PourKeshavarzi, Guoying Zhao, Mohammad Sabokrou

In this paper, we shed light on an on-call transfer set to provide past experiences whenever a new task arises in the data stream.

Incremental Learning

Deep Learning for Micro-expression Recognition: A Survey

no code implementations6 Jul 2021 Yante Li, Jinsheng Wei, Yang Liu, Janne Kauttonen, Guoying Zhao

In this survey, we provide a comprehensive review of deep micro-expression recognition (MER), including datasets, deep MER pipeline, and the bench-marking of most influential methods.

Micro Expression Recognition Micro-Expression Recognition

Deep Learning for Face Anti-Spoofing: A Survey

2 code implementations28 Jun 2021 Zitong Yu, Yunxiao Qin, Xiaobai Li, Chenxu Zhao, Zhen Lei, Guoying Zhao

Face anti-spoofing (FAS) has lately attracted increasing attention due to its vital role in securing face recognition systems from presentation attacks (PAs).

Domain Generalization Face Anti-Spoofing +1

Non-contact Pain Recognition from Video Sequences with Remote Physiological Measurements Prediction

no code implementations18 May 2021 Ruijing Yang, Ziyu Guan, Zitong Yu, Xiaoyi Feng, Jinye Peng, Guoying Zhao

The framework is able to capture both local and long-range dependencies via the proposed attention mechanism for the learned appearance representations, which are further enriched by temporally attended physiological cues (remote photoplethysmography, rPPG) that are recovered from videos in the auxiliary task.

Medical Diagnosis Multi-Task Learning

Dual-Cross Central Difference Network for Face Anti-Spoofing

1 code implementation4 May 2021 Zitong Yu, Yunxiao Qin, Hengshuang Zhao, Xiaobai Li, Guoying Zhao

In this paper, we propose two Cross Central Difference Convolutions (C-CDC), which exploit the difference of the center and surround sparse local features from the horizontal/vertical and diagonal directions, respectively.

Face Anti-Spoofing Face Recognition

TransRPPG: Remote Photoplethysmography Transformer for 3D Mask Face Presentation Attack Detection

no code implementations15 Apr 2021 Zitong Yu, Xiaobai Li, Pichao Wang, Guoying Zhao

3D mask face presentation attack detection (PAD) plays a vital role in securing face recognition systems from emergent 3D mask attacks.

Face Presentation Attack Detection Face Recognition

The MuSe 2021 Multimodal Sentiment Analysis Challenge: Sentiment, Emotion, Physiological-Emotion, and Stress

1 code implementation14 Apr 2021 Lukas Stappen, Alice Baird, Lukas Christ, Lea Schumann, Benjamin Sertolli, Eva-Maria Messner, Erik Cambria, Guoying Zhao, Björn W. Schuller

Multimodal Sentiment Analysis (MuSe) 2021 is a challenge focusing on the tasks of sentiment and emotion, as well as physiological-emotion and emotion-based stress recognition through more comprehensively integrating the audio-visual, language, and biological signal modalities.

Emotion Recognition Multimodal Sentiment Analysis

Hyperbolic Deep Neural Networks: A Survey

1 code implementation12 Jan 2021 Wei Peng, Tuomas Varanka, Abdelrahman Mostafa, Henglin Shi, Guoying Zhao

Recently, there has been a rising surge of momentum for deep representation learning in hyperbolic spaces due to theirhigh capacity of modeling data like knowledge graphs or synonym hierarchies, possessing hierarchical structure.

Knowledge Graphs Representation Learning

A hybrid quantum-classical neural network with deep residual learning

no code implementations14 Dec 2020 Yanying Liang, Wei Peng, Zhu-Jun Zheng, Olli Silvén, Guoying Zhao

In this paper, a novel hybrid quantum-classical neural network with deep residual learning (Res-HQCNN) is proposed.

Revisiting Pixel-Wise Supervision for Face Anti-Spoofing

1 code implementation24 Nov 2020 Zitong Yu, Xiaobai Li, Jingang Shi, Zhaoqiang Xia, Guoying Zhao

Face anti-spoofing (FAS) plays a vital role in securing face recognition systems from the presentation attacks (PAs).

Face Anti-Spoofing Face Recognition

2nd Place Scheme on Action Recognition Track of ECCV 2020 VIPriors Challenges: An Efficient Optical Flow Stream Guided Framework

no code implementations10 Aug 2020 Haoyu Chen, Zitong Yu, Xin Liu, Wei Peng, Yoon Lee, Guoying Zhao

To address the problem of training on small datasets for action recognition tasks, most prior works are either based on a large number of training samples or require pre-trained models transferred from other large datasets to tackle overfitting problems.

Action Recognition Optical Flow Estimation

Mix Dimension in Poincaré Geometry for 3D Skeleton-based Action Recognition

no code implementations30 Jul 2020 Wei Peng, Jingang Shi, Zhaoqiang Xia, Guoying Zhao

In human action recognition, current works introduce a dynamic graph generation mechanism to better capture the underlying semantic skeleton connections and thus improves the performance.

Action Recognition Anatomy +3

Micro-expression spotting: A new benchmark

no code implementations24 Jul 2020 Thuong-Khanh Tran, Quang-Nhat Vo, Xiaopeng Hong, Xiaobai Li, Guoying Zhao

Micro-expressions (MEs) are brief and involuntary facial expressions that occur when people are trying to hide their true feelings or conceal their emotions.

Micro-Expression Spotting

Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling

1 code implementation ECCV 2020 Xuesong Niu, Zitong Yu, Hu Han, Xiaobai Li, Shiguang Shan, Guoying Zhao

Remote physiological measurements, e. g., remote photoplethysmography (rPPG) based heart rate (HR), heart rate variability (HRV) and respiration frequency (RF) measuring, are playing more and more important roles under the application scenarios where contact measurement is inconvenient or impossible.

Heart Rate Variability

Face Anti-Spoofing with Human Material Perception

no code implementations ECCV 2020 Zitong Yu, Xiaobai Li, Xuesong Niu, Jingang Shi, Guoying Zhao

In this paper we rephrase face anti-spoofing as a material recognition problem and combine it with classical human material perception [1], intending to extract discriminative and robust features for FAS.

Face Anti-Spoofing Face Recognition +1

Revealing the Invisible with Model and Data Shrinking for Composite-database Micro-expression Recognition

no code implementations17 Jun 2020 Zhaoqiang Xia, Wei Peng, Huai-Qian Khor, Xiaoyi Feng, Guoying Zhao

In this paper, we analyze the influence of learning complexity, including the input complexity and model complexity, and discover that the lower-resolution input data and shallower-architecture model are helpful to ease the degradation of deep models in composite-database task.

Micro Expression Recognition Micro-Expression Recognition +1

AutoHR: A Strong End-to-end Baseline for Remote Heart Rate Measurement with Neural Searching

no code implementations26 Apr 2020 Zitong Yu, Xiaobai Li, Xuesong Niu, Jingang Shi, Guoying Zhao

Remote photoplethysmography (rPPG), which aims at measuring heart activities without any contact, has great potential in many applications (e. g., remote healthcare).

Data Augmentation Neural Architecture Search +1

Multi-Modal Face Anti-Spoofing Based on Central Difference Networks

1 code implementation17 Apr 2020 Zitong Yu, Yunxiao Qin, Xiaobai Li, Zezheng Wang, Chenxu Zhao, Zhen Lei, Guoying Zhao

Face anti-spoofing (FAS) plays a vital role in securing face recognition systems from presentation attacks.

Face Anti-Spoofing Face Recognition

Searching Central Difference Convolutional Networks for Face Anti-Spoofing

3 code implementations CVPR 2020 Zitong Yu, Chenxu Zhao, Zezheng Wang, Yunxiao Qin, Zhuo Su, Xiaobai Li, Feng Zhou, Guoying Zhao

Here we propose a novel frame level FAS method based on Central Difference Convolution (CDC), which is able to capture intrinsic detailed patterns via aggregating both intensity and gradient information.

Face Anti-Spoofing Face Recognition +1

Deep-HR: Fast Heart Rate Estimation from Face Video Under Realistic Conditions

no code implementations12 Feb 2020 Mohammad Sabokrou, Masoud Pourreza, Xiaobai Li, Mahmood Fathy, Guoying Zhao

In this paper, we propose a simple yet efficient approach to benefit the advantages of the Deep Neural Network (DNN) by simplifying HR estimation from a complex task to learning from very correlated representation to HR.

Heart rate estimation regression

Towards Reading Beyond Faces for Sparsity-Aware 4D Affect Recognition

no code implementations8 Feb 2020 Muzammil Behzad, Nhat Vo, Xiaobai Li, Guoying Zhao

Importantly, we then present a sparsity-aware deep network to compute the sparse representations of convolutional features over multi-views.

Facial Expression Recognition (FER)

Learning Graph Convolutional Network for Skeleton-based Human Action Recognition by Neural Searching

1 code implementation11 Nov 2019 Wei Peng, Xiaopeng Hong, Haoyu Chen, Guoying Zhao

Human action recognition from skeleton data, fueled by the Graph Convolutional Network (GCN), has attracted lots of attention, due to its powerful capability of modeling non-Euclidean structure data.

Action Recognition Neural Architecture Search +1

Structured Modeling of Joint Deep Feature and Prediction Refinement for Salient Object Detection

1 code implementation ICCV 2019 Yingyue Xu, Dan Xu, Xiaopeng Hong, Wanli Ouyang, Rongrong Ji, Min Xu, Guoying Zhao

We formulate the CRF graphical model that involves message-passing of feature-feature, feature-prediction, and prediction-prediction, from the coarse scale to the finer scale, to update the features and the corresponding predictions.

object-detection RGB Salient Object Detection +1

Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancement

1 code implementation ICCV 2019 Zitong Yu, Wei Peng, Xiaobai Li, Xiaopeng Hong, Guoying Zhao

The method includes two parts: 1) a Spatio-Temporal Video Enhancement Network (STVEN) for video enhancement, and 2) an rPPG network (rPPGNet) for rPPG signal recovery.

Video Compression Video Enhancement

Automatic 4D Facial Expression Recognition via Collaborative Cross-domain Dynamic Image Network

no code implementations7 May 2019 Muzammil Behzad, Nhat Vo, Xiaobai Li, Guoying Zhao

This paper proposes a novel 4D Facial Expression Recognition (FER) method using Collaborative Cross-domain Dynamic Image Network (CCDN).

Facial Expression Recognition (FER)

Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networks

2 code implementations7 May 2019 Zitong Yu, Xiaobai Li, Guoying Zhao

Recent studies demonstrated that the average heart rate (HR) can be measured from facial videos based on non-contact remote photoplethysmography (rPPG).

Emotion Recognition Heart Rate Variability +1

A Boost in Revealing Subtle Facial Expressions: A Consolidated Eulerian Framework

no code implementations23 Jan 2019 Wei Peng, Xiaopeng Hong, Yingyue Xu, Guoying Zhao

Facial Micro-expression Recognition (MER) distinguishes the underlying emotional states of spontaneous subtle facialexpressions.

Micro Expression Recognition Micro-Expression Recognition +1

Spatiotemporal Recurrent Convolutional Networks for Recognizing Spontaneous Micro-expressions

no code implementations15 Jan 2019 Zhaoqiang Xia, Xiaopeng Hong, Xingyu Gao, Xiaoyi Feng, Guoying Zhao

To exploit the merits of deep learning, we propose a novel deep recurrent convolutional networks based micro-expression recognition approach, capturing the spatial-temporal deformations of micro-expression sequence.

Data Augmentation Micro Expression Recognition +1

Cross-Database Micro-Expression Recognition: A Benchmark

no code implementations19 Dec 2018 Yuan Zong, Tong Zhang, Wenming Zheng, Xiaopeng Hong, Chuangao Tang, Zhen Cui, Guoying Zhao

Cross-database micro-expression recognition (CDMER) is one of recently emerging and interesting problem in micro-expression analysis.

Domain Adaptation Micro Expression Recognition +1

SRN: Side-output Residual Network for Object Reflection Symmetry Detection and Beyond

1 code implementation17 Jul 2018 Wei Ke, Jie Chen, Jianbin Jiao, Guoying Zhao, Qixiang Ye

The end-to-end deep learning approach, referred to as a side-output residual network (SRN), leverages the output residual units (RUs) to fit the errors between the object ground-truth symmetry and the side-outputs of multiple stages.

Edge Detection Hand Pose Estimation +1

Texture Classification in Extreme Scale Variations using GANet

no code implementations13 Feb 2018 Li Liu, Jie Chen, Guoying Zhao, Paul Fieguth, Xilin Chen, Matti Pietikäinen

Because extreme scale variations are not necessarily present in most standard texture databases, to support the proposed extreme-scale aspects of texture understanding we are developing a new dataset, the Extreme Scale Variation Textures (ESVaT), to test the performance of our framework.

Classification General Classification +1

From BoW to CNN: Two Decades of Texture Representation for Texture Classification

no code implementations31 Jan 2018 Li Liu, Jie Chen, Paul Fieguth, Guoying Zhao, Rama Chellappa, Matti Pietikainen

Texture is a fundamental characteristic of many types of images, and texture representation is one of the essential and challenging problems in computer vision and pattern recognition which has attracted extensive research attention.

General Classification Texture Classification

Micro-Expression Spotting: A Benchmark

no code implementations8 Oct 2017 Xiaopeng Hong, Thuong-Khanh Tran, Guoying Zhao

Micro-expressions are rapid and involuntary facial expressions, which indicate the suppressed or concealed emotions.

Micro-Expression Spotting

PCANet-II: When PCANet Meets the Second Order Pooling

no code implementations30 Sep 2017 Lei Tian, Xiaopeng Hong, Guoying Zhao, Chunxiao Fan, Yue Ming, Matti Pietikäinen

Moreover, it is easy to combine other discriminative and robust cues by using the second order pooling.

Learning a Target Sample Re-Generator for Cross-Database Micro-Expression Recognition

no code implementations26 Jul 2017 Yuan Zong, Xiaohua Huang, Wenming Zheng, Zhen Cui, Guoying Zhao

In this paper, we investigate the cross-database micro-expression recognition problem, where the training and testing samples are from two different micro-expression databases.

Emotion Recognition Micro Expression Recognition +1

SRN: Side-output Residual Network for Object Symmetry Detection in the Wild

1 code implementation CVPR 2017 Wei Ke, Jie Chen, Jianbin Jiao, Guoying Zhao, Qixiang Ye

By stacking RUs in a deep-to-shallow manner, SRN exploits the 'flow' of errors among multiple scales to ease the problems of fitting complex outputs with limited layers, suppressing the complex backgrounds, and effectively matching object symmetry of different scales.

Symmetry Detection

Two decades of local binary patterns: A survey

no code implementations20 Dec 2016 Matti Pietikäinen, Guoying Zhao

In recent years very discriminative and computationally efficient local texture descriptors based on local binary patterns (LBP) have been developed, which has led to significant progress in applying texture methods to different problems and applications.

Vocal Bursts Valence Prediction

Spontaneous Facial Micro-Expression Recognition using Discriminative Spatiotemporal Local Binary Pattern with an Improved Integral Projection

no code implementations7 Aug 2016 Xiaohua Huang, Su-Jing Wang, Xin Liu, Guoying Zhao, Xiaoyi Feng, Matti Pietikainen

For increasing the discrimination of micro-expressions, we propose a new feature selection based on Laplacian method to extract the discriminative information for facial micro-expression recognition.

feature selection Micro Expression Recognition +1

Saliency Integration: An Arbitrator Model

no code implementations4 Aug 2016 Yingyue Xu, Xiaopeng Hong, Fatih Porikli, Xin Liu, Jie Chen, Guoying Zhao

Previous offline integration methods usually face two challenges: 1. if most of the candidate saliency models misjudge the saliency on an image, the integration result will lean heavily on those inferior candidate models; 2. an unawareness of the ground truth saliency labels brings difficulty in estimating the expertise of each candidate model.

Recurrent Convolutional Neural Network Regression for Continuous Pain Intensity Estimation in Video

no code implementations3 May 2016 Jing Zhou, Xiaopeng Hong, Fei Su, Guoying Zhao

To overcome this problem, we propose a real-time regression framework based on the recurrent convolutional neural network for automatic frame-level pain intensity estimation.

Pain Intensity Regression regression

LOAD: Local Orientation Adaptive Descriptor for Texture and Material Classification

no code implementations22 Apr 2015 Xianbiao Qi, Guoying Zhao, Linlin Shen, Qingquan Li, Matti Pietikainen

It is worth to mention that we achieve a 65. 4\% classification accuracy-- which is, to the best of our knowledge, the highest record by far --on Flickr Material Database by using a single feature.

General Classification Material Classification +2

HEp-2 Cell Classification via Fusing Texture and Shape Information

no code implementations16 Feb 2015 Xianbiao Qi, Guoying Zhao, Chun-Guang Li, Jun Guo, Matti Pietikäinen

Indirect Immunofluorescence (IIF) HEp-2 cell image is an effective evidence for diagnosis of autoimmune diseases.

Classification General Classification

Dynamic texture and scene classification by transferring deep image features

no code implementations1 Feb 2015 Xianbiao Qi, Chun-Guang Li, Guoying Zhao, Xiaopeng Hong, Matti Pietikäinen

Moreover we explore two different implementations of the TCoF scheme, i. e., the \textit{spatial} TCoF and the \textit{temporal} TCoF, in which the mean-removed frames and the difference between two adjacent frames are used as the inputs of the ConvNet, respectively.

Classification General Classification +2

Cannot find the paper you are looking for? You can Submit a new open access paper.