Search Results for author:
Found 85 papers, 31 papers with code
Surveillance Face Presentation Attack Detection Challenge
Based on this dataset and protocol-$3$ for evaluating the robustness of the algorithm under quality changes, we organized a face presentation attack detection challenge in surveillance scenarios.
Wild Face Anti-Spoofing Challenge 2023: Benchmark and Results
Leveraging the WFAS dataset and Protocol 1 (Known-Type), we host the Wild Face Anti-Spoofing Challenge at the CVPR2023 workshop.
Blowing in the Wind: CycleNet for Human Cinemagraphs from Still Images
We investigate the problem in the context of dressed humans under the wind.
Meta-Album: Multi-domain Meta-Dataset for Few-Shot Image Classification
We introduce Meta-Album, an image classification meta-dataset designed to facilitate few-shot learning, transfer learning, meta-learning, among other tasks.
Surveillance Face Anti-spoofing
In order to promote relevant research and fill this gap in the community, we collect a large-scale Surveillance High-Fidelity Mask (SuHiFiMask) dataset captured under 40 surveillance scenes, which has 101 subjects from different age groups with 232 3D attacks (high-fidelity masks), 200 2D attacks (posters, portraits, and screens), and 2 adversarial attacks.
Neural Cloth Simulation
Here, we propose the first methodology able to learn realistic cloth dynamics unsupervisedly, and henceforth, a general formulation for neural cloth simulation.
BeLFusion: Latent Diffusion for Behavior-Driven Human Motion Prediction
To address these issues, we present BeLFusion, a model that, for the first time, leverages latent diffusion models in HMP to sample from a latent space where behavior is disentangled from pose and motion.
Ranked #1 on
Human Pose Forecasting
on AMASS
(ADE metric)
SoccerNet 2022 Challenges Results
The SoccerNet 2022 challenges were the second annual video understanding challenges organized by the SoccerNet team.
NeurIPS'22 Cross-Domain MetaDL competition: Design and baseline results
We present the design and baseline results for a new challenge in the ChaLearn meta-learning series, accepted at NeurIPS'22, focusing on "cross-domain" meta-learning.
A Non-Anatomical Graph Structure for isolated hand gesture separation in continuous gesture sequences
Recently, one model has been presented to deal with the challenge of the boundary detection of isolated gestures in a continuous gesture video [17].
UniUD-FBK-UB-UniBZ Submission to the EPIC-Kitchens-100 Multi-Instance Retrieval Challenge 2022
This report presents the technical details of our submission to the EPIC-Kitchens-100 Multi-Instance Retrieval Challenge 2022.
Ranked #1 on
Multi-Instance Retrieval
on EPIC-KITCHENS-100
Relevance-based Margin for Contrastively-trained Video Retrieval Models
We show that even if we carefully tuned the fixed margin, our technique (which does not have the margin as a hyper-parameter) would still achieve better performance.
Ranked #4 on
Multi-Instance Retrieval
on EPIC-KITCHENS-100
Word separation in continuous sign language using isolated signs and post-processing
Results of the continuous sign videos confirm the efficiency of the proposed model to deal with isolated sign boundaries detection.
Towards explaining the generalization gap in neural networks using topological data analysis
Understanding how neural networks generalize on unseen data is crucial for designing more robust and reliable models.
Towards Self-Supervised Gaze Estimation
Recent joint embedding-based self-supervised methods have surpassed standard supervised approaches on various image recognition tasks such as image classification.
Gate-Shift-Fuse for Video Action Recognition
3D kernel factorization approaches have been proposed to reduce the complexity of 3D CNNs.
Ranked #12 on
Action Recognition
on EPIC-KITCHENS-100
(using extra training data)
Comparison of Spatio-Temporal Models for Human Motion and Pose Forecasting in Face-to-Face Interaction Scenarios
In this work, we present the first systematic comparison of state-of-the-art approaches for behavior forecasting.
Didn't see that coming: a survey on non-verbal social human behavior forecasting
Non-verbal social human behavior forecasting has increasingly attracted the interest of the research community in recent years.
Video Transformers: A Survey
Transformer models have shown great success handling long-range interactions, making them a promising tool for modeling video.
Winning solutions and post-challenge analyses of the ChaLearn AutoDL challenge 2019
Code submissions were executed on hidden tasks, with limited time and computational resources, pushing solutions that get results quickly.
MyoPS: A Benchmark of Myocardial Pathology Segmentation Combining Three-Sequence Cardiac Magnetic Resonance Images
Assessment of myocardial viability is essential in diagnosis and treatment management of patients suffering from myocardial infarction, and classification of pathology on myocardium is the key to this assessment.
CrossMoDA 2021 challenge: Benchmark of Cross-Modality Domain Adaptation techniques for Vestibular Schwannoma and Cochlea Segmentation
The aim was to automatically perform unilateral VS and bilateral cochlea segmentation on hrT2 as provided in the testing set (N=137).
All You Need In Sign Language Production
To make an easy and mutual communication between the hearing-impaired and the hearing communities, building a robust system capable of translating the spoken language into sign language and vice versa is fundamental.
Cultural Vocal Bursts Intensity Prediction
Sign Language Production
+2
Multi-Task Classification of Sewer Pipe Defects and Properties using a Cross-Task Graph Neural Network Decoder
In order to efficiently manage the sewerage infrastructure, automated sewer inspection has to be utilized.
Codabench: Flexible, Easy-to-Use and Reproducible Benchmarking Platform
A public instance of Codabench (https://www. codabench. org/) is open to everyone, free of charge, and allows benchmark organizers to compare fairly submissions, under the same setting (software, hardware, data, algorithms), with custom protocols and data formats.
SAIC_Cambridge-HuPBA-FBK Submission to the EPIC-Kitchens-100 Action Recognition Challenge 2021
This report presents the technical details of our submission to the EPIC-Kitchens-100 Action Recognition Challenge 2021.
Neural Implicit Surfaces for Efficient and Accurate Collisions in Physically Based Simulations
Nonetheless, their memory footprint also grows rapidly and their parallelization in a GPU is problematic due to their branching nature.
Dyadformer: A Multi-modal Transformer for Long-Range Modeling of Dyadic Interactions
Personality computing has become an emerging topic in computer vision, due to the wide range of applications it can be used for.
Multi-Modal Zero-Shot Sign Language Recognition
Zero-Shot Learning (ZSL) has rapidly advanced in recent years.
ZS-SLR: Zero-Shot Sign Language Recognition from RGB-D Videos
To benefit from the vision Transformer capabilities, we use two vision Transformer models, for human detection and visual features representation.
3D High-Fidelity Mask Face Presentation Attack Detection Challenge
The threat of 3D masks to face recognition systems is increasingly serious and has been widely concerned by researchers.
ChaLearn Looking at People: Inpainting and Denoising challenges
Dealing with incomplete information is a well studied problem in the context of machine learning and computational intelligence.
Deep unsupervised 3D human body reconstruction from a sparse set of landmarks
In this paper we propose the first deep unsupervised approach in human body reconstruction to estimate body surface from a sparse set of landmarks, so called DeepMurf.
ChaLearn LAP Large Scale Signer Independent Isolated Sign Language Recognition Challenge: Design, Results and Future Research
However, several open challenges still need to be solved to allow SLR to be useful in practice.
Deep learning with self-supervision and uncertainty regularization to count fish in underwater images
From experiments on both contrasting datasets, we demonstrate our network outperforms the few other deep learning models implemented for solving this task.
Contrastive Context-Aware Learning for 3D High-Fidelity Mask Face Presentation Attack Detection
To bridge the gap to real-world applications, we introduce a largescale High-Fidelity Mask dataset, namely CASIA-SURF HiFiMask (briefly HiFiMask).
Sign Language Production: A Review
Sign Language is the dominant yet non-primary form of communication language used in the deaf and hearing-impaired community.
Learning to Recognize Actions on Objects in Egocentric Video with Attention Dictionaries
We present EgoACO, a deep neural architecture for video action recognition that learns to pool action-context-object descriptors from frame level features by leveraging the verb-noun structure of action labels in egocentric video datasets.
Context-Aware Personality Inference in Dyadic Scenarios: Introducing the UDIVA Dataset
This paper introduces UDIVA, a new non-acted dataset of face-to-face dyadic interactions, where interlocutors perform competitive and collaborative tasks with different behavior elicitation and cognitive workload.
PBNS: Physically Based Neural Simulator for Unsupervised Garment Pose Space Deformation
While deep-based approaches in the domain are becoming a trend, these are data-hungry models.
Person Perception Biases Exposed: Revisiting the First Impressions Dataset
This work revisits the ChaLearn First Impressions database, annotated for personality perception using pairwise comparisons via crowdsourcing.
FairFace Challenge at ECCV 2020: Analyzing Bias in Face Recognition
This work summarizes the 2020 ChaLearn Looking at People Fair Face Recognition and Analysis Challenge and provides a description of the top-winning solutions and analysis of the results.
DeePSD: Automatic Deep Skinning And Pose Space Deformation For 3D Garment Animation
We present a novel solution to the garment animation problem through deep learning.
FBK-HUPBA Submission to the EPIC-Kitchens Action Recognition 2020 Challenge
In this report we describe the technical details of our submission to the EPIC-Kitchens Action Recognition 2020 Challenge.
Computing the Testing Error without a Testing Set
Here, we derive an algorithm to estimate the performance gap between training and testing that does not require any testing dataset.
Cross-ethnicity Face Anti-spoofing Recognition Challenge: A Review
Although ethnic bias has been verified to severely affect the performance of face recognition systems, it still remains an open research problem in face anti-spoofing.
CASIA-SURF CeFA: A Benchmark for Multi-modal Cross-ethnicity Face Anti-spoofing
Ethnic bias has proven to negatively affect the performance of face recognition systems, and it remains an open research problem in face anti-spoofing.
Multi-level Context Gating of Embedded Collective Knowledge for Medical Image Segmentation
These blocks adaptively recalibrate the channel-wise feature responses by utilizing a self-gating mechanism of the global information embedding of the feature maps.
Ranked #6 on
Lesion Segmentation
on ISIC 2018
Static and Dynamic Fusion for Multi-modal Cross-ethnicity Face Anti-spoofing
Regardless of the usage of deep learning and handcrafted methods, the dynamic information from videos and the effect of cross-ethnicity are rarely considered in face anti-spoofing.
Gate-Shift Networks for Video Action Recognition
Deep 3D CNNs for video action recognition are designed to learn powerful representations in the joint spatio-temporal feature space.
Ranked #21 on
Action Recognition
on Something-Something V1
(using extra training data)
On the Effect of Observed Subject Biases in Apparent Personality Analysis from Audio-visual Signals
Furthermore, given the interpretability nature of our network design, we provide an incremental analysis on the impact of each possible source of bias on final network predictions.
Bi-Directional ConvLSTM U-Net with Densley Connected Convolutions
To strengthen feature propagation and encourage feature reuse, we use densely connected convolutions in the last convolutional layer of the encoding path.
Ranked #1 on
Lung Nodule Segmentation
on Lung Nodule
CASIA-SURF: A Large-scale Multi-modal Benchmark for Face Anti-spoofing
To facilitate face anti-spoofing research, we introduce a large-scale multi-modal dataset, namely CASIA-SURF, which is the largest publicly available dataset for face anti-spoofing in terms of both subjects and modalities.
ChaLearn Looking at People: IsoGD and ConGD Large-scale RGB-D Gesture Recognition
The ChaLearn large-scale gesture recognition challenge has been run twice in two workshops in conjunction with the International Conference on Pattern Recognition (ICPR) 2016 and International Conference on Computer Vision (ICCV) 2017, attracting more than $200$ teams round the world.
FBK-HUPBA Submission to the EPIC-Kitchens 2019 Action Recognition Challenge
In this report we describe the technical details of our submission to the EPIC-Kitchens 2019 action recognition challenge.
Hierarchical Feature Aggregation Networks for Video Action Recognition
Most action recognition methods base on a) a late aggregation of frame level CNN features using average pooling, max pooling, or RNN, among others, or b) spatio-temporal aggregation via 3D convolutions.
Ranked #49 on
Action Recognition
on HMDB-51
(using extra training data)
Analysis of the AutoML Challenge Series 2015–2018
The solutions of the winners are systematically benchmarked over all datasets of all rounds and compared with canonical machine learning algorithms available in scikit-learn.
Ranked #1 on
AutoML
on Chalearn-AutoML-1
Multi-task human analysis in still images: 2D/3D pose, depth map, and multi-part segmentation
In this work, we analyze four related human analysis tasks in still images in a multi-task scenario by leveraging such datasets.
On the effect of age perception biases for real age regression
Our model outperformed a state-of-the-art architecture proposed to separately address apparent and real age regression.
SMPLR: Deep SMPL reverse for 3D human pose and shape recovery
By implementing SMPLR as an encoder-decoder we avoid the need of complex constraints on pose and shape.
A Dataset and Benchmark for Large-scale Multi-modal Face Anti-spoofing
To facilitate face anti-spoofing research, we introduce a large-scale multi-modal dataset, namely CASIA-SURF, which is the largest publicly available dataset for face anti-spoofing in terms of both subjects and visual modalities.
LSTA: Long Short-Term Attention for Egocentric Action Recognition
Egocentric activity recognition is one of the most challenging tasks in video analysis.
Ranked #4 on
Egocentric Activity Recognition
on EGTEA
From 2D to 3D Geodesic-based Garment Matching
A new approach for 2D to 3D garment retexturing is proposed based on Gaussian mixture models and thin plate splines (TPS).
Beyond One-hot Encoding: lower dimensional target embedding
Following this observation, we embed the targets into a low-dimensional space, drastically improving convergence speed while preserving accuracy.
Recurrent CNN for 3D Gaze Estimation using Appearance and Shape Cues
Gaze behavior is an important non-verbal cue in social signal processing and human-computer interaction.
Ranked #1 on
Gaze Estimation
on EYEDIAP (screen target)
First Impressions: A Survey on Vision-Based Apparent Personality Trait Analysis
However, recently there has been an increasing interest from the computer vision community in analyzing personality from visual data.
Exploiting feature representations through similarity learning, post-ranking and ranking aggregation for person re-identification
In this work, we propose to exploit a post-ranking approach and combine different feature representations through ranking aggregation.
Deep Structure Inference Network for Facial Action Unit Recognition
In recent years, most efforts in automatic AU recognition have been dedicated to learning combinations of local features and to exploiting correlations between Action Units.
Explaining First Impressions: Modeling, Recognizing, and Explaining Apparent Personality from Videos
Explainability and interpretability are two critical aspects of decision support systems.
Survey on Emotional Body Gesture Recognition
Automatic emotion recognition has become a trending research topic in the past decade.
Cultural Vocal Bursts Intensity Prediction
Emotion Recognition
+4
Depth-Based 3D Hand Pose Estimation: From Current Achievements to Future Goals
Official Torch7 implementation of "V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Map", CVPR 2018
Ranked #4 on
Hand Pose Estimation
on HANDS 2017
Folded Recurrent Neural Networks for Future Video Prediction
Future video prediction is an ill-posed Computer Vision problem that recently received much attention.
Ranked #1 on
Video Prediction
on KTH
(Cond metric)
RGB-D-based Human Motion Recognition with Deep Learning: A Survey
Specifically, deep learning methods based on the CNN and RNN architectures have been adopted for motion recognition using RGB-D data.
Automatic Recognition of Facial Displays of Unfelt Emotions
Performance of the proposed model shows that on average it is easier to distinguish among genuine facial expressions of emotion than among unfelt facial expressions of emotion and that certain emotion pairs such as contempt and disgust are more difficult to distinguish than the rest.
End-to-end Global to Local CNN Learning for Hand Pose Recovery in Depth Data
Despite recent advances in 3D pose estimation of human hands, especially thanks to the advent of CNNs and depth cameras, this task is still far from being solved.
WordFence: Text Detection in Natural Images with Border Awareness
In recent years, text recognition has achieved remarkable success in recognizing scanned document text.
End-to-end semantic face segmentation with conditional random fields as convolutional, recurrent and adversarial networks
Recent years have seen a sharp increase in the number of related yet distinct advances in semantic segmentation.
ChaLearn Looking at People: A Review of Events and Resources
This paper reviews associated events, and introduces the ChaLearn LAP platform where public resources (including code, data and preprints of papers) related to the organized events are available.
ChaLearn Looking at People and Faces of the World: Face Analysis Workshop and Challenge 2016
A custom-build application was used to collect and label data about the apparent age of people (as opposed to the real age).
Ranked #2 on
Gender Prediction
on FotW Gender
Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-related Applications
Facial expressions are an important way through which humans interact socially.
Support Vector Machines with Time Series Distance Kernels for Action Classification
Bagheri, Q. Gao, and S. Escalera, "Support Vector Machines with Time Series Distance Kernels for Action Classification", in Proc.
Error-Correcting Factorization
To address these limitations this paper proposes an Error-Correcting Factorization (ECF) method, our contribution is three fold: (I) We propose a novel representation of the error-correction capability, called the design matrix, that enables us to build an ECOC on the basis of allocating correction to pairs of classes.
Non-Verbal Communication Analysis in Victim-Offender Mediations
In this paper we present a non-invasive ambient intelligence framework for the semi-automatic analysis of non-verbal communication applied to the restorative justice field.
A Gesture Recognition System for Detecting Behavioral Patterns of ADHD
We propose an extension of DTW using one-class classifiers in order to be able to encode the variability of a gesture category, and thus, perform an alignment between a gesture sample and a gesture class.
