Search Results for author:
Found 41 papers, 18 papers with code
Real, fake and synthetic faces - does the coin have three sides?
This observation was supported by further analysis of various image properties.
Generation and Detection of Sign Language Deepfakes - A Linguistic and Visual Analysis
A question in the realm of deepfakes is slowly emerging pertaining to whether we can go beyond facial deepfakes and whether it would be beneficial to society.
GTA-HDR: A Large-Scale Synthetic Dataset for HDR Image Reconstruction
High Dynamic Range (HDR) content (i. e., images and videos) has a broad range of applications.
HistoHDR-Net: Histogram Equalization for Single LDR to HDR Image Translation
High Dynamic Range (HDR) imaging aims to replicate the high visual quality and clarity of real-world scenes.
DiffAugment: Diffusion based Long-Tailed Visual Relationship Recognition
The task of Visual Relationship Recognition (VRR) aims to identify relationships between two interacting objects in an image and is particularly challenging due to the widely-spread and highly imbalanced distribution of <subject, relation, object> triplets.
AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Dataset
The comprehensive benchmark of the proposed dataset utilizing state-of-the-art deepfake detection and localization methods indicates a significant drop in performance compared to previous datasets.
MAGIC-TBR: Multiview Attention Fusion for Transformer-based Bodily Behavior Recognition in Group Settings
Bodily behavioral language is an important social cue, and its automated analysis helps in enhancing the understanding of artificial intelligence systems.
ArtHDR-Net: Perceptually Realistic and Accurate HDR Content Creation
High Dynamic Range (HDR) content creation has become an important topic for modern media and entertainment sectors, gaming and Augmented/Virtual Reality industries.
Pavlok-Nudge: A Feedback Mechanism for Atomic Behaviour Modification with Snoring Usecase
To this end, we design a user interface to generate an automatic feedback mechanism that integrates Pavlok and a deep learning based model to detect certain behaviours via an integrated user interface i. e. mobile or desktop application.
Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localization
The proposed baseline method, Boundary Aware Temporal Forgery Detection (BA-TFD), is a 3D Convolutional Neural Network-based architecture which effectively captures multimodal manipulations.
Ranked #1 on
Temporal Forgery Localization
on ForgeryNet
Do I Have Your Attention: A Large Scale Engagement Prediction Dataset and Baselines
The experiments show the usefulness of the proposed dataset.
Audio-visual video face hallucination with frequency supervision and cross modality support by speech based lip reading loss
In order to learn these fine spatio-temporal motion details, we propose a novel cross-modal audio-visual Video Face Hallucination Generative Adversarial Network (VFH-GAN).
MARLIN: Masked Autoencoder for facial video Representation LearnINg
This paper proposes a self-supervised approach to learn universal facial representations from videos, that can transfer across a variety of facial analysis tasks such as Facial Attribute Recognition (FAR), Facial Expression Recognition (FER), DeepFake Detection (DFD), and Lip Synchronization (LS).
Ranked #1 on
Emotion Classification
on CMU-MOSEI
RAZE: Region Guided Self-Supervised Gaze Representation Learning
Automatic eye gaze estimation is an important problem in vision based assistive technology with use cases in different emerging topics such as augmented reality, virtual reality and human-computer interaction.
'Labelling the Gaps': A Weakly Supervised Automatic Eye Gaze Estimation
Our proposed method reduces the annotation effort to as low as 2. 67%, with minimal impact on performance; indicating the potential of our model enabling gaze estimation 'in-the-wild' setup.
Visual Representations of Physiological Signals for Fake Video Detection
We investigate two strategies for combining the video and physiology modalities, either by augmenting the video with information from the physiology or by novelly learning the fusion of those two modalities with a proposed Graph Convolutional Network architecture.
AV-Gaze: A Study on the Effectiveness of Audio Guided Visual Attention Estimation for Non-Profilic Faces
In challenging real-life conditions such as extreme head-pose, occlusions, and low-resolution images where the visual information fails to estimate visual attention/gaze direction, audio signals could provide important and complementary information.
Do You Really Mean That? Content Driven Audio-Visual Deepfake Dataset and Multimodal Method for Temporal Forgery Localization
Our baseline method for benchmarking the proposed dataset is a 3DCNN model, termed as Boundary Aware Temporal Forgery Detection (BA-TFD), which is guided via contrastive, boundary matching, and frame classification loss functions.
Ranked #1 on
DeepFake Detection
on LAV-DF
MTGLS: Multi-Task Gaze Estimation with Limited Supervision
Our proposed framework outperforms the unsupervised state-of-the-art on CAVE (by 6. 43%) and even supervised state-of-the-art methods on Gaze360 (by 6. 59%) datasets.
Frequency Aware Face Hallucination Generative Adversarial Network with Semantic Structural Constraint
To explicitly encode the high frequency components, an auto encoder is proposed to generate high resolution coefficients of Discrete Cosine Transform (DCT).
Automatic Gaze Analysis: A Survey of Deep Learning based Approaches
Eye gaze analysis is an important research problem in the field of Computer Vision and Human-Computer Interaction.
Self-Supervised Approach for Facial Movement Based Optical Flow
The aim of this work is threefold: (1) exploring self-supervised techniques to generate optical flow ground truth for face images; (2) computing baseline results on the effects of using face data to train Convolutional Neural Networks (CNN) for predicting optical flow; and (3) using the learned optical flow in micro-expression recognition to demonstrate its effectiveness.
Micro Expression Recognition
Micro-Expression Recognition
+1
FakeBuster: A DeepFakes Detection Tool for Video Conferencing Scenarios
This paper proposes a new DeepFake detector FakeBuster for detecting impostors during video conferencing and manipulated faces on social media.
Hyperrealistic Image Inpainting with Hypergraphs
In this paper, we introduce hypergraph convolution on spatial features to learn the complex relationship among the data.
The eyes know it: FakeET -- An Eye-tracking Database to Understand Deepfake Perception
We present \textbf{FakeET}-- an eye-tracking database to understand human visual perception of \emph{deepfake} videos.
Not made for each other- Audio-Visual Dissonance-based Deepfake Detection and Localization
MDS is computed as an aggregate of dissimilarity scores between audio and visual segments in a video.
Motion and Region Aware Adversarial Learning for Fall Detection with Thermal Imaging
A larger reconstruction error indicates the occurrence of a fall.
Speak2Label: Using Domain Knowledge for Creating a Large Scale Driver Gaze Zone Estimation Dataset
In this paper, a fully automatic technique for labelling an image based gaze behavior dataset for driver gaze zone estimation is proposed.
Unsupervised Learning of Eye Gaze Representation from the Web
Automatic eye gaze estimation has interested researchers for a while now.
Predicting Group Cohesiveness in Images
We study the factors that influence the perception of group-level cohesion and propose methods for estimating the human-perceived cohesion on the group cohesiveness scale.
Clustering and Learning from Imbalanced Data
A learning classifier must outperform a trivial solution, in case of imbalanced data, this condition usually does not hold true.
EmotiW 2018: Audio-Video, Student Engagement and Group-Level Affect Prediction
This paper details the sixth Emotion Recognition in the Wild (EmotiW) challenge.
Expression Empowered ResiDen Network for Facial Action Unit Detection
The proposed network achieves state-of-art results on the two databases.
DIF : Dataset of Perceived Intoxicated Faces for Drunk Person Identification
Convolutional Neural Networks (CNN) and Deep Neural Networks (DNN) are trained for computing the video and audio baselines, respectively.
Dense and Diverse Capsule Networks: Making the Capsules Learn Better
We propose Dense Capsule Networks (DCNet) and Diverse Capsule Networks (DCNet++).
Ranked #7 on
Image Classification
on smallNORB
DisguiseNet : A Contrastive Approach for Disguised Face Verification in the Wild
The experiments show the effectiveness of the approach on the DFW data.
Prediction and Localization of Student Engagement in the Wild
Recognizing the lack of any publicly available dataset in the domain of user engagement, a new `in the wild' dataset is created to study the subject engagement problem.
Continuous Multimodal Emotion Recognition Approach for AVEC 2017
This paper reports the analysis of audio and visual features in predicting the continuous emotion dimensions under the seventh Audio/Visual Emotion Challenge (AVEC 2017), which was done as part of a B. Tech.
Depression Scale Recognition from Audio, Visual and Text Analysis
The results obtained were able to cross the provided baseline on validation data set by 17% on audio features and 24. 5% on video features.
Analyzing the Affect of a Group of People Using Multi-modal Framework
We fuse face, upperbody and scene information for robustness of GER against the challenging environments.
Occlusion-Aware Human Pose Estimation with Mixtures of Sub-Trees
The proposed method handles occlusions during the inference process by identifying overlapping regions between different sub-trees and introducing a penalty term for overlapping parts.
