Search Results for author:
Found 22 papers, 8 papers with code
MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusion
In this work, we propose MagicPose, a diffusion-based model for 2D human pose and facial expression retargeting.
Polysemous Visual-Semantic Embedding for Cross-Modal Retrieval
In this work, we introduce Polysemous Instance Embedding Networks (PIE-Nets) that compute multiple and diverse representations of an instance by combining global context with locally-guided features via multi-head self-attention and residual learning.
Ranked #33 on
Cross-Modal Retrieval
on COCO 2014
LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysis
Facial expression analysis is an important tool for human-computer interaction.
Speaker Turn Modeling for Dialogue Act Classification
Dialogue Act (DA) classification is the task of classifying utterances with respect to the function they serve in a dialogue.
Ranked #2 on
Dialogue Act Classification
on Switchboard corpus
Multimodal Phased Transformer for Sentiment Analysis
We evaluate our model with three sentiment analysis datasets and achieve comparable or superior performance compared with the existing methods, with a 90% reduction in the number of parameters.
FG-Net: Facial Action Unit Detection with Generalizable Pyramidal Features
The proposed FG-Net achieves a strong generalization ability for heatmap-based AU detection thanks to the generalizable and semantic-rich features extracted from the pre-trained generative model.
Modeling Dynamics of Facial Behavior for Mental Health Assessment
Facial action unit (FAU) intensities are popular descriptors for the analysis of facial behavior.
A Speech Representation Anonymization Framework via Selective Noise Perturbation
Privacy and security are major concerns when communicating speech signals to cloud services such as automatic speech recognition (ASR) and speech emotion recognition (SER).
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+7
Cross-Modal Retrieval with Implicit Concept Association
Traditional cross-modal retrieval assumes explicit association of concepts across modalities, where there is no ambiguity in how the concepts are linked to each other, e. g., when we do the image search with a query "dogs", we expect to see dog images.
AVEC 2019 Workshop and Challenge: State-of-Mind, Detecting Depression with AI, and Cross-Cultural Affect Recognition
The Audio/Visual Emotion Challenge and Workshop (AVEC 2019) "State-of-Mind, Detecting Depression with AI, and Cross-cultural Affect Recognition" is the ninth competition event aimed at the comparison of multimedia processing and machine learning methods for automatic audiovisual health and emotion analysis, with all participants competing strictly under the same conditions.
Affective Computing for Large-Scale Heterogeneous Multimedia Data: A Survey
Affective computing (AC) of these data can help to understand human behaviors and enable wide applications.
Towards A Friendly Online Community: An Unsupervised Style Transfer Framework for Profanity Redaction
Offensive and abusive language is a pressing problem on social media platforms.
Improper Gaussian Signaling for the $K$-user MIMO Interference Channels with Hardware Impairments
This paper investigates the performance of improper Gaussian signaling (IGS) for the $K$-user multiple-input, multiple-output (MIMO) interference channel (IC) with hardware impairments (HWI).
Analysis of Behavior Classification in Motivational Interviewing
Analysis of client and therapist behavior in counseling sessions can provide helpful insights for assessing the quality of the session and consequently, the client’s behavioral outcome.
A Pre-trained Audio-Visual Transformer for Emotion Recognition
In this paper, we introduce a pretrained audio-visual Transformer trained on more than 500k utterances from nearly 4000 celebrities from the VoxCeleb2 dataset for human behavior understanding.
Multi-modal Facial Action Unit Detection with Large Pre-trained Models for the 5th Competition on Affective Behavior Analysis in-the-wild
Facial action unit detection has emerged as an important task within facial expression analysis, aimed at detecting specific pre-defined, objective facial expressions, such as lip tightening and cheek raising.
Personalized Adaptation with Pre-trained Speech Encoders for Continuous Emotion Recognition
There are individual differences in expressive behaviors driven by cultural norms and personality.
Privacy-preserving Representation Learning for Speech Understanding
In this paper, we present a novel framework to anonymize utterance-level speech embeddings generated by pre-trained encoders and show its effectiveness for a range of speech classification tasks.
Build Your Own Robot Friend: An Open-Source Learning Module for Accessible and Engaging AI Education
We hope that this work will contribute toward accessible and engaging AI education in human-AI interaction for college and high school students.
Investigating the Generalizability of Physiological Characteristics of Anxiety
To address this ambiguity, we evaluated the generalizability of physiological features that have been shown to be correlated with anxiety and stress to high-arousal emotions.
Dyadic Interaction Modeling for Social Behavior Generation
Hence, an effective model for generating listener nonverbal behaviors requires understanding the dyadic context and interaction.
Leveraging Synthetic Data for Generalizable and Fair Facial Action Unit Detection
Then, we use MSDA to transfer the AU detection knowledge from a real dataset and the synthetic dataset to a target dataset.
