Search Results for author: Simon Bacon

Found 6 papers, 4 papers with code

Joint Multimodal Transformer for Emotion Recognition in the Wild

1 code implementation15 Mar 2024 Paul Waligora, Haseeb Aslam, Osama Zeeshan, Soufiane Belharbi, Alessandro Lameiras Koerich, Marco Pedersoli, Simon Bacon, Eric Granger

Multimodal emotion recognition (MMER) systems typically outperform unimodal systems by leveraging the inter- and intra-modal relationships between, e. g., visual, textual, physiological, and auditory modalities.

Multimodal Emotion Recognition

Guided Interpretable Facial Expression Recognition via Spatial Action Unit Cues

1 code implementation1 Feb 2024 Soufiane Belharbi, Marco Pedersoli, Alessandro Lameiras Koerich, Simon Bacon, Eric Granger

In particular, using this aus codebook, input image expression label, and facial landmarks, a single action units heatmap is built to indicate the most discriminative regions of interest in the image w. r. t the facial expression.

Facial Expression Recognition Facial Expression Recognition (FER)

A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition

1 code implementation28 Mar 2022 Gnana Praveen Rajasekar, Wheidima Carneiro de Melo, Nasib Ullah, Haseeb Aslam, Osama Zeeshan, Théo Denorme, Marco Pedersoli, Alessandro Koerich, Simon Bacon, Patrick Cardinal, Eric Granger

Specifically, we propose a joint cross-attention model that relies on the complementary relationships to extract the salient features across A-V modalities, allowing for accurate prediction of continuous values of valence and arousal.

Multimodal Emotion Recognition

Temporal Stochastic Softmax for 3D CNNs: An Application in Facial Expression Recognition

no code implementations10 Nov 2020 Théo Ayral, Marco Pedersoli, Simon Bacon, Eric Granger

The proposed softmax strategy provides several advantages: a reduced computational complexity due to efficient clip sampling, and an improved accuracy since temporal weighting focuses on more relevant clips during both training and inference.

Facial Expression Recognition Facial Expression Recognition (FER)

Cannot find the paper you are looking for? You can Submit a new open access paper.