Search Results for author:
Found 8 papers, 4 papers with code
MELT: Towards Automated Multimodal Emotion Data Annotation by Leveraging LLM Embedded Knowledge
We demonstrate the effectiveness of MELT by fine-tuning four self-supervised learning (SSL) backbones and assessing speech emotion recognition performance across emotion datasets.
The First MPDD Challenge: Multimodal Personality-aware Depression Detection
The Multimodal Personality-aware Depression Detection (MPDD) Challenge aims to address this gap by incorporating multimodal data alongside individual difference factors.
$C^2$AV-TSE: Context and Confidence-aware Audio Visual Target Speaker Extraction
Audio-Visual Target Speaker Extraction (AV-TSE) aims to mimic the human ability to enhance auditory perception using visual cues.
Raindrop Clarity: A Dual-Focused Dataset for Day and Night Raindrop Removal
There are 5, 442 daytime raindrop images and 9, 744 nighttime raindrop images.
Audio-Visual Target Speaker Extraction with Reverse Selective Auditory Attention
To this end, we propose a novel selective auditory attention mechanism, which can suppress interference speakers and non-speech signals to avoid incorrect speaker extraction.
Enhancing Real-World Active Speaker Detection with Multi-Modal Extraction Pre-Training
Audio-visual active speaker detection (AV-ASD) aims to identify which visible face is speaking in a scene with one or more persons.
Active Speaker Detection
Audio-Visual Active Speaker Detection
+2
Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expert
To address the problem, we propose using a lip-reading expert to improve the intelligibility of the generated lip regions by penalizing the incorrect generation results.
Rectified Linear Postsynaptic Potential Function for Backpropagation in Deep Spiking Neural Networks
In STDBP algorithm, the timing of individual spikes is used to convey information (temporal coding), and learning (back-propagation) is performed based on spike timing in an event-driven manner.
