Search Results for author:
Found 14 papers, 6 papers with code
Text-Queried Target Sound Event Localization
Sound event localization and detection (SELD) aims to determine the appearance of sound classes, together with their Direction of Arrival (DOA).
Room Impulse Response (RIR)
Sound Event Localization and Detection
+1
An Exploration of Length Generalization in Transformer-Based Speech Enhancement
In this paper, we conduct comprehensive experiments to explore the length generalization problem in speech enhancement with Transformer.
Mamba in Speech: Towards an Alternative to Self-Attention
Moreover, experiments demonstrate the effectiveness of BiMamba as an alternative to the self-attention module in Transformer and its derivates, particularly for the semantic-aware task.
Audio-Visual Target Speaker Extraction with Reverse Selective Auditory Attention
To this end, we propose a novel reverse selective auditory attention mechanism, which can suppress interference speakers and non-speech signals to avoid incorrect speaker extraction.
Enhancing Real-World Active Speaker Detection with Multi-Modal Extraction Pre-Training
Audio-visual active speaker detection (AV-ASD) aims to identify which visible face is speaking in a scene with one or more persons.
Active Speaker Detection
Audio-Visual Active Speaker Detection
+2
LocSelect: Target Speaker Localization with an Auditory Selective Hearing Mechanism
The prevailing noise-resistant and reverberation-resistant localization algorithms primarily emphasize separating and providing directional output for each speaker in multi-speaker scenarios, without association with the identity of speakers.
InterFormer: Interactive Local and Global Features Fusion for Automatic Speech Recognition
To address these issues, this paper proposes InterFormer for interactive local and global features fusion to learn a better representation for ASR.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Rethinking Speech Recognition with A Multimodal Perspective via Acoustic and Semantic Cooperative Decoding
The experimental results show that ASCD significantly improves the performance by leveraging both the acoustic and semantic information cooperatively.
Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expert
To address the problem, we propose using a lip-reading expert to improve the intelligibility of the generated lip regions by penalizing the incorrect generation results.
A Miniaturised Camera-based Multi-Modal Tactile Sensor
The human tactile system is composed of various types of mechanoreceptors, each able to perceive and process distinct information such as force, pressure, texture, etc.
Iterative Sound Source Localization for Unknown Number of Sources
Sound source localization aims to seek the direction of arrival (DOA) of all sound sources from the observed multi-channel audio.
Speaker Extraction with Co-Speech Gestures Cue
Speaker extraction seeks to extract the clean speech of a target speaker from a multi-talker mixture speech.
Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection
Active speaker detection (ASD) seeks to detect who is speaking in a visual scene of one or more speakers.
Active Speaker Detection
Audio-Visual Active Speaker Detection
NUS-HLT Report for ActivityNet Challenge 2021 AVA (Speaker)
Active speaker detection (ASD) seeks to detect who is speaking in a visual scene of one or more speakers.
Active Speaker Detection
Audio-Visual Active Speaker Detection
