Modality Dropout for Multimodal Device Directed Speech Detection using Verbal and Non-Verbal Features

no code implementations • 23 Oct 2023 • Gautam Krishna, Sameer Dharur, Oggi Rudovic, Pranay Dighe, Saurabh Adya, Ahmed Hussen Abdelaziz, Ahmed H Tewfik

Device-directed speech detection (DDSD) is the binary classification task of distinguishing between queries directed at a voice assistant versus side conversation or background speech.

Automatic Speech Recognition Binary Classification +2

Brain Signals to Rescue Aphasia, Apraxia and Dysarthria Speech Recognition

no code implementations • 28 Feb 2021 • Gautam Krishna, Mason Carnahan, Shilpa Shamapant, Yashitha Surendranath, Saumya Jain, Arundhati Ghosh, Co Tran, Jose del R Millan, Ahmed H Tewfik

In this paper, we propose a deep learning-based algorithm to improve the performance of automatic speech recognition (ASR) systems for aphasia, apraxia, and dysarthria speech by utilizing electroencephalography (EEG) features recorded synchronously with aphasia, apraxia, and dysarthria speech.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

Pneumonia Detection on Chest X-ray using Radiomic Features and Contrastive Learning

no code implementations • 12 Jan 2021 • Yan Han, Chongyan Chen, Ahmed H Tewfik, Ying Ding, Yifan Peng

Traditionally, radiomics, as a subfield of radiology that can extract a large number of quantitative features from medical images, demonstrates its potential to facilitate medical imaging diagnosis before the deep learning era.

Contrastive Learning Pneumonia Detection