Search Results for author: Co Tran

Found 22 papers, 0 papers with code

Brain Signals to Rescue Aphasia, Apraxia and Dysarthria Speech Recognition

no code implementations28 Feb 2021 Gautam Krishna, Mason Carnahan, Shilpa Shamapant, Yashitha Surendranath, Saumya Jain, Arundhati Ghosh, Co Tran, Jose del R Millan, Ahmed H Tewfik

In this paper, we propose a deep learning-based algorithm to improve the performance of automatic speech recognition (ASR) systems for aphasia, apraxia, and dysarthria speech by utilizing electroencephalography (EEG) features recorded synchronously with aphasia, apraxia, and dysarthria speech.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

Speech Recognition using EEG signals recorded using dry electrodes

no code implementations13 Aug 2020 Gautam Krishna, Co Tran, Mason Carnahan, Morgan M Hagood, Ahmed H. Tewfik

In this paper, we demonstrate speech recognition using electroencephalography (EEG) signals obtained using dry electrodes on a limited English vocabulary consisting of three vowels and one word using a deep learning model.

EEG speech-recognition +1

Constrained Variational Autoencoder for improving EEG based Speech Recognition Systems

no code implementations1 Jun 2020 Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik

In this paper we introduce a recurrent neural network (RNN) based variational autoencoder (VAE) model with a new constrained loss function that can generate more meaningful electroencephalography (EEG) features from raw EEG features to improve the performance of EEG based speech recognition systems.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

Understanding effect of speech perception in EEG based speech recognition systems

no code implementations29 May 2020 Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik

The electroencephalography (EEG) signals recorded in parallel with speech are used to perform isolated and continuous speech recognition.

EEG speech-recognition +1

Predicting Different Acoustic Features from EEG and towards direct synthesis of Audio Waveform from EEG

no code implementations29 May 2020 Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik

In [1, 2] authors provided preliminary results for synthesizing speech from electroencephalography (EEG) features where they first predict acoustic features from EEG features and then the speech is reconstructed from the predicted acoustic features using griffin lim reconstruction algorithm.

EEG

Improving EEG based continuous speech recognition using GAN

no code implementations29 May 2020 Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik

In this paper we demonstrate that it is possible to generate more meaningful electroencephalography (EEG) features from raw EEG features using generative adversarial networks (GAN) to improve the performance of EEG based continuous speech recognition systems.

EEG speech-recognition +1

Predicting Video features from EEG and Vice versa

no code implementations16 May 2020 Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik

In this paper we explore predicting facial or lip video features from electroencephalography (EEG) features and predicting EEG features from recorded facial or lip video frames using deep learning models.

EEG

Advancing Speech Synthesis using EEG

no code implementations9 Apr 2020 Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik

In this paper we introduce attention-regression model to demonstrate predicting acoustic features from electroencephalography (EEG) features recorded in parallel with spoken sentences.

EEG regression +1

Speaker Identification using EEG

no code implementations7 Mar 2020 Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik

In this paper we explore speaker identification using electroencephalography (EEG) signals.

EEG Speaker Identification

Generating EEG features from Acoustic features

no code implementations29 Feb 2020 Gautam Krishna, Co Tran, Mason Carnahan, Yan Han, Ahmed H. Tewfik

In this paper we demonstrate predicting electroencephalograpgy (EEG) features from acoustic features using recurrent neural network (RNN) based regression model and generative adversarial network (GAN).

EEG Generative Adversarial Network +2

Speech Synthesis using EEG

no code implementations22 Feb 2020 Gautam Krishna, Co Tran, Yan Han, Mason Carnahan

In this paper we demonstrate speech synthesis using different electroencephalography (EEG) feature sets recently introduced in [1].

EEG regression +1

Continuous Silent Speech Recognition using EEG

no code implementations6 Feb 2020 Gautam Krishna, Co Tran, Mason Carnahan, Ahmed Tewfik

Our results demonstrate the feasibility of using EEG signals for performing continuous silent speech recognition.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

EEG based Continuous Speech Recognition using Transformers

no code implementations31 Dec 2019 Gautam Krishna, Co Tran, Mason Carnahan, Ahmed H. Tewfik

In this paper we investigate continuous speech recognition using electroencephalography (EEG) features using recently introduced end-to-end transformer based automatic speech recognition (ASR) model.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

Continuous Speech Recognition using EEG and Video

no code implementations16 Dec 2019 Gautam Krishna, Mason Carnahan, Co Tran, Ahmed H. Tewfik

In this paper we investigate whether electroencephalography (EEG) features can be used to improve the performance of continuous visual speech recognition systems.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +4

Improving EEG based Continuous Speech Recognition

no code implementations24 Nov 2019 Gautam Krishna, Co Tran, Mason Carnahan, Yan Han, Ahmed H. Tewfik

In this paper we introduce various techniques to improve the performance of electroencephalography (EEG) features based continuous speech recognition (CSR) systems.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

Voice Activity Detection in presence of background noise using EEG

no code implementations8 Nov 2019 Gautam Krishna, Co Tran, Yan Han, Mason Carnahan, Ahmed H. Tewfik

In this paper we demonstrate that performance of voice activity detection (VAD) system operating in presence of background noise can be improved by concatenating acoustic input features with electroencephalography (EEG) features.

Sound Audio and Speech Processing Signal Processing

Spoken Speech Enhancement using EEG

no code implementations13 Sep 2019 Gautam Krishna, Co Tran, Yan Han, Mason Carnahan, Ahmed H. Tewfik

In this paper we demonstrate spoken speech enhancement using electroencephalography (EEG) signals using a generative adversarial network (GAN) based model, gated recurrent unit (GRU) regression based model, temporal convolutional network (TCN) regression model and finally using a mixed TCN GRU regression model.

EEG Generative Adversarial Network +2

State-of-the-art Speech Recognition using EEG and Towards Decoding of Speech Spectrum From EEG

no code implementations14 Aug 2019 Gautam Krishna, Yan Han, Co Tran, Mason Carnahan, Ahmed H. Tewfik

In this paper we first demonstrate continuous noisy speech recognition using electroencephalography (EEG) signals on English vocabulary using different types of state of the art end-to-end automatic speech recognition (ASR) models, we further provide results obtained using EEG data recorded under different experimental conditions.

Audio and Speech Processing Sound

Robust End-to-End Speaker Verification Using EEG

no code implementations17 Jun 2019 Yan Han, Gautam Krishna, Co Tran, Mason Carnahan, Ahmed H. Tewfik

In this paper we demonstrate that performance of a speaker verification system can be improved by concatenating electroencephalography (EEG) signal features with speech signal features or only using EEG signal features.

EEG Speaker Verification

Advancing Speech Recognition With No Speech Or With Noisy Speech

no code implementations17 Jun 2019 Gautam Krishna, Co Tran, Mason Carnahan, Ahmed H. Tewfik

In this paper we demonstrate end-to-end continuous speech recognition (CSR) using electroencephalography (EEG) signals with no speech signal as input.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

Speech Recognition With No Speech Or With Noisy Speech Beyond English

no code implementations17 Jun 2019 Gautam Krishna, Co Tran, Yan Han, Mason Carnahan, Ahmed H. Tewfik

In this paper we demonstrate continuous noisy speech recognition using connectionist temporal classification (CTC) model on limited Chinese vocabulary using electroencephalography (EEG) features with no speech signal as input and we further demonstrate single CTC model based continuous noisy speech recognition on limited joint English and Chinese vocabulary using EEG features with no speech signal as input.

EEG General Classification +2

Cannot find the paper you are looking for? You can Submit a new open access paper.