Attentively Embracing Noise for Robust Latent Representation in BERT

1 code implementation • COLING 2020 • Gwenaelle Cunha Sergio, Dennis Singh Moirangthem, Minho Lee

We propose using all encoded transformer tokens and further encode them using a novel attentive embracement layer and multi-head attention layer.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +6

Emotional Video to Audio Transformation Using Deep Recurrent Neural Networks and a Neuro-Fuzzy System

1 code implementation • 5 Apr 2020 • Gwenaelle Cunha Sergio, Minho Lee

In this study, we propose a novel hybrid deep neural network that uses an Adaptive Neuro-Fuzzy Inference System to predict a video's emotion from its visual features and a deep Long Short-Term Memory Recurrent Neural Network to generate its corresponding audio signals with similar emotional inkling.

Music Generation

Stacked DeBERT: All Attention in Incomplete Data for Text Classification

1 code implementation • 1 Jan 2020 • Gwenaelle Cunha Sergio, Minho Lee

This is due to the fact that current approaches are built for and trained with clean and complete data, and thus are not able to extract features that can adequately represent incomplete data.

Chatbot Denoising +6

Application of Genetic Algorithm for More Efficient Multi-Layer Thickness Optimization in Solar Cells

1 code implementation • 14 Sep 2019 • Premkumar Vincent, Gwenaelle Cunha Sergio, Jaewon Jang, In Man Kang, Jaehoon Park, Hyeok Kim, Minho Lee, Jin-Hyuk Bae

The commonplace method used in optimization simulations, such as for optimizing the optical spacer layers' thicknesses, is the parameter sweep.