Search Results for author: Xiaobing Sun

Found 3 papers, 1 papers with code

Implicit N-grams Induced by Recurrence

1 code implementation NAACL 2022 Xiaobing Sun, Wei Lu

Although self-attention based models such as Transformers have achieved remarkable successes on natural language processing (NLP) tasks, recent studies reveal that they have limitations on modeling sequential transformations (Hahn, 2020), which may prompt re-examinations of recurrent neural networks (RNNs) that demonstrated impressive results on handling sequential data.

Language Modelling Sentiment Analysis

SEQUENCE-LEVEL FEATURES: HOW GRU AND LSTM CELLS CAPTURE N-GRAMS

no code implementations1 Jan 2021 Xiaobing Sun, Wei Lu

Based on the closed-form approximations of the hidden states, we argue that the effectiveness of the cells may be attributed to a type of sequence-level representations brought in by the gating mechanism, which enables the cells to encode sequence-level features along with token-level features.

Language Modelling Sentiment Analysis

Cannot find the paper you are looking for? You can Submit a new open access paper.