Browse > Natural Language Processing > Language Modelling

Language Modelling

486 papers with code ยท Natural Language Processing

Language modeling is the task of predicting the next word or character in a document.

* indicates models using dynamic evaluation; where, at test time, models may adapt to seen tokens in order to improve performance on following tokens. (Mikolov et al., (2010), Kraus et al., (2017))

( Image credit: Exploring the Limits of Language Modeling )

Leaderboards

Latest papers without code

Hierarchical models vs. transfer learning for document-level sentiment classification

19 Feb 2020

Documents are composed of smaller pieces - paragraphs, sentences, and tokens - that have complex relationships between one another.

DOCUMENT CLASSIFICATION LANGUAGE MODELLING SENTIMENT ANALYSIS TRANSFER LEARNING

LAMBERT: Layout-Aware language Modeling using BERT for information extraction

19 Feb 2020

In this paper we introduce a novel approach to the problem of understanding documents where the local semantics is influenced by non-trivial layout.

LANGUAGE MODELLING

Hierarchical Transformer Network for Utterance-level Emotion Recognition

18 Feb 2020

To address these problems, we propose a hierarchical transformer framework (apart from the description of other studies, the "transformer" in this paper usually refers to the encoder part of the transformer) with a lower-level transformer to model the word-level input and an upper-level transformer to capture the context of utterance-level embeddings.

EMOTION RECOGNITION LANGUAGE MODELLING TEXT CLASSIFICATION

Studying the Effects of Cognitive Biases in Evaluation of Conversational Agents

18 Feb 2020

To investigate, we conducted a between-subjects study with 77 crowdsourced workers to understand the role of cognitive biases, specifically anchoring bias, when humans are asked to evaluate the output of conversational agents.

DECISION MAKING LANGUAGE MODELLING

Global and Local Feature Learning for Ego-Network Analysis

16 Feb 2020

This social network can be efficiently analyzed after learning representations of the ego and its alters in a low-dimensional, real vector space.

LANGUAGE MODELLING LEARNING NETWORK REPRESENTATIONS

Transformer on a Diet

14 Feb 2020

Transformer has been widely used thanks to its ability to capture sequence information in an efficient way.

LANGUAGE MODELLING

FQuAD: French Question Answering Dataset

14 Feb 2020

FQuAD is French Native Reading Comprehension dataset that consists of 25, 000+ questions on a set of Wikipedia articles.

LANGUAGE MODELLING MACHINE READING COMPREHENSION QUESTION ANSWERING

A Data Efficient End-To-End Spoken Language Understanding Architecture

14 Feb 2020

For that, in many cases, models are combined with an external language model to enhance their performance.

CHUNKING LANGUAGE MODELLING SEMANTIC PARSING SPOKEN LANGUAGE UNDERSTANDING

CBAG: Conditional Biomedical Abstract Generation

13 Feb 2020

We propose a transformer-based conditional language model with a shallow encoder "condition" stack, and a deep "language model" stack of multi-headed attention blocks.

LANGUAGE MODELLING TEXT GENERATION

Pre-Training for Query Rewriting in A Spoken Language Understanding System

13 Feb 2020

Then, inspired by the wide success of pre-trained contextual language embeddings, and also as a way to compensate for insufficient QR training data, we propose a language-modeling (LM) based approach to pre-train query embeddings on historical user conversation data with a voice assistant.

ENTITY RESOLUTION LANGUAGE MODELLING SPEECH RECOGNITION SPOKEN LANGUAGE UNDERSTANDING