Search Results for author: Marek Rei

Found 46 papers, 14 papers with code

Control Prefixes for Parameter-Efficient Text Generation

1 code implementation15 Oct 2021 Jordan Clive, Kris Cao, Marek Rei

Prefix-tuning is a powerful lightweight technique for adapting a large pre-trained language model to a downstream application.

Abstractive Text Summarization Data-to-Text Generation +2

Guiding Visual Question Generation

no code implementations15 Oct 2021 Nihir Vedd, Zixu Wang, Marek Rei, Yishu Miao, Lucia Specia

In traditional Visual Question Generation (VQG), most images have multiple concepts (e. g. objects and categories) for which a question could be generated, but models are trained to mimic an arbitrary choice of concept as given in their training data.

Question Generation Visual Question Answering +1

Memorisation versus Generalisation in Pre-trained Language Models

no code implementations ACL 2022 Michael Tänzer, Sebastian Ruder, Marek Rei

State-of-the-art pre-trained language models have been shown to memorise facts and perform well with limited amounts of training data.

Few-Shot Learning Low Resource Named Entity Recognition +1

Supervising Model Attention with Human Explanations for Robust Natural Language Inference

1 code implementation16 Apr 2021 Joe Stacey, Yonatan Belinkov, Marek Rei

Natural Language Inference (NLI) models are known to learn from biases and artefacts within their training data, impacting how well they generalise to other unseen datasets.

Natural Language Inference

Zero-shot Sequence Labeling for Transformer-based Sentence Classifiers

1 code implementation ACL (RepL4NLP) 2021 Kamil Bujel, Helen Yannakoudakis, Marek Rei

We investigate how sentence-level transformers can be modified into effective sequence labelers at the token level without any direct supervision.

Visual Cues and Error Correction for Translation Robustness

1 code implementation Findings (EMNLP) 2021 Zhenhao Li, Marek Rei, Lucia Specia

Neural Machine Translation models are sensitive to noise in the input texts, such as misspelled words and ungrammatical constructions.

Machine Translation Translation

Grammatical error detection in transcriptions of spoken English

no code implementations COLING 2020 Andrew Caines, Christian Bentz, Kate Knill, Marek Rei, Paula Buttery

We describe the collection of transcription corrections and grammatical error annotations for the CrowdED Corpus of spoken English monologues on business topics.

Grammatical Error Detection

Grammatical Error Correction in Low Error Density Domains: A New Benchmark and Analyses

no code implementations EMNLP 2020 Simon Flachs, Ophélie Lacroix, Helen Yannakoudakis, Marek Rei, Anders Søgaard

Evaluation of grammatical error correction (GEC) systems has primarily focused on essays written by non-native learners of English, which however is only part of the full spectrum of GEC applications.

Grammatical Error Correction Language Modelling

Multidirectional Associative Optimization of Function-Specific Word Representations

1 code implementation ACL 2020 Daniela Gerz, Ivan Vulić, Marek Rei, Roi Reichart, Anna Korhonen

We present a neural framework for learning associations between interrelated groups of words such as the ones found in Subject-Verb-Object (SVO) structures.

Semi-supervised Bootstrapping of Dialogue State Trackers for Task Oriented Modelling

no code implementations26 Nov 2019 Bo-Hsiang Tseng, Marek Rei, Paweł Budzianowski, Richard E. Turner, Bill Byrne, Anna Korhonen

Dialogue systems benefit greatly from optimizing on detailed annotations, such as transcribed utterances, internal dialogue state representations and dialogue act labels.

Semi-Supervised Bootstrapping of Dialogue State Trackers for Task-Oriented Modelling

no code implementations IJCNLP 2019 Bo-Hsiang Tseng, Marek Rei, Pawe{\l} Budzianowski, Richard Turner, Bill Byrne, Anna Korhonen

Dialogue systems benefit greatly from optimizing on detailed annotations, such as transcribed utterances, internal dialogue state representations and dialogue act labels.

Context is Key: Grammatical Error Detection with Contextual Word Representations

1 code implementation WS 2019 Samuel Bell, Helen Yannakoudakis, Marek Rei

Grammatical error detection (GED) in non-native writing requires systems to identify a wide range of errors in text written by language learners.

Grammatical Error Detection

A Simple and Robust Approach to Detecting Subject-Verb Agreement Errors

no code implementations NAACL 2019 Simon Flachs, Oph{\'e}lie Lacroix, Marek Rei, Helen Yannakoudakis, Anders S{\o}gaard

While rule-based detection of subject-verb agreement (SVA) errors is sensitive to syntactic parsing errors and irregularities and exceptions to the main rules, neural sequential labelers have a tendency to overfit their training data.

Jointly Learning to Label Sentences and Tokens

2 code implementations14 Nov 2018 Marek Rei, Anders Søgaard

Learning to construct text representations in end-to-end systems can be difficult, as natural languages are highly compositional and task-specific annotated datasets are often limited in size.

Grammatical Error Detection Sentence Classification

Sequence Classification with Human Attention

1 code implementation CONLL 2018 Maria Barrett, Joachim Bingel, Nora Hollenstein, Marek Rei, Anders S{\o}gaard

Learning attention functions requires large volumes of data, but many NLP tasks simulate human behavior, and in this paper, we show that human attention really does provide a good inductive bias on many attention functions in NLP.

Abusive Language Classification +3

Variable Typing: Assigning Meaning to Variables in Mathematical Text

no code implementations NAACL 2018 Yiannos Stathopoulos, Simon Baker, Marek Rei, Simone Teufel

Our results show that the best performing MIR models make use of our typed index, compared to a formula index only containing raw symbols, thereby demonstrating the usefulness of variable typing.

Information Retrieval

Scoring Lexical Entailment with a Supervised Directional Similarity Network

1 code implementation ACL 2018 Marek Rei, Daniela Gerz, Ivan Vulić

Experiments show excellent performance on scoring graded lexical entailment, raising the state-of-the-art on the HyperLex dataset by approximately 25%.

Lexical Entailment Word Embeddings

Zero-shot Sequence Labeling: Transferring Knowledge from Sentences to Tokens

no code implementations NAACL 2018 Marek Rei, Anders Søgaard

Can attention- or gradient-based visualization techniques be used to infer token-level labels for binary sequence tagging problems, using networks trained only on sentence-level labels?

Neural Multi-task Learning in Automated Assessment

no code implementations21 Jan 2018 Ronan Cummins, Marek Rei

Grammatical error detection and automated essay scoring are two tasks in the area of automated assessment.

Automated Essay Scoring Grammatical Error Detection +1

An Error-Oriented Approach to Word Embedding Pre-Training

no code implementations WS 2017 Youmna Farag, Marek Rei, Ted Briscoe

Additionally, extending the model with corrections provides further performance gains when data sparsity is an issue.

Auxiliary Objectives for Neural Error Detection Models

no code implementations WS 2017 Marek Rei, Helen Yannakoudakis

We investigate the utility of different auxiliary objectives and training strategies within a neural sequence labeling approach to error detection in learner writing.

Grammatical Error Detection

Detecting Off-topic Responses to Visual Prompts

no code implementations WS 2017 Marek Rei

Automated methods for essay scoring have made great progress in recent years, achieving accuracies very close to human annotators.

Semi-supervised Multitask Learning for Sequence Labeling

3 code implementations ACL 2017 Marek Rei

We propose a sequence labeling framework with a secondary training objective, learning to predict surrounding words for every word in the dataset.

Chunking Grammatical Error Detection +4

Attending to Characters in Neural Sequence Labeling Models

no code implementations COLING 2016 Marek Rei, Gamal K. O. Crichton, Sampo Pyysalo

Sequence labeling architectures use word embeddings for capturing similarity, but suffer when handling previously unseen or rare words.

Chunking Grammatical Error Detection +3

Automatic Text Scoring Using Neural Networks

2 code implementations ACL 2016 Dimitrios Alikaniotis, Helen Yannakoudakis, Marek Rei

Automated Text Scoring (ATS) provides a cost-effective and consistent alternative to human marking.

A Joint Model for Word Embedding and Word Morphology

no code implementations WS 2016 Kris Cao, Marek Rei

This paper presents a joint model for performing unsupervised morphological analysis on words, and learning a character-level composition function from morphemes to word embeddings.

Morphological Analysis Word Embeddings

Cannot find the paper you are looking for? You can Submit a new open access paper.