Search Results for author:
Found 7 papers, 3 papers with code
Numeracy enhances the Literacy of Language Models
This paper studies the effect of using six different number encoders on the task of masked word prediction (MWP), as a proxy for evaluating literacy.
BPE beyond Word Boundary: How NOT to use Multi Word Expressions in Neural Machine Translation
BPE tokenization merges characters into longer tokens by finding frequently occurring contiguous patterns within the word boundary.
Learn Your Tokens: Word-Pooled Tokenization for Language Modeling
Language models typically tokenize text into subwords, using a deterministic, hand-engineered heuristic of combining characters into longer surface-level strings such as 'ing' or whole words.
Estimating Numbers without Regression
Despite recent successes in language models, their ability to represent numbers is insufficient.
Representing Numbers in NLP: a Survey and a Vision
NLP systems rarely give special consideration to numbers found in text.
SWOW-8500: Word Association task for Intrinsic Evaluation of Word Embeddings
Downstream evaluation of pretrained word embeddings is expensive, more so for tasks where current state of the art models are very large architectures.
IJCNLP-2017 Task 3: Review Opinion Diversification (RevOpiD-2017)
Unlike Entity Disambiguation in web search results, Opinion Disambiguation is a relatively unexplored topic.
