Search Results for author: Alexandra Benamar

Found 3 papers, 1 papers with code

Evaluating Tokenizers Impact on OOVs Representation with Transformers Models

1 code implementation LREC 2022 Alexandra Benamar, Cyril Grouin, Meryl Bothua, Anne Vilnat

Our experiments have led to exciting findings that showed: (1) It is easier to improve the representation of new words (A and B) than it is for words that already exist in the vocabulary of the Transformer models (C), (2) To ameliorate the representation of OOVs, the most effective method relies on adding external morpho-syntactic context rather than improving the semantic understanding of the words directly (fine-tuning) and (3) We cannot foresee the impact of minor misspellings in words because similar misspellings have different impacts on their representation.

Anatomy Domain Adaptation

Cannot find the paper you are looking for? You can Submit a new open access paper.