HuggingFace's Transformers: State-of-the-art Natural Language Processing

9 Oct 2019Thomas WolfLysandre DebutVictor SanhJulien ChaumondClement DelangueAnthony MoiPierric CistacTim RaultRémi LoufMorgan FuntowiczJamie Brew

Recent advances in modern Natural Language Processing (NLP) research have been dominated by the combination of Transfer Learning methods with large-scale language models, in particular based on the Transformer architecture. With them came a paradigm shift in NLP with the starting point for training a model on a downstream task moving from a blank specific model to a general-purpose pretrained architecture... (read more)

PDF Abstract

Evaluation Results from the Paper

  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.