Search Results for author: Fady Baly

Found 4 papers, 3 papers with code

AraGPT2: Pre-Trained Transformer for Arabic Language Generation

1 code implementation EACL (WANLP) 2021 Wissam Antoun, Fady Baly, Hazem Hajj

In this paper, we develop the first advanced Arabic language generation model, AraGPT2, trained from scratch on a large Arabic corpus of internet text and news articles.

Language Modelling News Generation +1

AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding

1 code implementation EACL (WANLP) 2021 Wissam Antoun, Fady Baly, Hazem Hajj

Advances in English language representation enabled a more sample-efficient pre-training task by Efficiently Learning an Encoder that Classifies Token Replacements Accurately (ELECTRA).

Language Modelling Masked Language Modeling +5

Multi-Task Learning using AraBert for Offensive Language Detection

no code implementations LREC 2020 Dj, Marc ji, Fady Baly, Wissam Antoun, Hazem Hajj

The shared task on Offensive Language Detection at the OSACT4 has aimed at achieving state of art profane language detection methods for Arabic social media.

Language Modelling Multi-Task Learning

AraBERT: Transformer-based Model for Arabic Language Understanding

3 code implementations LREC 2020 Wissam Antoun, Fady Baly, Hazem Hajj

Recently, with the surge of transformers based models, language-specific BERT based models have proven to be very efficient at language understanding, provided they are pre-trained on a very large corpus.

named-entity-recognition Named Entity Recognition +3

Cannot find the paper you are looking for? You can Submit a new open access paper.