Search Results for author: Muhammad ElNokrashy

Found 9 papers, 2 papers with code

Investigating Cultural Alignment of Large Language Models

1 code implementation20 Feb 2024 Badr AlKhamissi, Muhammad ElNokrashy, Mai AlKhamissi, Mona Diab

The intricate relationship between language and culture has long been a subject of exploration within the realm of linguistic anthropology.

Cross-Lingual Transfer

Partial Diacritization: A Context-Contrastive Inference Approach

no code implementations17 Jan 2024 Muhammad ElNokrashy, Badr AlKhamissi

In this light, we introduce Context-Contrastive Partial Diacritization (CCPD)--a novel approach to PD which integrates seamlessly with existing Arabic diacritization systems.

The Shared Task on Gender Rewriting

no code implementations22 Oct 2022 Bashar Alhafni, Nizar Habash, Houda Bouamor, Ossama Obeid, Sultan Alrowili, Daliyah AlZeer, Khawlah M. Alshanqiti, Ahmed ElBakry, Muhammad ElNokrashy, Mohamed Gabr, Abderrahmane Issam, Abdelrahim Qaddoumi, K. Vijay-Shanker, Mahmoud Zyate

In this paper, we present the results and findings of the Shared Task on Gender Rewriting, which was organized as part of the Seventh Arabic Natural Language Processing Workshop.

Sentence

Depth-Wise Attention (DWAtt): A Layer Fusion Method for Data-Efficient Classification

no code implementations30 Sep 2022 Muhammad ElNokrashy, Badr AlKhamissi, Mona Diab

To test this, we propose a new layer fusion method: Depth-Wise Attention (DWAtt), to help re-surface signals from non-final layers.

NER

Language Tokens: A Frustratingly Simple Approach Improves Zero-Shot Performance of Multilingual Translation

no code implementations11 Aug 2022 Muhammad ElNokrashy, Amr Hendy, Mohamed Maher, Mohamed Afify, Hany Hassan Awadalla

In a WMT evaluation campaign, From-English performance improves by 4. 17 and 2. 87 BLEU points, in the zero-shot setting, and when direct data is available for training, respectively.

Translation

Deep Spiking Neural Networks with Resonate-and-Fire Neurons

no code implementations16 Sep 2021 Badr AlKhamissi, Muhammad ElNokrashy, David Bernal-Casas

In this work, we explore a new Spiking Neural Network (SNN) formulation with Resonate-and-Fire (RAF) neurons (Izhikevich, 2001) trained with gradient descent via back-propagation.

The Emergence of Abstract and Episodic Neurons in Episodic Meta-RL

no code implementations ICLR Workshop Learning_to_Learn 2021 Badr AlKhamissi, Muhammad ElNokrashy, Michael Spranger

In this work, we analyze the reinstatement mechanism introduced by Ritter et al. (2018) to reveal two classes of neurons that emerge in the agent's working memory (an epLSTM cell) when trained using episodic meta-RL on an episodic variant of the Harlow visual fixation task.

Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task

1 code implementation EACL (WANLP) 2021 Badr AlKhamissi, Mohamed Gabr, Muhammad ElNokrashy, Khaled Essam

Tasks are to identify the geographic origin of short Dialectal (DA) and Modern Standard Arabic (MSA) utterances at the levels of both country and province.

Dialect Identification

Cannot find the paper you are looking for? You can Submit a new open access paper.