Search Results for author: marwan omar

Found 8 papers, 0 papers with code

Does Synthetic Data Make Large Language Models More Efficient?

no code implementations11 Oct 2023 Sia Gholami, marwan omar

Natural Language Processing (NLP) has undergone transformative changes with the advent of deep learning methodologies.

Data Augmentation Question Generation +2

Can pruning make Large Language Models more efficient?

no code implementations6 Oct 2023 Sia Gholami, marwan omar

Transformer models have revolutionized natural language processing with their unparalleled ability to grasp complex contextual relationships.

Computational Efficiency

Can a student Large Language Model perform as well as it's teacher?

no code implementations3 Oct 2023 Sia Gholami, marwan omar

The burgeoning complexity of contemporary deep learning models, while achieving unparalleled accuracy, has inadvertently introduced deployment challenges in resource-constrained environments.

Knowledge Distillation Language Modelling +1

Do Generative Large Language Models need billions of parameters?

no code implementations12 Sep 2023 Sia Gholami, marwan omar

This paper presents novel systems and methodologies for the development of efficient large language models (LLMs).

Language Modelling

Harnessing the Power of Decision Trees to Detect IoT Malware

no code implementations28 Jan 2023 marwan omar

Due to its simple installation and connectivity, the Internet of Things (IoT) is susceptible to malware attacks.

Specificity

New Approach to Malware Detection Using Optimized Convolutional Neural Network

no code implementations26 Jan 2023 marwan omar

This paper is different than most other papers in the literature in that it uses an expert data science approach by developing a convolutional neural network from scratch to establish a baseline of the performance model first, explores and implements an improvement model from the baseline model, and finally it evaluates the performance of the final model.

Malware Detection

Robust Natural Language Processing: Recent Advances, Challenges, and Future Directions

no code implementations3 Jan 2022 marwan omar, Soohyeon Choi, DaeHun Nyang, David Mohaisen

Recent natural language processing (NLP) techniques have accomplished high performance on benchmark datasets, primarily due to the significant improvement in the performance of deep learning.

Sentiment Analysis speech-recognition +1

Adversarial Training: A simple and efficient technique to Improving NLP Robustness

no code implementations29 Sep 2021 marwan omar

NLP models are shown to be prone to adversarial attacks which undermines their robustness, i. e. a small perturbation to the input text can fool an NLP model to incorrectly classify text.

Adversarial Text Attribute +3

Cannot find the paper you are looking for? You can Submit a new open access paper.