Search Results for author: Marzieh S. Tahaei

Found 5 papers, 0 papers with code

SeKron: A Decomposition Method Supporting Many Factorization Structures

no code implementations12 Oct 2022 Marawan Gamal Abdel Hameed, Ali Mosleh, Marzieh S. Tahaei, Vahid Partovi Nia

We validate SeKron for model compression on both high-level and low-level computer vision tasks and find that it outperforms state-of-the-art decomposition methods.

Model Compression Tensor Decomposition

Towards Fine-tuning Pre-trained Language Models with Integer Forward and Backward Propagation

no code implementations20 Sep 2022 Mohammadreza Tayaranian, Alireza Ghaffari, Marzieh S. Tahaei, Mehdi Rezagholizadeh, Masoud Asgharian, Vahid Partovi Nia

Previously researchers were focused on lower bit-width integer data types for the forward propagation of language models to save memory and computation.

Convolutional Neural Network Compression through Generalized Kronecker Product Decomposition

no code implementations29 Sep 2021 Marawan Gamal Abdel Hameed, Marzieh S. Tahaei, Ali Mosleh, Vahid Partovi Nia

Modern Convolutional Neural Network (CNN) architectures, despite their superiority in solving various problems, are generally too large to be deployed on resource constrained edge devices.

Image Classification Knowledge Distillation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.