Search Results for author: Steven Kolawole

Found 5 papers, 2 papers with code

What Happens When Small Is Made Smaller? Exploring the Impact of Compression on Small Data Pretrained Language Models

no code implementations6 Apr 2024 Busayo Awobade, Mardiyyah Oduwole, Steven Kolawole

Compression techniques have been crucial in advancing machine learning by enabling efficient training and deployment of large-scale language models.

Knowledge Distillation Language Modelling +1

Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes

1 code implementation8 Feb 2024 Lucio Dery, Steven Kolawole, Jean-François Kagy, Virginia Smith, Graham Neubig, Ameet Talwalkar

Given the generational gap in available hardware between lay practitioners and the most endowed institutions, LLMs are becoming increasingly inaccessible as they grow in size.

Vision Transformers for Mobile Applications: A Short Survey

no code implementations30 May 2023 Nahid Alam, Steven Kolawole, Simardeep Sethi, Nishant Bansali, Karina Nguyen

Vision Transformers (ViTs) have demonstrated state-of-the-art performance on many Computer Vision Tasks.

Sign-to-Speech Model for Sign Language Understanding: A Case Study of Nigerian Sign Language

1 code implementation1 Nov 2021 Steven Kolawole, Opeyemi Osakuade, Nayan Saxena, Babatunde Kazeem Olorisade

Through this paper, we seek to reduce the communication barrier between the hearing-impaired community and the larger society who are usually not familiar with sign language in the sub-Saharan region of Africa with the largest occurrences of hearing disability cases, while using Nigeria as a case study.

object-detection Object Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.