Search Results for author:
Found 7 papers, 1 papers with code
MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases
The resultant models, denoted as MobileLLM-LS, demonstrate a further accuracy enhancement of 0. 7%/0. 8% than MobileLLM 125M/350M.
Not All Weights Are Created Equal: Enhancing Energy Efficiency in On-Device Streaming Speech Recognition
This study delves into how weight parameters in speech recognition models influence the overall power consumption of these models.
On The Open Prompt Challenge In Conditional Audio Generation
Text-to-audio generation (TTA) produces audio from a text description, learning from pairs of audio samples and hand-annotated text.
Revisiting Sample Size Determination in Natural Language Understanding
Knowing exactly how many data points need to be labeled to achieve a certain model performance is a hugely beneficial step towards reducing the overall budgets for annotation.
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models
Several post-training quantization methods have been applied to large language models (LLMs), and have been shown to perform well down to 8-bits.
Hyperparameter-free Continuous Learning for Domain Classification in Natural Language Understanding
Most existing continual learning approaches suffer from low accuracy and performance fluctuation, especially when the distributions of old and new data are significantly different.
Automatic Mixed-Precision Quantization Search of BERT
Knowledge distillation, Weight pruning, and Quantization are known to be the main directions in model compression.
