SMART: Automatically Scaling Down Language Models with Accuracy Guarantees for Reduced Processing Fees

1 code implementation • 11 Mar 2024 • Saehan Jo, Immanuel Trummer

SMART employs a profiling phase that evaluates the performance of multiple LLMs to identify those that meet the user-defined accuracy level.