Progressive Knowledge Distillation Of Stable Diffusion XL Using Layer Level Loss

1 code implementation • 5 Jan 2024 • Yatharth Gupta, Vishnu V. Jaddipal, Harish Prabhala, Sayak Paul, Patrick von Platen

In this work, we introduce two scaled-down variants, Segmind Stable Diffusion (SSD-1B) and Segmind-Vega, with 1. 3B and 0. 74B parameter UNets, respectively, achieved through progressive removal using layer-level losses focusing on reducing the model size while preserving generative quality.

Knowledge Distillation