no code implementations • 5 Feb 2024 • Bo-Kyeong Kim, Geonmin Kim, Tae-Ho Kim, Thibault Castells, Shinkook Choi, Junho Shin, Hyoung-Kyu Song
Structured pruning of modern large language models (LLMs) has emerged as a way of decreasing their high computational needs.
3 code implementations • 25 May 2023 • Bo-Kyeong Kim, Hyoung-Kyu Song, Thibault Castells, Shinkook Choi
Text-to-image (T2I) generation with Stable Diffusion models (SDMs) involves high computing demands due to billion-scale parameters.
DreamBooth Personalized Generation Image-to-Image Translation
1 code implementation • 18 Nov 2021 • Thibault Castells, Seul-Ki Yeom
As an attempt to solve this problem, pruning filters is a common solution, but most existing pruning methods do not preserve the model accuracy efficiently and therefore require a large number of finetuning epochs.
2 code implementations • NeurIPS 2020 • Thibault Castells, Philippe Weinzaepfel, Jerome Revaud
The key idea is to somehow estimate the importance (or weight) of each sample directly during training based on the observation that easy and hard samples behave differently and can therefore be separated.