Search Results for author: Thibault Castells

Found 4 papers, 3 papers with code

Shortened LLaMA: A Simple Depth Pruning for Large Language Models

no code implementations5 Feb 2024 Bo-Kyeong Kim, Geonmin Kim, Tae-Ho Kim, Thibault Castells, Shinkook Choi, Junho Shin, Hyoung-Kyu Song

Structured pruning of modern large language models (LLMs) has emerged as a way of decreasing their high computational needs.

BK-SDM: A Lightweight, Fast, and Cheap Version of Stable Diffusion

3 code implementations25 May 2023 Bo-Kyeong Kim, Hyoung-Kyu Song, Thibault Castells, Shinkook Choi

Text-to-image (T2I) generation with Stable Diffusion models (SDMs) involves high computing demands due to billion-scale parameters.

DreamBooth Personalized Generation Image-to-Image Translation

Automatic Neural Network Pruning that Efficiently Preserves the Model Accuracy

1 code implementation18 Nov 2021 Thibault Castells, Seul-Ki Yeom

As an attempt to solve this problem, pruning filters is a common solution, but most existing pruning methods do not preserve the model accuracy efficiently and therefore require a large number of finetuning epochs.

Network Pruning

SuperLoss: A Generic Loss for Robust Curriculum Learning

2 code implementations NeurIPS 2020 Thibault Castells, Philippe Weinzaepfel, Jerome Revaud

The key idea is to somehow estimate the importance (or weight) of each sample directly during training based on the observation that easy and hard samples behave differently and can therefore be separated.

Image Classification Image Retrieval +4

Cannot find the paper you are looking for? You can Submit a new open access paper.