Search Results for author: Umberto Michieli

Found 37 papers, 12 papers with code

Controllable Forgetting Mechanism for Few-Shot Class-Incremental Learning

no code implementations27 Jan 2025 Kirill Paramonov, Mete Ozay, Eunju Yang, Jijoong Moon, Umberto Michieli

A key challenge in these scenarios is balancing the trade-off between adapting to new, personalized classes and maintaining the performance of the model on the original, base classes.

class-incremental learning Few-Shot Class-Incremental Learning +1

LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generation

1 code implementation6 Dec 2024 Donald Shenaj, Ondrej Bohdal, Mete Ozay, Pietro Zanuttigh, Umberto Michieli

Recent advancements in image generation models have enabled personalized image creation with both user-defined subjects (content) and styles.

Image Generation

DreamCache: Finetuning-Free Lightweight Personalized Image Generation via Feature Caching

no code implementations26 Nov 2024 Emanuele Aiello, Umberto Michieli, Diego Valsesia, Mete Ozay, Enrico Magli

Personalized image generation requires text-to-image generative models that capture the core features of a reference subject to allow for controlled generation across different contexts.

Image Generation Personalized Image Generation

Swiss DINO: Efficient and Versatile Vision Framework for On-device Personal Object Search

1 code implementation10 Jul 2024 Kirill Paramonov, Jia-Xing Zhong, Umberto Michieli, Jijoong Moon, Mete Ozay

In this paper, we address a recent trend in robotic home appliances to include vision systems on personal devices, capable of personalizing the appliances on the fly.

Few-Shot Learning Scene Understanding +1

Enhanced Model Robustness to Input Corruptions by Per-corruption Adaptation of Normalization Statistics

no code implementations8 Jul 2024 Elena Camuffo, Umberto Michieli, Simone Milani, Jijoong Moon, Mete Ozay

In this paper, we introduce Per-corruption Adaptation of Normalization statistics (PAN) to enhance the model robustness of vision systems.

Data Augmentation Object Recognition +1

Cross-Architecture Auxiliary Feature Space Translation for Efficient Few-Shot Personalized Object Detection

no code implementations1 Jul 2024 Francesco Barbato, Umberto Michieli, Jijoong Moon, Pietro Zanuttigh, Mete Ozay

We introduce a conditional coarse-to-fine few-shot learner to refine the coarse predictions made by an efficient object detector, showing that using an off-the-shelf model leads to poor personalization due to neural collapse.

object-detection Object Detection

Model Merging and Safety Alignment: One Bad Model Spoils the Bunch

no code implementations20 Jun 2024 Hasan Abed Al Kader Hammoud, Umberto Michieli, Fabio Pizzati, Philip Torr, Adel Bibi, Bernard Ghanem, Mete Ozay

Our experiments illustrate the effectiveness of integrating alignment-related data during merging, resulting in models that excel in both domain expertise and alignment.

model Safety Alignment

Object-conditioned Bag of Instances for Few-Shot Personalized Instance Recognition

no code implementations1 Apr 2024 Umberto Michieli, Jijoong Moon, Daehyun Kim, Mete Ozay

Nowadays, users demand for increased personalization of vision systems to localize and identify personal instances of objects (e. g., my dog rather than dog) from a few-shot dataset only.

Object object-detection +2

FFT-based Selection and Optimization of Statistics for Robust Recognition of Severely Corrupted Images

no code implementations21 Mar 2024 Elena Camuffo, Umberto Michieli, Jijoong Moon, Daehyun Kim, Mete Ozay

Improving model robustness in case of corrupted images is among the key challenges to enable robust vision systems on smart devices, such as robotic agents.

Deep Neural Network Models Trained With A Fixed Random Classifier Transfer Better Across Domains

no code implementations28 Feb 2024 Hafiz Tiomoko Ali, Umberto Michieli, Ji Joong Moon, Daehyun Kim, Mete Ozay

Inspired by NC properties, we explore in this paper the transferability of DNN models trained with their last layer weight fixed according to ETF.

Fine-Grained Image Classification Transfer Learning

HOP to the Next Tasks and Domains for Continual Learning in NLP

no code implementations28 Feb 2024 Umberto Michieli, Mete Ozay

Continual Learning (CL) aims to learn a sequence of problems (i. e., tasks and domains) by transferring knowledge acquired on previous problems, whilst avoiding forgetting of past ones.

Continual Learning

A Modular System for Enhanced Robustness of Multimedia Understanding Networks via Deep Parametric Estimation

1 code implementation28 Feb 2024 Francesco Barbato, Umberto Michieli, Mehmet Kerim Yucel, Pietro Zanuttigh, Mete Ozay

To this end, we design a small, modular, and efficient (just 2GFLOPs to process a Full HD image) system to enhance input data for robust downstream multimedia understanding with minimal computational cost.

Data Augmentation Domain Adaptation +2

RECALL+: Adversarial Web-based Replay for Continual Learning in Semantic Segmentation

no code implementations19 Sep 2023 Chang Liu, Giulia Rizzoli, Francesco Barbato, Andrea Maracani, Marco Toldo, Umberto Michieli, Yi Niu, Pietro Zanuttigh

Catastrophic forgetting of previous knowledge is a critical issue in continual learning typically handled through various regularization strategies.

Continual Learning Incremental Learning +1

Online Continual Learning in Keyword Spotting for Low-Resource Devices via Pooling High-Order Temporal Statistics

1 code implementation24 Jul 2023 Umberto Michieli, Pablo Peso Parada, Mete Ozay

Keyword Spotting (KWS) models on embedded devices should adapt fast to new user-defined words without forgetting previous ones.

Continual Learning Keyword Spotting

A Model for Every User and Budget: Label-Free and Personalized Mixed-Precision Quantization

1 code implementation24 Jul 2023 Edward Fish, Umberto Michieli, Mete Ozay

Recent advancement in Automatic Speech Recognition (ASR) has produced large AI models, which become impractical for deployment in mobile devices.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

Online Continual Learning for Robust Indoor Object Recognition

no code implementations19 Jul 2023 Umberto Michieli, Mete Ozay

Vision systems mounted on home robots need to interact with unseen classes in changing environments.

Continual Learning Object +1

Learning with Style: Continual Semantic Segmentation Across Tasks and Domains

no code implementations13 Oct 2022 Marco Toldo, Umberto Michieli, Pietro Zanuttigh

Then, we address the proposed setup by using style transfer techniques to extend knowledge across domains when learning incremental tasks and a robust distillation framework to effectively recollect task knowledge under incremental domain shift.

Autonomous Driving class-incremental learning +6

Learning Across Domains and Devices: Style-Driven Source-Free Domain Adaptation in Clustered Federated Learning

1 code implementation5 Oct 2022 Donald Shenaj, Eros Fanì, Marco Toldo, Debora Caldarola, Antonio Tavera, Umberto Michieli, Marco Ciccone, Pietro Zanuttigh, Barbara Caputo

Federated Learning (FL) has recently emerged as a possible way to tackle the domain shift in real-world Semantic Segmentation (SS) without compromising the private nature of the collected data.

Autonomous Driving Federated Learning +2

Continual Coarse-to-Fine Domain Adaptation in Semantic Segmentation

1 code implementation18 Jan 2022 Donald Shenaj, Francesco Barbato, Umberto Michieli, Pietro Zanuttigh

In this paper we introduce the novel task of coarse-to-fine learning of semantic segmentation architectures in presence of domain shift.

Domain Adaptation Knowledge Distillation +1

Road Scenes Segmentation Across Different Domains by Disentangling Latent Representations

1 code implementation6 Aug 2021 Francesco Barbato, Umberto Michieli, Marco Toldo, Pietro Zanuttigh

Deep learning models obtain impressive accuracy in road scenes understanding, however they need a large quantity of labeled samples for their training.

Domain Adaptation Semantic Segmentation

Prototype Guided Federated Learning of Visual Feature Representations

no code implementations19 May 2021 Umberto Michieli, Mete Ozay

Federated Learning (FL) is a framework which enables distributed model training using a large corpus of decentralized training data.

Federated Learning Image Classification +2

Latent Space Regularization for Unsupervised Domain Adaptation in Semantic Segmentation

1 code implementation6 Apr 2021 Francesco Barbato, Marco Toldo, Umberto Michieli, Pietro Zanuttigh

Deep convolutional neural networks for semantic segmentation achieve outstanding accuracy, however they also have a couple of major drawbacks: first, they do not generalize well to distributions slightly different from the one of the training data; second, they require a huge amount of labeled data for their optimization.

Autonomous Driving Clustering +3

Unsupervised Domain Adaptation in Semantic Segmentation via Orthogonal and Clustered Embeddings

1 code implementation25 Nov 2020 Marco Toldo, Umberto Michieli, Pietro Zanuttigh

Deep learning frameworks allowed for a remarkable advancement in semantic segmentation, but the data hungry nature of convolutional networks has rapidly raised the demand for adaptation techniques able to transfer learned knowledge from label-abundant domains to unlabeled ones.

Clustering Semantic Segmentation +1

GMNet: Graph Matching Network for Large Scale Part Semantic Segmentation in the Wild

no code implementations ECCV 2020 Umberto Michieli, Edoardo Borsato, Luca Rossi, Pietro Zanuttigh

To tackle part-level ambiguity and localization we propose a novel adjacency graph-based module that aims at matching the relative spatial relationships between ground truth and predicted parts.

Graph Matching Object +1

Unsupervised Domain Adaptation in Semantic Segmentation: a Review

no code implementations21 May 2020 Marco Toldo, Andrea Maracani, Umberto Michieli, Pietro Zanuttigh

The aim of this paper is to give an overview of the recent advancements in the Unsupervised Domain Adaptation (UDA) of deep networks for semantic segmentation.

Autonomous Driving Multi-Task Learning +2

Unsupervised Domain Adaptation with Multiple Domain Discriminators and Adaptive Self-Training

no code implementations27 Apr 2020 Teo Spadotto, Marco Toldo, Umberto Michieli, Pietro Zanuttigh

We introduce a novel UDA framework where a standard supervised loss on labeled synthetic data is supported by an adversarial module and a self-training strategy aiming at aligning the two domain distributions.

Segmentation Semantic Segmentation +1

Knowledge Distillation for Incremental Learning in Semantic Segmentation

no code implementations8 Nov 2019 Umberto Michieli, Pietro Zanuttigh

Deep learning architectures have shown remarkable results in scene understanding problems, however they exhibit a critical drop of performances when they are required to learn incrementally new tasks without forgetting old ones.

Image Classification Incremental Learning +5

Adversarial Learning and Self-Teaching Techniques for Domain Adaptation in Semantic Segmentation

no code implementations2 Sep 2019 Umberto Michieli, Matteo Biasetton, Gianluca Agresti, Pietro Zanuttigh

A recently proposed workaround is to train deep networks using synthetic data, but the domain shift between real world and synthetic representations limits the performance.

Autonomous Driving Semantic Segmentation +1

Incremental Learning Techniques for Semantic Segmentation

2 code implementations31 Jul 2019 Umberto Michieli, Pietro Zanuttigh

To tackle this task we propose to distill the knowledge of the previous model to retain the information about previously learned classes, whilst updating the current model to learn the new ones.

Disjoint 10-1 Disjoint 15-1 +14

Complex Network Analysis of Men Single ATP Tennis Matches

no code implementations22 Apr 2018 Umberto Michieli

Who are the most significant players in the history of men tennis?

Cannot find the paper you are looking for? You can Submit a new open access paper.