no code implementations • 4 Dec 2024 • Gianni Franchi, Dat Nguyen Trong, Nacim Belkhir, Guoxuan Xia, Andrea Pilzer
Alongside adapting existing approaches designed to measure uncertainty in the image space, we also introduce Prompt-based UNCertainty Estimation for T2I models (PUNC), a novel method leveraging Large Vision-Language Models (LVLMs) to better address uncertainties arising from the semantics of the prompt and generated images.
no code implementations • 2 Dec 2024 • Francesco Taioli, Edoardo Zorzi, Gianni Franchi, Alberto Castellini, Alessandro Farinelli, Marco Cristani, Yiming Wang
Existing embodied instance goal navigation tasks, driven by natural language, assume human users to provide complete and nuanced instance descriptions prior to the navigation, which can be impractical in the real world as human instructions might be brief and ambiguous.
no code implementations • 4 Nov 2024 • Rémi Kazmierczak, Steve Azzolin, Eloïse Berthier, Anna Hedström, Patricia Delhomme, Nicolas Bousquet, Goran Frehse, Massimiliano Mancini, Baptiste Caramiaux, Andrea Passerini, Gianni Franchi
Our first key contribution is a human evaluation of XAI explanations on four diverse datasets (COCO, Pascal Parts, Cats Dogs Cars, and MonumAI) which constitutes the first large-scale benchmark dataset for XAI, with annotations at both the image and concept levels.
no code implementations • 4 Nov 2024 • Mouïn Ben Ammar, David Brellmann, Arturo Mendoza, Antoine Manzanera, Gianni Franchi
While overparameterization is known to benefit generalization, its impact on Out-Of-Distribution (OOD) detection is less understood.
Out-of-Distribution Detection Out of Distribution (OOD) Detection
no code implementations • 7 Oct 2024 • Mingxuan Liu, Zhun Zhong, Jun Li, Gianni Franchi, Subhankar Roy, Elisa Ricci
Our framework, Text Driven Semantic Multiple Clustering (TeDeSC), uses text as a proxy to concurrently reason over large image collections, discover partitioning criteria, expressed in natural language, and reveal semantic substructures.
1 code implementation • 28 May 2024 • Matteo Farina, Gianni Franchi, Giovanni Iacca, Massimiliano Mancini, Elisa Ricci
Thanks to its simplicity and comparatively negligible computation, ZERO can serve as a strong baseline for future work in this field.
1 code implementation • 26 Mar 2024 • Adrien Lafage, Mathieu Barbier, Gianni Franchi, David Filliat
Accurate trajectory forecasting is crucial for the performance of various systems, such as advanced driver-assistance systems and self-driving vehicles.
no code implementations • 19 Mar 2024 • Guoxuan Xia, Olivier Laurent, Gianni Franchi, Christos-Savvas Bouganis
We then demonstrate the empirical effectiveness of post-hoc logit normalisation for recovering lost SC performance caused by LS.
no code implementations • CVPR 2024 • Gianni Franchi, Olivier Laurent, Maxence Leguéry, Andrei Bursuc, Andrea Pilzer, Angela Yao
Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications.
no code implementations • 30 Nov 2023 • Rémi Kazmierczak, Eloïse Berthier, Goran Frehse, Gianni Franchi
In this paper, we introduce an explainable algorithm designed from a multi-modal foundation model, that performs fast and explainable image classification.
1 code implementation • 12 Oct 2023 • Olivier Laurent, Emanuel Aldea, Gianni Franchi
The distribution of the weights of modern deep neural networks (DNNs) - crucial for uncertainty quantification and robustness - is an eminently complex object due to its extremely high dimensionality.
1 code implementation • 10 Oct 2023 • Mouïn Ben Ammar, Nacim Belkhir, Sebastian Popescu, Antoine Manzanera, Gianni Franchi
Detecting out-of-distribution (OOD) data is a critical challenge in machine learning due to model overconfidence, often without awareness of their epistemological limits.
1 code implementation • 7 Oct 2023 • Denis Mbey Akola, Gianni Franchi
This paper presents a new approach for training two-stage object detection ensemble models, more specifically, Faster R-CNN models to estimate uncertainty.
1 code implementation • 30 Sep 2023 • Kai Xu, Rongyu Chen, Gianni Franchi, Angela Yao
The capacity of a modern deep learning system to determine if a sample falls within its realm of knowledge is fundamental and important.
Ranked #1 on Out-of-Distribution Detection on Far-OOD
Out-of-Distribution Detection Out of Distribution (OOD) Detection
1 code implementation • 27 Sep 2023 • Gianni Franchi, Marwane Hariat, Xuanlong Yu, Nacim Belkhir, Antoine Manzanera, David Filliat
Current deep neural networks (DNNs) for autonomous driving computer vision are typically trained on specific datasets that only involve a single type of data and urban scenes.
no code implementations • 27 Sep 2023 • Xuanlong Yu, Yi Zuo, Zitao Wang, Xiaowen Zhang, Jiaxuan Zhao, Yuting Yang, Licheng Jiao, Rui Peng, Xinyi Wang, Junpei Zhang, Kexin Zhang, Fang Liu, Roberto Alcover-Couso, Juan C. SanMiguel, Marcos Escudero-Viñolo, Hanlin Tian, Kenta Matsui, Tianhao Wang, Fahmy Adan, Zhitong Gao, Xuming He, Quentin Bouniot, Hossein Moghaddam, Shyam Nandan Rai, Fabio Cermelli, Carlo Masone, Andrea Pilzer, Elisa Ricci, Andrei Bursuc, Arno Solin, Martin Trapp, Rui Li, Angela Yao, Wenlong Chen, Ivor Simpson, Neill D. F. Campbell, Gianni Franchi
This paper outlines the winning solutions employed in addressing the MUAD uncertainty quantification challenge held at ICCV 2023.
no code implementations • 19 Sep 2023 • Clement Laroudie, Andrei Bursuc, Mai Lan Ha, Gianni Franchi
This paper examines the robustness of a multi-modal computer vision model, CLIP (Contrastive Language-Image Pretraining), in the context of unsupervised learning.
1 code implementation • 17 Aug 2023 • Xuanlong Yu, Gianni Franchi, Jindong Gu, Emanuel Aldea
In this work, we propose a generalized AuxUE scheme for more robust uncertainty quantification on regression tasks.
no code implementations • 1 Aug 2023 • Marwane Hariat, Olivier Laurent, Rémi Kazmierczak, Shihao Zhang, Andrei Bursuc, Angela Yao, Gianni Franchi
We propose a novel approach to improve the robustness of semantic segmentation techniques by leveraging the synergy between label-to-image generators and image-to-label segmentation models.
1 code implementation • 17 Oct 2022 • Olivier Laurent, Adrien Lafage, Enzo Tartaglione, Geoffrey Daniel, Jean-Marc Martinez, Andrei Bursuc, Gianni Franchi
Deep Ensembles (DE) are a prominent approach for achieving excellent performance on key metrics such as accuracy, calibration, uncertainty estimation, and out-of-distribution detection.
1 code implementation • 26 Sep 2022 • Adrien Bennetot, Gianni Franchi, Javier Del Ser, Raja Chatila, Natalia Diaz-Rodriguez
As a result, there is a widespread agreement on the importance of endowing Deep Learning models with explanatory capabilities so that they can themselves provide an answer to why a particular prediction was made.
Explainable artificial intelligence Explainable Artificial Intelligence (XAI) +1
1 code implementation • 20 Jul 2022 • Gianni Franchi, Xuanlong Yu, Andrei Bursuc, Emanuel Aldea, Severine Dubuisson, David Filliat
Predictive uncertainty estimation is essential for deploying Deep Neural Networks in real-world autonomous systems.
3 code implementations • 2 Mar 2022 • Gianni Franchi, Xuanlong Yu, Andrei Bursuc, Angel Tena, Rémi Kazmierczak, Séverine Dubuisson, Emanuel Aldea, David Filliat
However, disentangling the different types and sources of uncertainty is non trivial for most datasets, especially since there is no ground truth for uncertainty.
no code implementations • 24 Feb 2022 • Xuanlong Yu, Gianni Franchi, Emanuel Aldea
To this end, this paper will introduce a taxonomy and summary of CAR approaches, a new uncertainty estimation solution for CAR, and a set of experiments on depth accuracy and uncertainty quantification for CAR-based models on KITTI dataset.
1 code implementation • 17 Feb 2022 • Rémi Kazmierczak, Gianni Franchi, Nacim Belkhir, Antoine Manzanera, David Filliat
Several metrics exist to quantify the similarity between images, but they are inefficient when it comes to measure the similarity of highly distorted images.
1 code implementation • 21 Oct 2021 • Xuanlong Yu, Gianni Franchi, Emanuel Aldea
It has become critical for deep learning algorithms to quantify their output uncertainties to satisfy reliability constraints and provide accurate results.
2 code implementations • 2 Aug 2021 • Gianni Franchi, Nacim Belkhir, Mai Lan Ha, Yufei Hu, Andrei Bursuc, Volker Blanz, Angela Yao
Along with predictive performance and runtime speed, reliability is a key requirement for real-world semantic segmentation.
no code implementations • 13 Jul 2021 • Mai Lan Ha, Gianni Franchi, Emanuel Aldea, Volker Blanz
NDA transforms deep features to become more discriminative and, therefore, improves the performances in various tasks.
1 code implementation • 14 Jun 2021 • Yufei Hu, Nacim Belkhir, Jesus Angulo, Angela Yao, Gianni Franchi
Using a combination of linear and non-linear procedures is critical for generating a sufficiently deep feature space.
2 code implementations • 24 Apr 2021 • Natalia Díaz-Rodríguez, Alberto Lamas, Jules Sanchez, Gianni Franchi, Ivan Donadello, Siham Tabik, David Filliat, Policarpo Cruz, Rosana Montes, Francisco Herrera
We tackle such problem by considering the symbolic knowledge is expressed in form of a domain expert knowledge graph.
2 code implementations • 4 Dec 2020 • Gianni Franchi, Andrei Bursuc, Emanuel Aldea, Severine Dubuisson, Isabelle Bloch
Bayesian neural networks (BNNs) have been long considered an ideal, yet unscalable solution for improving the robustness and the predictive uncertainty of deep neural networks.
Ranked #142 on Image Classification on CIFAR-10
no code implementations • 1 Jun 2020 • Gianni Franchi, Andrei Bursuc, Emanuel Aldea, Severine Dubuisson, Isabelle Bloch
This is due to the fact that modern DNNs are usually uncalibrated and we cannot characterize their epistemic uncertainty.
no code implementations • ECCV 2020 • Gianni Franchi, Andrei Bursuc, Emanuel Aldea, Severine Dubuisson, Isabelle Bloch
During training, the weights of a Deep Neural Network (DNN) are optimized from a random initialization towards a nearly optimum value minimizing a loss function.
no code implementations • 10 Dec 2018 • Gianni Franchi, Angela Yao, Andreas Kolb
We propose a novel single-image super-resolution approach based on the geostatistical method of kriging.
no code implementations • 30 May 2016 • Gianni Franchi, Jesus Angulo, Dino Sejdinovic
We propose a novel approach for pixel classification in hyperspectral images, leveraging on both the spatial and spectral information in the data.