1 code implementation • 5 Sep 2024 • Fereshteh Shakeri, Yunshi Huang, Julio Silva-Rodríguez, Houda Bahig, An Tang, Jose Dolz, Ismail Ben Ayed
Integrating image and text data through multi-modal learning has emerged as a new approach in medical imaging research, following its successful deployment in computer vision.
2 code implementations • 3 Sep 2024 • Maxime Zanella, Fereshteh Shakeri, Yunshi Huang, Houda Bahig, Ismail Ben Ayed
The development of vision-language models (VLMs) for histo-pathology has shown promising new usages and zero-shot performances.
2 code implementations • 1 Sep 2024 • Karim El Khoury, Maxime Zanella, Benoît Gérin, Tiffanie Godelaine, Benoît Macq, Saïd Mahmoudi, Christophe De Vleeschouwer, Ismail Ben Ayed
Vision-Language Models for remote sensing have shown promising uses thanks to their extensive pretraining.
1 code implementation • 18 Jul 2024 • Balamurali Murugesan, Julio Silva-Rodriguez, Ismail Ben Ayed, Jose Dolz
This paper addresses the critical issue of miscalibration in CLIP-based model adaptation, particularly in the challenging scenario of out-of-distribution (OOD) samples, which has been overlooked in the existing literature on CLIP adaptation.
1 code implementation • 4 Jul 2024 • Mehrdad Noori, Milad Cheraghalikhani, Ali Bahri, Gustavo Adolfo Vargas Hakim, David Osowiechi, Moslem Yazdanpanah, Ismail Ben Ayed, Christian Desrosiers
To address these challenges, we propose FDS, Feedback-guided Domain Synthesis, a novel strategy that employs diffusion models to synthesize novel, pseudo-domains by training a single model on all source domains and performing domain mixing based on learned features.
1 code implementation • 19 Jun 2024 • David Osowiechi, Mehrdad Noori, Gustavo Adolfo Vargas Hakim, Moslem Yazdanpanah, Ali Bahri, Milad Cheraghalikhani, Sahar Dastani, Farzad Beizaee, Ismail Ben Ayed, Christian Desrosiers
In response, we present Weight Average Test-Time Adaptation (WATT) of CLIP, a pioneering approach facilitating full test-time adaptation (TTA) of this VLM.
no code implementations • 11 Jun 2024 • Maxime Darrin, Philippe Formont, Ismail Ben Ayed, Jackie CK Cheung, Pablo Piantanida
Embedders play a central role in machine learning, projecting any object into numerical representations that can, in turn, be leveraged to perform various downstream tasks.
1 code implementation • 3 Jun 2024 • Maxime Zanella, Benoît Gérin, Ismail Ben Ayed
Transduction is a powerful paradigm that leverages the structure of unlabeled data to boost predictive accuracy.
1 code implementation • 28 May 2024 • Maxime Zanella, Ismail Ben Ayed
Recent progress in the few-shot adaptation of Vision-Language Models (VLMs) has further pushed their generalization capabilities, at the expense of just a few labeled samples within the target downstream task.
no code implementations • 20 May 2024 • Ali Bahri, Moslem Yazdanpanah, Mehrdad Noori, Milad Cheraghalikhani, Gustavo Adolfo Vargas Hakim, David Osowiechi, Farzad Beizaee, Ismail Ben Ayed, Christian Desrosiers
We introduce a pioneering approach to self-supervised learning for point clouds, employing a geometrically informed mask selection strategy called GeoMask3D (GM3D) to boost the efficiency of Masked Auto Encoders (MAE).
1 code implementation • CVPR 2024 • Maxime Zanella, Ismail Ben Ayed
Additionally, our method does not rely on ad hoc rules (e. g., confidence threshold) used in some previous test-time augmentation techniques to filter the augmented views.
1 code implementation • 1 May 2024 • Gustavo Adolfo Vargas Hakim, David Osowiechi, Mehrdad Noori, Milad Cheraghalikhani, Ali Bahri, Moslem Yazdanpanah, Ismail Ben Ayed, Christian Desrosiers
In this study, we introduce CLIP Adaptation duRing Test-Time (CLIPArTT), a fully test-time adaptation (TTA) approach for CLIP, which involves automatic text prompts construction during inference for their use as text supervision.
no code implementations • 30 Apr 2024 • Antonio Emanuele Cinà, Jérôme Rony, Maura Pintor, Luca Demetrio, Ambra Demontis, Battista Biggio, Ismail Ben Ayed, Fabio Roli
While novel attacks are continuously proposed, each is shown to outperform its predecessors using different experimental setups, hyperparameter settings, and number of forward and backward calls to the target models.
1 code implementation • 12 Apr 2024 • Sina Hajimiri, Ismail Ben Ayed, Jose Dolz
However, existing approaches often rely on impractical supervised pre-training or access to additional pre-trained networks.
Open Vocabulary Semantic Segmentation Open-Vocabulary Semantic Segmentation +1
1 code implementation • 12 Apr 2024 • David Osowiechi, Gustavo A. Vargas Hakim, Mehrdad Noori, Milad Cheraghalikhani, Ali Bahri, Moslem Yazdanpanah, Ismail Ben Ayed, Christian Desrosiers
Despite their exceptional performance in vision tasks, deep learning models often struggle when faced with domain shifts during testing.
no code implementations • 2 Apr 2024 • Philippe Formont, Hugo Jeannin, Pablo Piantanida, Ismail Ben Ayed
Few-shot learning has recently attracted significant interest in drug discovery, with a recent, fast-growing literature mostly involving convoluted meta-learning strategies.
1 code implementation • CVPR 2024 • Yunshi Huang, Fereshteh Shakeri, Jose Dolz, Malik Boudiaf, Houda Bahig, Ismail Ben Ayed
In this work, we propose and examine from convex-optimization perspectives a generalization of the standard LP baseline, in which the linear classifier weights are learnable functions of the text embedding, with class-wise multipliers blending image and text knowledge.
1 code implementation • 22 Mar 2024 • Shambhavi Mishra, Balamurali Murugesan, Ismail Ben Ayed, Marco Pedersoli, Jose Dolz
State-of-the-art semi-supervised learning (SSL) approaches rely on highly confident predictions to serve as pseudo-labels that guide the training on unlabeled samples.
1 code implementation • 19 Mar 2024 • Balamurali Murugesan, Julio Silva-Rodriguez, Ismail Ben Ayed, Jose Dolz
In particular, we present a formulation that integrates class and region-wise constraints into the learning objective, with multiple penalty weights to account for class and region differences.
no code implementations • 27 Jan 2024 • Julio Silva-Rodriguez, Jihed Chelbi, Waziha Kabir, Hadi Chakor, Jose Dolz, Ismail Ben Ayed, Riadh Kobbi
In this work, we explore the potential of using FLAIR features as starting point for fundus image classification, and we compare its performance with regard to Imagenet initialization on two popular transfer learning methods: Linear Probing (LP) and Fine-Tuning (FP).
1 code implementation • 25 Jan 2024 • Balamurali Murugesan, Sukesh Adiga Vasudeva, Bingyuan Liu, Hervé Lombaert, Ismail Ben Ayed, Jose Dolz
Ensuring reliable confidence scores from deep neural networks is of paramount significance in critical decision-making systems, particularly in real-world domains such as healthcare.
1 code implementation • CVPR 2024 • Ségolène Martin, Yunshi Huang, Fereshteh Shakeri, Jean-Christophe Pesquet, Ismail Ben Ayed
Transductive inference has been widely investigated in few-shot image classification but completely overlooked in the recent fast growing literature on adapting vision-langage models like CLIP.
1 code implementation • CVPR 2024 • David Osowiechi, Gustavo A. Vargas Hakim, Mehrdad Noori, Milad Cheraghalikhani, Ali Bahri, Moslem Yazdanpanah, Ismail Ben Ayed, Christian Desrosiers
Despite their exceptional performance in vision tasks deep learning models often struggle when faced with domain shifts during testing.
1 code implementation • CVPR 2024 • Julio Silva-Rodríguez, Sina Hajimiri, Ismail Ben Ayed, Jose Dolz
Efficient transfer learning (ETL) is receiving increasing attention to adapt large pre-trained language-vision models on downstream tasks with a few labeled samples.
no code implementations • 29 Nov 2023 • Aymen Sadraoui, Ségolène Martin, Eliott Barbot, Astrid Laurent-Bellue, Jean-Christophe Pesquet, Catherine Guettier, Ismail Ben Ayed
This paper presents a new approach for classifying 2D histopathology patches using few-shot learning.
no code implementations • 21 Oct 2023 • Pierre Colombo, Victor Pellegrain, Malik Boudiaf, Victor Storchan, Myriam Tami, Ismail Ben Ayed, Celine Hudelot, Pablo Piantanida
First, we introduce a scenario where the embedding of a pre-trained model is served through a gated API with compute-cost and data-privacy constraints.
1 code implementation • ICCV 2023 • Gustavo A. Vargas Hakim, David Osowiechi, Mehrdad Noori, Milad Cheraghalikhani, Ismail Ben Ayed, Christian Desrosiers
Deep Learning models have shown remarkable performance in a broad range of vision tasks.
no code implementations • 9 Oct 2023 • Mathieu Vu, Emilie Chouzenoux, Jean-Christophe Pesquet, Ismail Ben Ayed
Ensemble learning leverages multiple models (i. e., weak learners) on a common machine learning task to enhance prediction performance.
1 code implementation • 3 Oct 2023 • Saypraseuth Mounsaveng, Florent Chiaroni, Malik Boudiaf, Marco Pedersoli, Ismail Ben Ayed
Fully Test-Time Adaptation (TTA), which aims at adapting models to data drifts, has recently attracted wide interest.
1 code implementation • 15 Aug 2023 • Julio Silva-Rodriguez, Hadi Chakor, Riadh Kobbi, Jose Dolz, Ismail Ben Ayed
Foundation vision-language models are currently transforming computer vision, and are on the rise in medical imaging fueled by their very promising generalization capabilities.
1 code implementation • 21 Jul 2023 • Saypraseuth Mounsaveng, Issam Laradji, David Vázquez, Marco Perdersoli, Ismail Ben Ayed
Experimental results show that our model can learn color and affine transformations that are more helpful to train an image classifier than predefined DA transformations, which are also more expensive as they need to be selected before the training by grid search on a validation set.
2 code implementations • 30 Jun 2023 • Balamurali Murugesan, Rukhshanda Hussain, Rajarshi Bhattacharya, Ismail Ben Ayed, Jose Dolz
First, modifying only the class token of the text prompt results in a greater impact on the Class Activation Map (CAM), compared to arguably more complex strategies that optimize the context.
Few-Shot Learning Weakly supervised Semantic Segmentation +1
no code implementations • 13 Apr 2023 • Imtiaz Masud Ziko, Freddy Lecue, Ismail Ben Ayed
We introduce a simple non-linear embedding adaptation layer, which is fine-tuned on top of fixed pre-trained features for one-shot tasks, improving significantly transductive entropy-based inference for low-shot regimes.
1 code implementation • 29 Mar 2023 • Julio Silva-Rodríguez, Jose Dolz, Ismail Ben Ayed
With the recent raise of foundation models in computer vision and NLP, the pretrain-and-adapt strategy, where a large-scale model is fine-tuned on downstream tasks, is gaining popularity.
1 code implementation • 28 Mar 2023 • Mehrdad Noori, Milad Cheraghalikhani, Ali Bahri, Gustavo A. Vargas Hakim, David Osowiechi, Ismail Ben Ayed, Christian Desrosiers
This paper presents a first Token-level Feature Stylization (TFS-ViT) approach for domain generalization, which improves the performance of ViTs to unseen data by synthesizing new domains.
1 code implementation • 16 Mar 2023 • Soufiane Belharbi, Shakeeb Murtaza, Marco Pedersoli, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
This paper proposes a novel CAM method for WSVOL that exploits spatiotemporal information in activation maps during training without constraining an object's position.
1 code implementation • 11 Mar 2023 • Balamurali Murugesan, Sukesh Adiga V, Bingyuan Liu, Hervé Lombaert, Ismail Ben Ayed, Jose Dolz
Ensuring reliable confidence scores from deep networks is of pivotal importance in critical decision-making systems, notably in the medical domain.
1 code implementation • CVPR 2023 • Malik Boudiaf, Etienne Bennequin, Myriam Tami, Antoine Toubhans, Pablo Piantanida, Céline Hudelot, Ismail Ben Ayed
We tackle the Few-Shot Open-Set Recognition (FSOSR) problem, i. e. classifying instances among a set of classes for which we only have a few labeled samples, while simultaneously detecting instances that do not belong to any known class.
1 code implementation • CVPR 2023 • Jérôme Rony, Jean-Christophe Pesquet, Ismail Ben Ayed
Classification has been the focal point of research on adversarial attacks, but only a few works investigate methods suited to denser prediction tasks, such as semantic segmentation.
no code implementations • 13 Dec 2022 • Ruobing Shen, Bo Tang, Andrea Lodi, Ismail Ben Ayed, Thomas Guthier
We address interactive panoptic annotation, where one segment all object and stuff regions in an image.
1 code implementation • ICCV 2023 • Florent Chiaroni, Jose Dolz, Ziko Imtiaz Masud, Amar Mitiche, Ismail Ben Ayed
We introduce a Parametric Information Maximization (PIM) model for the Generalized Category Discovery (GCD) problem.
1 code implementation • CVPR 2023 • Bingyuan Liu, Jérôme Rony, Adrian Galdran, Jose Dolz, Ismail Ben Ayed
Comprehensive evaluation and multiple comparisons on a variety of benchmarks, including standard and long-tailed image classification, semantic segmentation, and text classification, demonstrate the superiority of the proposed method.
1 code implementation • CVPR 2023 • Sina Hajimiri, Malik Boudiaf, Ismail Ben Ayed, Jose Dolz
In addition, the terms derived from our MI-based formulation are coupled with a knowledge distillation term to retain the knowledge on base classes.
1 code implementation • 26 Oct 2022 • Ségolène Martin, Malik Boudiaf, Emilie Chouzenoux, Jean-Christophe Pesquet, Ismail Ben Ayed
We relax these assumptions and extend current benchmarks, so that the query-set classes of a given task are unknown, but just belong to a much larger set of possible classes.
1 code implementation • 20 Oct 2022 • David Osowiechi, Gustavo A. Vargas Hakim, Mehrdad Noori, Milad Cheraghalikhani, Ismail Ben Ayed, Christian Desrosiers
A major problem of deep neural networks for image classification is their vulnerability to domain changes at test-time.
1 code implementation • 9 Sep 2022 • Balamurali Murugesan, Bingyuan Liu, Adrian Galdran, Ismail Ben Ayed, Jose Dolz
Following our observations, we propose a simple and flexible generalization based on inequality constraints, which imposes a controllable margin on logit distances.
1 code implementation • 30 Aug 2022 • Soufiane Belharbi, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
Our proposed TCAM method achieves a new state-of-art in WSVOL accuracy, and visual results suggest that it can be adapted for subsequent tasks like visual object tracking and detection.
1 code implementation • 30 Jul 2022 • Florent Chiaroni, Malik Boudiaf, Amar Mitiche, Ismail Ben Ayed
We explore clustering the softmax predictions of deep neural networks and introduce a novel probabilistic clustering method, referred to as k-sBetas.
1 code implementation • 18 Jun 2022 • Malik Boudiaf, Etienne Bennequin, Myriam Tami, Celine Hudelot, Antoine Toubhans, Pablo Piantanida, Ismail Ben Ayed
Through extensive experiments spanning 5 datasets, we show that OSTIM surpasses both inductive and existing transductive methods in detecting open-set instances while competing with the strongest transductive methods in classifying closed-set instances.
2 code implementations • 14 Jun 2022 • Jérôme Rony, Jean-Christophe Pesquet, Ismail Ben Ayed
Classification has been the focal point of research on adversarial attacks, but only a few works investigate methods suited to denser prediction tasks, such as semantic segmentation.
no code implementations • 31 May 2022 • Fereshteh Shakeri, Malik Boudiaf, Sina Mohammadi, Ivaxi Sheth, Mohammad Havaei, Ismail Ben Ayed, Samira Ebrahimi Kahou
We build few-shot tasks and base-training data with various tissue types, different levels of domain shifts stemming from various cancer sites, and different class-granularity levels, thereby reflecting realistic scenarios.
1 code implementation • 16 May 2022 • Mathilde Bateson, Hervé Lombaert, Ismail Ben Ayed
In typical clinical settings, the source data is inaccessible and the target distribution is represented with a handful of samples: adaptation can only happen at test time on a few or even a single subject(s).
1 code implementation • 12 May 2022 • Soufiane Belharbi, Jérôme Rony, Jose Dolz, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
Our method is composed of two networks: a localizer that yields segmentation mask, followed by a classifier.
1 code implementation • NeurIPS 2021 • Olivier Veilleux, Malik Boudiaf, Pablo Piantanida, Ismail Ben Ayed
Transductive inference is widely used in few-shot learning, as it leverages the statistics of the unlabeled query set of a few-shot task, typically yielding substantially better performances than its inductive counterpart.
1 code implementation • CVPR 2022 • Malik Boudiaf, Romain Mueller, Ismail Ben Ayed, Luca Bertinetto
An interesting and practical paradigm is online test-time adaptation, according to which training data is inaccessible, no labelled data from the test distribution is available, and adaptation can only happen at test time and on a handful of samples.
1 code implementation • 7 Jan 2022 • Soufiane Belharbi, Marco Pedersoli, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
The CNN is exploited to collect both positive and negative evidence at the pixel level to train the decoder.
1 code implementation • CVPR 2022 • Bingyuan Liu, Ismail Ben Ayed, Adrian Galdran, Jose Dolz
Following our observations, we propose a simple and flexible generalization based on inequality constraints, which imposes a controllable margin on logit distances.
2 code implementations • 21 Sep 2021 • Bingyuan Liu, Christian Desrosiers, Ismail Ben Ayed, Jose Dolz
Combined with a standard cross-entropy loss over the labeled pixels, our novel formulation integrates two important terms: (i) a Shannon entropy loss defined over the less-supervised images, which encourages confident student predictions in the bottom branch; and (ii) a KL divergence term, which transfers the knowledge (i. e., predictions) of the strongly supervised branch to the less-supervised branch and guides the entropy (student-confidence) term to avoid trivial solutions.
1 code implementation • 15 Sep 2021 • Soufiane Belharbi, Aydin Sarraf, Marco Pedersoli, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
Interpolation is required to restore full size CAMs, yet it does not consider the statistical properties of objects, such as color and texture, leading to activations with inconsistent boundaries, and inaccurate localizations.
1 code implementation • 6 Aug 2021 • Mathilde Bateson, Hoel Kervadec, Jose Dolz, Hervé Lombaert, Ismail Ben Ayed
Our method yields comparable results to several state of the art adaptation techniques, despite having access to much less information, as the source images are entirely absent in our adaptation phase.
3 code implementations • 23 Jun 2021 • Malik Boudiaf, Ziko Imtiaz Masud, Jérôme Rony, Jose Dolz, Ismail Ben Ayed, Pablo Piantanida
We motivate our transductive loss by deriving a formal relation between the classification accuracy and mutual-information maximization.
1 code implementation • 16 Jun 2021 • Imtiaz Masud Ziko, Malik Boudiaf, Jose Dolz, Eric Granger, Ismail Ben Ayed
Surprisingly, we found that even standard clustering procedures (e. g., K-means), which correspond to particular, non-regularized cases of our general model, already achieve competitive performances in comparison to the state-of-the-art in few-shot learning.
1 code implementation • 12 Jun 2021 • Marine Picot, Francisco Messina, Malik Boudiaf, Fabrice Labeau, Ismail Ben Ayed, Pablo Piantanida
Adversarial robustness has become a topic of growing interest in machine learning since it was observed that neural networks tend to be brittle.
1 code implementation • 3 May 2021 • Hoel Kervadec, Houda Bahig, Laurent Letourneau-Guillon, Jose Dolz, Ismail Ben Ayed
We also found that shape descriptors can be a valid way to encode anatomical priors about the task, enabling to leverage expert knowledge without additional annotations.
1 code implementation • 18 Apr 2021 • Bingyuan Liu, Jose Dolz, Adrian Galdran, Riadh Kobbi, Ismail Ben Ayed
Most segmentation losses are arguably variants of the Cross-Entropy (CE) or Dice losses.
1 code implementation • 15 Dec 2020 • Jose Dolz, Christian Desrosiers, Ismail Ben Ayed
In conjunction with a standard cross-entropy over the labeled pixels, our novel formulation integrates two important terms: (i) a Shannon entropy loss defined over the less-supervised images, which encourages confident student predictions at the bottom branch; and (ii) a Kullback-Leibler (KL) divergence, which transfers the knowledge from the predictions generated by the strongly supervised branch to the less-supervised branch, and guides the entropy (student-confidence) term to avoid trivial solutions.
2 code implementations • CVPR 2021 • Malik Boudiaf, Hoel Kervadec, Ziko Imtiaz Masud, Pablo Piantanida, Ismail Ben Ayed, Jose Dolz
We show that the way inference is performed in few-shot segmentation tasks has a substantial effect on performances -- an aspect often overlooked in the literature in favor of the meta-learning paradigm.
Ranked #3 on Few-Shot Semantic Segmentation on COCO-20i (10-shot)
1 code implementation • 9 Dec 2020 • Shanshan Wang, Cheng Li, Rongpin Wang, Zaiyi Liu, Meiyun Wang, Hongna Tan, Yaping Wu, Xinfeng Liu, Hui Sun, Rui Yang, Xin Liu, Jie Chen, Huihui Zhou, Ismail Ben Ayed, Hairong Zheng
Automatic medical image segmentation plays a critical role in scientific research and medical care.
1 code implementation • NeurIPS 2020 • Malik Boudiaf, Imtiaz Ziko, Jérôme Rony, Jose Dolz, Pablo Piantanida, Ismail Ben Ayed
We introduce Transductive Infomation Maximization (TIM) for few-shot learning.
2 code implementations • ICCV 2021 • Jérôme Rony, Eric Granger, Marco Pedersoli, Ismail Ben Ayed
Our attack enjoys the generality of penalty methods and the computational efficiency of distance-customized algorithms, and can be readily used for a wide set of distances.
2 code implementations • 14 Nov 2020 • Soufiane Belharbi, Jérôme Rony, Jose Dolz, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
We propose novel regularization terms, which enable the model to seek both non-discriminative and discriminative regions, while discouraging unbalanced segmentations.
1 code implementation • 10 Oct 2020 • Soufiane Belharbi, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
CNN visualization and interpretation methods, like class-activation maps (CAMs), are typically used to highlight the image regions linked to class predictions.
1 code implementation • 1 Oct 2020 • Adrian Galdran, José Dolz, Hadi Chakor, Hervé Lombaert, Ismail Ben Ayed
Assessing the degree of disease severity in biomedical images is a task similar to standard classification but constrained by an underlying structure in the label space.
2 code implementations • 3 Sep 2020 • Adrian Galdran, André Anjos, José Dolz, Hadi Chakor, Hervé Lombaert, Ismail Ben Ayed
Our analysis demonstrates that the retinal vessel segmentation problem is far from solved when considering test images that differ substantially from the training data, and that this task represents an ideal scenario for the exploration of domain adaptation techniques.
2 code implementations • 25 Aug 2020 • Malik Boudiaf, Ziko Imtiaz Masud, Jérôme Rony, José Dolz, Pablo Piantanida, Ismail Ben Ayed
We introduce Transductive Infomation Maximization (TIM) for few-shot learning.
no code implementations • 9 Aug 2020 • Madhu Kiran, Amran Bhuiyan, Louis-Antoine Blais-Morin, Mehrsan Javan, Ismail Ben Ayed, Eric Granger
Our Mutual Attention network relies on the joint spatial attention between image and optical flow features maps to activate a common set of salient features across them.
Optical Flow Estimation Video-Based Person Re-Identification
no code implementations • 29 Jun 2020 • Tal Arbel, Ismail Ben Ayed, Marleen de Bruijne, Maxime Descoteaux, Herve Lombaert, Chris Pal
This compendium gathers all the accepted extended abstracts from the Third International Conference on Medical Imaging with Deep Learning (MIDL 2020), held in Montreal, Canada, 6-9 July 2020.
2 code implementations • 28 Jun 2020 • Imtiaz Masud Ziko, Jose Dolz, Eric Granger, Ismail Ben Ayed
Our transductive inference does not re-train the base model, and can be viewed as a graph clustering of the query set, subject to supervision constraints from the support set.
2 code implementations • 25 Jun 2020 • Saypraseuth Mounsaveng, Issam Laradji, Ismail Ben Ayed, David Vazquez, Marco Pedersoli
Data augmentation is a key practice in machine learning for improving generalization performance.
5 code implementations • 7 May 2020 • Mathilde Bateson, Hoel Kervadec, Jose Dolz, Herve Lombaert, Ismail Ben Ayed
Our formulation is based on minimizing a label-free entropy loss defined over target-domain data, which we further guide with a domain invariant prior on the segmentation regions.
1 code implementation • MIDL 2019 • Hoel Kervadec, Jose Dolz, Shan-Shan Wang, Eric Granger, Ismail Ben Ayed
Particularly, we leverage a classical tightness prior to a deep learning setting via imposing a set of constraints on the network outputs.
1 code implementation • ECCV 2020 • Malik Boudiaf, Jérôme Rony, Imtiaz Masud Ziko, Eric Granger, Marco Pedersoli, Pablo Piantanida, Ismail Ben Ayed
Second, we show that, more generally, minimizing the cross-entropy is actually equivalent to maximizing the mutual information, to which we connect several well-known pairwise losses.
Ranked #12 on Metric Learning on CARS196 (using extra training data)
no code implementations • 18 Mar 2020 • Abdur R Feyjie, Reza Azad, Marco Pedersoli, Claude Kauffman, Ismail Ben Ayed, Jose Dolz
To handle this new learning paradigm, we propose to include surrogate tasks that can leverage very powerful supervisory signals --derived from the data itself-- for semantic feature learning.
1 code implementation • 9 Mar 2020 • Reza Azad, Abdur R Fayjie, Claude Kauffman, Ismail Ben Ayed, Marco Pedersoli, Jose Dolz
Despite the initial belief that Convolutional Neural Networks (CNNs) are driven by shapes to perform visual recognition tasks, recent evidence suggests that texture bias in CNNs provides higher performing models when learning on large labeled training datasets.
Ranked #2 on Few-Shot Semantic Segmentation on Pascal5i
1 code implementation • 25 Nov 2019 • Soufiane Belharbi, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
We propose a new constrained-optimization formulation for deep ordinal classification, in which uni-modality of the label distribution is enforced implicitly via a set of inequality constraints over all the pairs of adjacent labels.
Ranked #1 on Historical Color Image Dating on HCI (MAE metric)
no code implementations • 25 Sep 2019 • Ruobing Shen, Bo Tang, Ismail Ben Ayed, Andrea Lodi, Thomas Guthier
Large-scale ground truth data sets are of crucial importance for deep learning based segmentation models, but annotating per-pixel masks is prohibitively time consuming.
no code implementations • ICLR Workshop LLD 2019 • Saypraseuth Mounsaveng, David Vazquez, Ismail Ben Ayed, Marco Pedersoli
Data augmentation (DA) is fundamental against overfitting in large convolutional neural networks, especially with a limited training dataset.
1 code implementation • 8 Sep 2019 • Jérôme Rony, Soufiane Belharbi, Jose Dolz, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
Four key challenges are identified for the application of deep WSOL methods in histology -- under/over activation of CAMs, sensitivity to thresholding, and model selection.
no code implementations • 15 Aug 2019 • Jizong Peng, Hoel Kervadec, Jose Dolz, Ismail Ben Ayed, Marco Pedersoli, Christian Desrosiers
An efficient strategy for weakly-supervised segmentation is to impose constraints or regularization priors on target regions.
1 code implementation • arXiv preprint 2019 • Sajjad Abdoli, Luiz G. Hafemann, Jerome Rony, Ismail Ben Ayed, Patrick Cardinal, Alessandro L. Koerich
We demonstrate the existence of universal adversarial perturbations, which can fool a family of audio classification architectures, for both targeted and untargeted attack scenarios.
1 code implementation • 8 Aug 2019 • Mathilde Bateson, Jose Dolz, Hoel Kervadec, Hervé Lombaert, Ismail Ben Ayed
We propose to adapt segmentation networks with a constrained formulation, which embeds domain-invariant prior knowledge about the segmentation regions.
1 code implementation • 25 Jul 2019 • Soufiane Belharbi, Jérôme Rony, Jose Dolz, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
Pointwise localization allows more precise localization and accurate interpretability, compared to bounding box, in applications where objects are highly unstructured such as in medical domain.
no code implementations • 4 Jul 2019 • Hugo Masson, Amran Bhuiyan, Le Thanh Nguyen-Meidine, Mehrsan Javan, Parthipan Siva, Ismail Ben Ayed, Eric Granger
Then, these techniques are analysed according to their pruningcriteria and strategy, and according to different scenarios for exploiting pruningmethods to fine-tuning networks to target domains.
1 code implementation • 19 Jun 2019 • Imtiaz Masud Ziko, Eric Granger, Jing Yuan, Ismail Ben Ayed
We derive a general tight upper bound based on a concave-convex decomposition of our fairness term, its Lipschitz-gradient property and the Pinsker's inequality.
1 code implementation • 10 Apr 2019 • Hoel Kervadec, Jose Dolz, Eric Granger, Ismail Ben Ayed
This study investigates a curriculum-style strategy for semi-supervised CNN segmentation, which devises a regression network to learn image-level information such as the size of a target region.
1 code implementation • 8 Apr 2019 • Hoel Kervadec, Jose Dolz, Jing Yuan, Christian Desrosiers, Eric Granger, Ismail Ben Ayed
While sub-optimality is not guaranteed for non-convex problems, this result shows that log-barrier extensions are a principled way to approximate Lagrangian optimization for constrained CNNs via implicit dual variables.
no code implementations • MIDL 2019 • Georg Pichler, Jose Dolz, Ismail Ben Ayed, Pablo Piantanida
We juxtapose our approach to state-of-the-art segmentation adaptation via adversarial training in the network-output space.
5 code implementations • 17 Dec 2018 • Hoel Kervadec, Jihene Bouchtiba, Christian Desrosiers, Eric Granger, Jose Dolz, Ismail Ben Ayed
We propose a boundary loss, which takes the form of a distance metric on the space of contours, not regions.
Brain Lesion Segmentation From Mri Ischemic Stroke Lesion Segmentation +4
5 code implementations • 23 Nov 2018 • Jérôme Rony, Luiz G. Hafemann, Luiz S. Oliveira, Ismail Ben Ayed, Robert Sabourin, Eric Granger
Research on adversarial examples in computer vision tasks has shown that small, often imperceptible changes to an image can induce misclassification, which has security implications for a wide range of image processing systems.
1 code implementation • 19 Nov 2018 • Jose Dolz, Christian Desrosiers, Ismail Ben Ayed
Despite the technological advances in medical imaging, IVD localization and segmentation are still manually performed, which is time-consuming and prone to errors.
1 code implementation • NeurIPS 2018 • Imtiaz Masud Ziko, Eric Granger, Ismail Ben Ayed
Furthermore, we show that the density modes can be obtained as byproducts of the assignment variables via simple maximum-value operations whose additional computational cost is linear in the number of data points.
no code implementations • 16 Oct 2018 • Jose Dolz, Ismail Ben Ayed, Christian Desrosiers
First, instead of combining the available image modalities at the input, each of them is processed in a different path to better exploit their unique information.
1 code implementation • 9 Oct 2018 • Mohammed Jabi, Marco Pedersoli, Amar Mitiche, Ismail Ben Ayed
Typically, they use multinomial logistic regression posteriors and parameter regularization, as is very common in supervised learning.
Ranked #2 on Image Clustering on YouTube Faces DB
1 code implementation • CVPR 2019 • Dmitrii Marin, Meng Tang, Ismail Ben Ayed, Yuri Boykov
Both loss functions and architectures are often explicitly tuned to be amenable to this basic local optimization.
no code implementations • 28 May 2018 • Jose Dolz, Xiaopan Xu, Jerome Rony, Jing Yuan, Yang Liu, Eric Granger, Christian Desrosiers, Xi Zhang, Ismail Ben Ayed, Hongbing Lu
Precise segmentation of bladder walls and tumor regions is an essential step towards non-invasive identification of tumor stage and grade, which is critical for treatment decision and prognosis of patients with bladder cancer (BC).
4 code implementations • 12 May 2018 • Hoel Kervadec, Jose Dolz, Meng Tang, Eric Granger, Yuri Boykov, Ismail Ben Ayed
To the best of our knowledge, the method of [Pathak et al., 2015] is the only prior work that addresses deep CNNs with linear constraints in weakly supervised segmentation.
3 code implementations • 9 Apr 2018 • Jose Dolz, Karthik Gopinath, Jing Yuan, Herve Lombaert, Christian Desrosiers, Ismail Ben Ayed
Therefore, the proposed network has total freedom to learn more complex combinations between the modalities, within and in-between all the levels of abstraction, which increases significantly the learning representation.
Ranked #1 on Medical Image Segmentation on iSEG 2017 Challenge
no code implementations • ECCV 2018 • Meng Tang, Federico Perazzi, Abdelaziz Djelouah, Ismail Ben Ayed, Christopher Schroers, Yuri Boykov
This approach simplifies weakly-supervised training by avoiding extra MRF/CRF inference steps or layers explicitly generating full masks, while improving both the quality and efficiency of training.
no code implementations • 16 Dec 2017 • Ruobing Shen, Eric Kendinibilir, Ismail Ben Ayed, Andrea Lodi, Andrea Tramontani, Gerhard Reinelt
The method enforces connectivity priors iteratively by a cutting plane method, and provides feasible solutions with a guarantee on sub-optimality even if we terminate it earlier.
1 code implementation • 14 Dec 2017 • Jose Dolz, Christian Desrosiers, Li Wang, Jing Yuan, Dinggang Shen, Ismail Ben Ayed
We report evaluations of our method on the public data of the MICCAI iSEG-2017 Challenge on 6-month infant brain MRI segmentation, and show very competitive results among 21 teams, ranking first or second in most metrics.
Ranked #1 on Infant Brain Mri Segmentation on iSEG 2017 Challenge
1 code implementation • 16 Oct 2017 • Jose Dolz, Ismail Ben Ayed, Jing Yuan, Christian Desrosiers
Neonatal brain segmentation in magnetic resonance (MR) is a challenging problem due to poor image quality and low contrast between white and gray matter regions.
no code implementations • 16 May 2017 • Dmitrii Marin, Meng Tang, Ismail Ben Ayed, Yuri Boykov
We call it Breiman's bias due to its similarity to the histogram mode isolation previously discovered by Breiman in decision tree learning with Gini impurity.
1 code implementation • 28 Apr 2017 • Jose Dolz, Ismail Ben Ayed, Christian Desrosiers
We propose to constrain segmentation functionals with a dimensionless, unbiased and position-independent shape compactness prior, which we solve efficiently with an alternating direction method of multipliers (ADMM).
no code implementations • 21 Apr 2017 • Tobias Fechter, Sonja Adebahr, Dimos Baltas, Ismail Ben Ayed, Christian Desrosiers, Jose Dolz
These figures translate into a very good agreement with the reference contours and an increase in accuracy compared to other methods.
no code implementations • CVPR 2017 • Jose Dolz, Ismail Ben Ayed, Christian Desrosiers
We formulate an Alternating Direction Method of Mul-tipliers (ADMM) that systematically distributes the computations of any technique for optimizing pairwise functions, including non-submodular potentials.
no code implementations • ICCV 2015 • Meng Tang, Ismail Ben Ayed, Dmitrii Marin, Yuri Boykov
Our bound formulation for kernel K-means allows to combine general pair-wise feature clustering methods with image grid regularization using graph cuts, similarly to standard color model fitting techniques for segmentation.
no code implementations • 24 Jun 2015 • Meng Tang, Dmitrii Marin, Ismail Ben Ayed, Yuri Boykov
We propose a new segmentation model combining common regularization energies, e. g. Markov Random Field (MRF) potentials, and standard pairwise clustering criteria like Normalized Cut (NC), average association (AA), etc.
no code implementations • ICCV 2015 • Yuri Boykov, Hossam Isack, Carl Olsson, Ismail Ben Ayed
Many standard optimization methods for segmentation and reconstruction compute ML model estimates for appearance or geometry of segments, e. g. Zhu-Yuille 1996, Torr 1998, Chan-Vese 2001, GrabCut 2004, Delong et al. 2012.
no code implementations • CVPR 2014 • Lena Gorelick, Yuri Boykov, Olga Veksler, Ismail Ben Ayed, Andrew Delong
We propose a general optimization framework based on local submodular approximations (LSA).
no code implementations • 8 Nov 2013 • Lena Gorelick, Yuri Boykov, Olga Veksler, Ismail Ben Ayed, Andrew Delong
We propose a general optimization framework based on local submodular approximations (LSA).
no code implementations • CVPR 2013 • Ismail Ben Ayed, Lena Gorelick, Yuri Boykov
From these general-form bounds, we state various non-linear problems as the optimization of auxiliary functionals by graph cuts.