1 code implementation • 12 May 2022 • Soufiane Belharbi, Jérôme Rony, Jose Dolz, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
Our method is composed of two networks: a localizer that yields segmentation mask, followed by a classifier.
1 code implementation • NeurIPS 2021 • Olivier Veilleux, Malik Boudiaf, Pablo Piantanida, Ismail Ben Ayed
Transductive inference is widely used in few-shot learning, as it leverages the statistics of the unlabeled query set of a few-shot task, typically yielding substantially better performances than its inductive counterpart.
1 code implementation • 15 Jan 2022 • Malik Boudiaf, Romain Mueller, Ismail Ben Ayed, Luca Bertinetto
An interesting and practical paradigm is online test-time adaptation, according to which training data is inaccessible, no labelled data from the test distribution is available, and adaptation can only happen at test time and on a handful of samples.
1 code implementation • 7 Jan 2022 • Soufiane Belharbi, Marco Pedersoli, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
The CNN is exploited to collect both positive and negative evidence at the pixel level to train the decoder.
1 code implementation • 30 Nov 2021 • Bingyuan Liu, Ismail Ben Ayed, Adrian Galdran, Jose Dolz
Following our observations, we propose a simple and flexible generalization based on inequality constraints, which imposes a controllable margin on logit distances.
1 code implementation • 21 Sep 2021 • Bingyuan Liu, Christian Desrosiers, Ismail Ben Ayed, Jose Dolz
In this work, we propose a dual-branch architecture, where the upper branch (teacher) receives strong annotations, while the bottom one (student) is driven by limited supervision and guided by the upper branch.
1 code implementation • 15 Sep 2021 • Soufiane Belharbi, Aydin Sarraf, Marco Pedersoli, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
Interpolation is required to restore full size CAMs, yet it does not consider the statistical properties of objects, such as color and texture, leading to activations with inconsistent boundaries, and inaccurate localizations.
1 code implementation • 6 Aug 2021 • Mathilde Bateson, Jose Dolz, Hoel Kervadec, Hervé Lombaert, Ismail Ben Ayed
Our method yields comparable results to several state of the art adaptation techniques, despite having access to much less information, as the source images are entirely absent in our adaptation phase.
2 code implementations • 23 Jun 2021 • Malik Boudiaf, Ziko Imtiaz Masud, Jérôme Rony, Jose Dolz, Ismail Ben Ayed, Pablo Piantanida
We motivate our transductive loss by deriving a formal relation between the classification accuracy and mutual-information maximization.
1 code implementation • 16 Jun 2021 • Imtiaz Masud Ziko, Malik Boudiaf, Jose Dolz, Eric Granger, Ismail Ben Ayed
Surprisingly, we found that even standard clustering procedures (e. g., K-means), which correspond to particular, non-regularized cases of our general model, already achieve competitive performances in comparison to the state-of-the-art in few-shot learning.
1 code implementation • 12 Jun 2021 • Marine Picot, Francisco Messina, Malik Boudiaf, Fabrice Labeau, Ismail Ben Ayed, Pablo Piantanida
Adversarial robustness has become a topic of growing interest in machine learning since it was observed that neural networks tend to be brittle.
1 code implementation • 3 May 2021 • Hoel Kervadec, Houda Bahig, Laurent Letourneau-Guillon, Jose Dolz, Ismail Ben Ayed
We also found that shape descriptors can be a valid way to encode anatomical priors about the task, enabling to leverage expert knowledge without additional annotations.
1 code implementation • 18 Apr 2021 • Bingyuan Liu, Jose Dolz, Adrian Galdran, Riadh Kobbi, Ismail Ben Ayed
In the abundant segmentation literature, there is no clear consensus as to which of these losses is a better choice, with varying performances for each across different benchmarks and applications.
1 code implementation • 15 Dec 2020 • Jose Dolz, Christian Desrosiers, Ismail Ben Ayed
In conjunction with a standard cross-entropy over the labeled pixels, our novel formulation integrates two important terms: (i) a Shannon entropy loss defined over the less-supervised images, which encourages confident student predictions at the bottom branch; and (ii) a Kullback-Leibler (KL) divergence, which transfers the knowledge from the predictions generated by the strongly supervised branch to the less-supervised branch, and guides the entropy (student-confidence) term to avoid trivial solutions.
2 code implementations • CVPR 2021 • Malik Boudiaf, Hoel Kervadec, Ziko Imtiaz Masud, Pablo Piantanida, Ismail Ben Ayed, Jose Dolz
We show that the way inference is performed in few-shot segmentation tasks has a substantial effect on performances -- an aspect often overlooked in the literature in favor of the meta-learning paradigm.
1 code implementation • 9 Dec 2020 • Shanshan Wang, Cheng Li, Rongpin Wang, Zaiyi Liu, Meiyun Wang, Hongna Tan, Yaping Wu, Xinfeng Liu, Hui Sun, Rui Yang, Xin Liu, Jie Chen, Huihui Zhou, Ismail Ben Ayed, Hairong Zheng
Automatic medical image segmentation plays a critical role in scientific research and medical care.
1 code implementation • NeurIPS 2020 • Malik Boudiaf, Imtiaz Ziko, Jérôme Rony, Jose Dolz, Pablo Piantanida, Ismail Ben Ayed
We introduce Transductive Infomation Maximization (TIM) for few-shot learning.
2 code implementations • ICCV 2021 • Jérôme Rony, Eric Granger, Marco Pedersoli, Ismail Ben Ayed
Our attack enjoys the generality of penalty methods and the computational efficiency of distance-customized algorithms, and can be readily used for a wide set of distances.
2 code implementations • 14 Nov 2020 • Soufiane Belharbi, Jérôme Rony, Jose Dolz, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
We propose novel regularization terms, which enable the model to seek both non-discriminative and discriminative regions, while discouraging unbalanced segmentations.
1 code implementation • 10 Oct 2020 • Soufiane Belharbi, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
CNN visualization and interpretation methods, like class-activation maps (CAMs), are typically used to highlight the image regions linked to class predictions.
1 code implementation • 1 Oct 2020 • Adrian Galdran, José Dolz, Hadi Chakor, Hervé Lombaert, Ismail Ben Ayed
Assessing the degree of disease severity in biomedical images is a task similar to standard classification but constrained by an underlying structure in the label space.
1 code implementation • 3 Sep 2020 • Adrian Galdran, André Anjos, José Dolz, Hadi Chakor, Hervé Lombaert, Ismail Ben Ayed
Our analysis demonstrates that the retinal vessel segmentation problem is far from solved when considering test images that differ substantially from the training data, and that this task represents an ideal scenario for the exploration of domain adaptation techniques.
1 code implementation • 25 Aug 2020 • Malik Boudiaf, Ziko Imtiaz Masud, Jérôme Rony, José Dolz, Pablo Piantanida, Ismail Ben Ayed
We introduce Transductive Infomation Maximization (TIM) for few-shot learning.
no code implementations • 9 Aug 2020 • Madhu Kiran, Amran Bhuiyan, Louis-Antoine Blais-Morin, Mehrsan Javan, Ismail Ben Ayed, Eric Granger
Our Mutual Attention network relies on the joint spatial attention between image and optical flow features maps to activate a common set of salient features across them.
Optical Flow Estimation
Video-Based Person Re-Identification
no code implementations • 29 Jun 2020 • Tal Arbel, Ismail Ben Ayed, Marleen de Bruijne, Maxime Descoteaux, Herve Lombaert, Chris Pal
This compendium gathers all the accepted extended abstracts from the Third International Conference on Medical Imaging with Deep Learning (MIDL 2020), held in Montreal, Canada, 6-9 July 2020.
1 code implementation • 28 Jun 2020 • Imtiaz Masud Ziko, Jose Dolz, Eric Granger, Ismail Ben Ayed
Our transductive inference does not re-train the base model, and can be viewed as a graph clustering of the query set, subject to supervision constraints from the support set.
2 code implementations • 25 Jun 2020 • Saypraseuth Mounsaveng, Issam Laradji, Ismail Ben Ayed, David Vazquez, Marco Pedersoli
Data augmentation is a key practice in machine learning for improving generalization performance.
3 code implementations • 7 May 2020 • Mathilde Bateson, Hoel Kervadec, Jose Dolz, Herve Lombaert, Ismail Ben Ayed
Our formulation is based on minimizing a label-free entropy loss defined over target-domain data, which we further guide with a domain invariant prior on the segmentation regions.
1 code implementation • MIDL 2019 • Hoel Kervadec, Jose Dolz, Shan-Shan Wang, Eric Granger, Ismail Ben Ayed
Particularly, we leverage a classical tightness prior to a deep learning setting via imposing a set of constraints on the network outputs.
1 code implementation • ECCV 2020 • Malik Boudiaf, Jérôme Rony, Imtiaz Masud Ziko, Eric Granger, Marco Pedersoli, Pablo Piantanida, Ismail Ben Ayed
Second, we show that, more generally, minimizing the cross-entropy is actually equivalent to maximizing the mutual information, to which we connect several well-known pairwise losses.
Ranked #7 on
Metric Learning
on In-Shop
(using extra training data)
no code implementations • 18 Mar 2020 • Abdur R Feyjie, Reza Azad, Marco Pedersoli, Claude Kauffman, Ismail Ben Ayed, Jose Dolz
To handle this new learning paradigm, we propose to include surrogate tasks that can leverage very powerful supervisory signals --derived from the data itself-- for semantic feature learning.
1 code implementation • 9 Mar 2020 • Reza Azad, Abdur R Fayjie, Claude Kauffman, Ismail Ben Ayed, Marco Pedersoli, Jose Dolz
Despite the initial belief that Convolutional Neural Networks (CNNs) are driven by shapes to perform visual recognition tasks, recent evidence suggests that texture bias in CNNs provides higher performing models when learning on large labeled training datasets.
Ranked #2 on
Few-Shot Semantic Segmentation
on Pascal5i
1 code implementation • 25 Nov 2019 • Soufiane Belharbi, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
We propose a new constrained-optimization formulation for deep ordinal classification, in which uni-modality of the label distribution is enforced implicitly via a set of inequality constraints over all the pairs of adjacent labels.
Ranked #1 on
Historical Color Image Dating
on HCI
no code implementations • 25 Sep 2019 • Ruobing Shen, Bo Tang, Ismail Ben Ayed, Andrea Lodi, Thomas Guthier
Large-scale ground truth data sets are of crucial importance for deep learning based segmentation models, but annotating per-pixel masks is prohibitively time consuming.
no code implementations • ICLR Workshop LLD 2019 • Saypraseuth Mounsaveng, David Vazquez, Ismail Ben Ayed, Marco Pedersoli
Data augmentation (DA) is fundamental against overfitting in large convolutional neural networks, especially with a limited training dataset.
1 code implementation • 8 Sep 2019 • Jérôme Rony, Soufiane Belharbi, Jose Dolz, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
Four key challenges are identified for the application of deep WSOL methods in histology -- under/over activation of CAMs, sensitivity to thresholding, and model selection.
no code implementations • 15 Aug 2019 • Jizong Peng, Hoel Kervadec, Jose Dolz, Ismail Ben Ayed, Marco Pedersoli, Christian Desrosiers
An efficient strategy for weakly-supervised segmentation is to impose constraints or regularization priors on target regions.
1 code implementation • arXiv preprint 2019 • Sajjad Abdoli, Luiz G. Hafemann, Jerome Rony, Ismail Ben Ayed, Patrick Cardinal, Alessandro L. Koerich
We demonstrate the existence of universal adversarial perturbations, which can fool a family of audio classification architectures, for both targeted and untargeted attack scenarios.
1 code implementation • 8 Aug 2019 • Mathilde Bateson, Jose Dolz, Hoel Kervadec, Hervé Lombaert, Ismail Ben Ayed
We propose to adapt segmentation networks with a constrained formulation, which embeds domain-invariant prior knowledge about the segmentation regions.
1 code implementation • 25 Jul 2019 • Soufiane Belharbi, Jérôme Rony, Jose Dolz, Ismail Ben Ayed, Luke McCaffrey, Eric Granger
Pointwise localization allows more precise localization and accurate interpretability, compared to bounding box, in applications where objects are highly unstructured such as in medical domain.
no code implementations • 4 Jul 2019 • Hugo Masson, Amran Bhuiyan, Le Thanh Nguyen-Meidine, Mehrsan Javan, Parthipan Siva, Ismail Ben Ayed, Eric Granger
Then, these techniques are analysed according to their pruningcriteria and strategy, and according to different scenarios for exploiting pruningmethods to fine-tuning networks to target domains.
1 code implementation • 19 Jun 2019 • Imtiaz Masud Ziko, Eric Granger, Jing Yuan, Ismail Ben Ayed
We derive a general tight upper bound based on a concave-convex decomposition of our fairness term, its Lipschitz-gradient property and the Pinsker's inequality.
1 code implementation • 10 Apr 2019 • Hoel Kervadec, Jose Dolz, Eric Granger, Ismail Ben Ayed
This study investigates a curriculum-style strategy for semi-supervised CNN segmentation, which devises a regression network to learn image-level information such as the size of a target region.
Left Ventricle Segmentation
Semi-Supervised Semantic Segmentation
1 code implementation • 8 Apr 2019 • Hoel Kervadec, Jose Dolz, Jing Yuan, Christian Desrosiers, Eric Granger, Ismail Ben Ayed
While sub-optimality is not guaranteed for non-convex problems, this result shows that log-barrier extensions are a principled way to approximate Lagrangian optimization for constrained CNNs via implicit dual variables.
no code implementations • MIDL 2019 • Georg Pichler, Jose Dolz, Ismail Ben Ayed, Pablo Piantanida
We juxtapose our approach to state-of-the-art segmentation adaptation via adversarial training in the network-output space.
5 code implementations • 17 Dec 2018 • Hoel Kervadec, Jihene Bouchtiba, Christian Desrosiers, Eric Granger, Jose Dolz, Ismail Ben Ayed
We propose a boundary loss, which takes the form of a distance metric on the space of contours, not regions.
Brain Lesion Segmentation From Mri
Ischemic Stroke Lesion Segmentation
+3
3 code implementations • 23 Nov 2018 • Jérôme Rony, Luiz G. Hafemann, Luiz S. Oliveira, Ismail Ben Ayed, Robert Sabourin, Eric Granger
Research on adversarial examples in computer vision tasks has shown that small, often imperceptible changes to an image can induce misclassification, which has security implications for a wide range of image processing systems.
1 code implementation • 19 Nov 2018 • Jose Dolz, Christian Desrosiers, Ismail Ben Ayed
Despite the technological advances in medical imaging, IVD localization and segmentation are still manually performed, which is time-consuming and prone to errors.
1 code implementation • NeurIPS 2018 • Imtiaz Masud Ziko, Eric Granger, Ismail Ben Ayed
Furthermore, we show that the density modes can be obtained as byproducts of the assignment variables via simple maximum-value operations whose additional computational cost is linear in the number of data points.
no code implementations • 16 Oct 2018 • Jose Dolz, Ismail Ben Ayed, Christian Desrosiers
First, instead of combining the available image modalities at the input, each of them is processed in a different path to better exploit their unique information.
1 code implementation • 9 Oct 2018 • Mohammed Jabi, Marco Pedersoli, Amar Mitiche, Ismail Ben Ayed
Typically, they use multinomial logistic regression posteriors and parameter regularization, as is very common in supervised learning.
Ranked #2 on
Image Clustering
on YouTube Faces DB
1 code implementation • CVPR 2019 • Dmitrii Marin, Meng Tang, Ismail Ben Ayed, Yuri Boykov
Both loss functions and architectures are often explicitly tuned to be amenable to this basic local optimization.
no code implementations • 28 May 2018 • Jose Dolz, Xiaopan Xu, Jerome Rony, Jing Yuan, Yang Liu, Eric Granger, Christian Desrosiers, Xi Zhang, Ismail Ben Ayed, Hongbing Lu
Precise segmentation of bladder walls and tumor regions is an essential step towards non-invasive identification of tumor stage and grade, which is critical for treatment decision and prognosis of patients with bladder cancer (BC).
4 code implementations • 12 May 2018 • Hoel Kervadec, Jose Dolz, Meng Tang, Eric Granger, Yuri Boykov, Ismail Ben Ayed
To the best of our knowledge, the method of [Pathak et al., 2015] is the only prior work that addresses deep CNNs with linear constraints in weakly supervised segmentation.
Medical Image Segmentation
Weakly supervised segmentation
+1
3 code implementations • 9 Apr 2018 • Jose Dolz, Karthik Gopinath, Jing Yuan, Herve Lombaert, Christian Desrosiers, Ismail Ben Ayed
Therefore, the proposed network has total freedom to learn more complex combinations between the modalities, within and in-between all the levels of abstraction, which increases significantly the learning representation.
Ranked #1 on
Medical Image Segmentation
on iSEG 2017 Challenge
no code implementations • ECCV 2018 • Meng Tang, Federico Perazzi, Abdelaziz Djelouah, Ismail Ben Ayed, Christopher Schroers, Yuri Boykov
This approach simplifies weakly-supervised training by avoiding extra MRF/CRF inference steps or layers explicitly generating full masks, while improving both the quality and efficiency of training.
no code implementations • 16 Dec 2017 • Ruobing Shen, Eric Kendinibilir, Ismail Ben Ayed, Andrea Lodi, Andrea Tramontani, Gerhard Reinelt
The method enforces connectivity priors iteratively by a cutting plane method, and provides feasible solutions with a guarantee on sub-optimality even if we terminate it earlier.
1 code implementation • 14 Dec 2017 • Jose Dolz, Christian Desrosiers, Li Wang, Jing Yuan, Dinggang Shen, Ismail Ben Ayed
We report evaluations of our method on the public data of the MICCAI iSEG-2017 Challenge on 6-month infant brain MRI segmentation, and show very competitive results among 21 teams, ranking first or second in most metrics.
Ranked #1 on
Infant Brain Mri Segmentation
on iSEG 2017 Challenge
1 code implementation • 16 Oct 2017 • Jose Dolz, Ismail Ben Ayed, Jing Yuan, Christian Desrosiers
Neonatal brain segmentation in magnetic resonance (MR) is a challenging problem due to poor image quality and low contrast between white and gray matter regions.
no code implementations • 16 May 2017 • Dmitrii Marin, Meng Tang, Ismail Ben Ayed, Yuri Boykov
We call it Breiman's bias due to its similarity to the histogram mode isolation previously discovered by Breiman in decision tree learning with Gini impurity.
1 code implementation • 28 Apr 2017 • Jose Dolz, Ismail Ben Ayed, Christian Desrosiers
We propose to constrain segmentation functionals with a dimensionless, unbiased and position-independent shape compactness prior, which we solve efficiently with an alternating direction method of multipliers (ADMM).
no code implementations • 21 Apr 2017 • Tobias Fechter, Sonja Adebahr, Dimos Baltas, Ismail Ben Ayed, Christian Desrosiers, Jose Dolz
These figures translate into a very good agreement with the reference contours and an increase in accuracy compared to other methods.
no code implementations • CVPR 2017 • Jose Dolz, Ismail Ben Ayed, Christian Desrosiers
We formulate an Alternating Direction Method of Mul-tipliers (ADMM) that systematically distributes the computations of any technique for optimizing pairwise functions, including non-submodular potentials.
no code implementations • ICCV 2015 • Meng Tang, Ismail Ben Ayed, Dmitrii Marin, Yuri Boykov
Our bound formulation for kernel K-means allows to combine general pair-wise feature clustering methods with image grid regularization using graph cuts, similarly to standard color model fitting techniques for segmentation.
no code implementations • 24 Jun 2015 • Meng Tang, Dmitrii Marin, Ismail Ben Ayed, Yuri Boykov
We propose a new segmentation model combining common regularization energies, e. g. Markov Random Field (MRF) potentials, and standard pairwise clustering criteria like Normalized Cut (NC), average association (AA), etc.
no code implementations • ICCV 2015 • Yuri Boykov, Hossam Isack, Carl Olsson, Ismail Ben Ayed
Many standard optimization methods for segmentation and reconstruction compute ML model estimates for appearance or geometry of segments, e. g. Zhu-Yuille 1996, Torr 1998, Chan-Vese 2001, GrabCut 2004, Delong et al. 2012.
no code implementations • CVPR 2014 • Lena Gorelick, Yuri Boykov, Olga Veksler, Ismail Ben Ayed, Andrew Delong
We propose a general optimization framework based on local submodular approximations (LSA).
no code implementations • 8 Nov 2013 • Lena Gorelick, Yuri Boykov, Olga Veksler, Ismail Ben Ayed, Andrew Delong
We propose a general optimization framework based on local submodular approximations (LSA).
no code implementations • CVPR 2013 • Ismail Ben Ayed, Lena Gorelick, Yuri Boykov
From these general-form bounds, we state various non-linear problems as the optimization of auxiliary functionals by graph cuts.