Search Results for author: Gustavo Carneiro

Found 110 papers, 51 papers with code

Frequency Attention for Knowledge Distillation

1 code implementation9 Mar 2024 Cuong Pham, Van-Anh Nguyen, Trung Le, Dinh Phung, Gustavo Carneiro, Thanh-Toan Do

Inspired by the benefits of the frequency domain, we propose a novel module that functions as an attention mechanism in the frequency domain.

Image Classification Knowledge Distillation +3

Mixture of Gaussian-distributed Prototypes with Generative Modelling for Interpretable Image Classification

no code implementations30 Nov 2023 Chong Wang, Yuanhong Chen, Fengbei Liu, Davis James McCarthy, Helen Frazer, Gustavo Carneiro

Such an approach enables the learning of more powerful prototype representations since each learned prototype will own a measure of variability, which naturally reduces the sparsity given the spread of the distribution around each prototype, and we also integrate a prototype diversity objective function into the GMM optimisation to reduce redundancy.

Decision Making Image Classification

Learning to Complement with Multiple Humans (LECOMH): Integrating Multi-rater and Noisy-Label Learning into Human-AI Collaboration

no code implementations22 Nov 2023 Zheng Zhang, Kevin Wells, Gustavo Carneiro

The advent of learning with noisy labels (LNL), multi-rater learning, and human-AI collaboration has revolutionised the development of robust classifiers, enabling them to address the challenges posed by different types of data imperfections and complex decision processes commonly encountered in real-world applications.

Learning with noisy labels

Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality

no code implementations2 Oct 2023 Hu Wang, Yuanhong Chen, Congbo Ma, Jodie Avery, Louise Hull, Gustavo Carneiro

Then, cross-modal knowledge distillation is performed between teacher and student modalities for each task to push the model parameters to a point that is beneficial for all tasks.

Knowledge Distillation

SelectNAdapt: Support Set Selection for Few-Shot Domain Adaptation

1 code implementation9 Aug 2023 Youssef Dawoud, Gustavo Carneiro, Vasileios Belagiannis

Few-shot domain adaptation mitigates this issue by adapting deep neural networks pre-trained on the source domain to the target domain using a randomly selected and annotated support set from the target domain.

Clustering Domain Adaptation

Partial Label Supervision for Agnostic Generative Noisy Label Learning

1 code implementation2 Aug 2023 Fengbei Liu, Chong Wang, Yuanhong Chen, Yuyuan Liu, Gustavo Carneiro

Second, we introduce a new Partial Label Supervision (PLS) for noisy label learning that accounts for both clean label coverage and uncertainty.

Image Generation Learning with noisy labels +1

Multi-modal Learning with Missing Modality via Shared-Specific Feature Modelling

no code implementations CVPR 2023 Hu Wang, Yuanhong Chen, Congbo Ma, Jodie Avery, Louise Hull, Gustavo Carneiro

This is achieved from a strategy that relies on auxiliary tasks based on distribution alignment and domain classification, in addition to a residual feature fusion procedure.

Classification domain classification +4

Distilling Missing Modality Knowledge from Ultrasound for Endometriosis Diagnosis with Magnetic Resonance Images

no code implementations5 Jul 2023 Yuan Zhang, Hu Wang, David Butler, Minh-Son To, Jodie Avery, M Louise Hull, Gustavo Carneiro

Next, we distill the knowledge from the teacher TVUS POD obliteration detector to train the student MRI model by minimizing a regression loss that approximates the output of the student to the teacher using unpaired TVUS and MRI data.

Knowledge Distillation

Noisy-label Learning with Sample Selection based on Noise Rate Estimate

no code implementations31 May 2023 Arpit Garg, Cuong Nguyen, Rafael Felix, Thanh-Toan Do, Gustavo Carneiro

Even though the estimated noise rate from the training set appears to be a natural signal to be used in the definition of this curriculum, previous approaches generally rely on arbitrary thresholds or pre-defined selection functions to the best of our knowledge.

PASS: Peer-Agreement based Sample Selection for training with Noisy Labels

no code implementations20 Mar 2023 Arpit Garg, Cuong Nguyen, Rafael Felix, Thanh-Toan Do, Gustavo Carneiro

To address this limitation, we propose a novel peer-agreement based sample selection (PASS).

Multi-Head Multi-Loss Model Calibration

1 code implementation2 Mar 2023 Adrian Galdran, Johan Verjans, Gustavo Carneiro, Miguel A. González Ballester

Delivering meaningful uncertainty estimates is essential for a successful deployment of machine learning models in the clinical practice.

Image Classification Uncertainty Quantification

BRAIxDet: Learning to Detect Malignant Breast Lesion with Incomplete Annotations

no code implementations31 Jan 2023 Yuanhong Chen, Yuyuan Liu, Chong Wang, Michael Elliott, Chun Fung Kwok, Carlos Pena-Solorzano, Yu Tian, Fengbei Liu, Helen Frazer, Davis J. McCarthy, Gustavo Carneiro

Given the large size of such datasets, researchers usually face a dilemma with the weakly annotated subset: to not use it or to fully annotate it.

Lesion Detection

Learning Support and Trivial Prototypes for Interpretable Image Classification

1 code implementation ICCV 2023 Chong Wang, Yuyuan Liu, Yuanhong Chen, Fengbei Liu, Yu Tian, Davis J. McCarthy, Helen Frazer, Gustavo Carneiro

Prototypical part network (ProtoPNet) methods have been designed to achieve interpretable classification by associating predictions with a set of training prototypes, which we refer to as trivial prototypes because they are trained to lie far from the classification boundary in the feature space.

Explainable Artificial Intelligence (XAI) Image Classification +1

Task Weighting in Meta-learning with Trajectory Optimisation

no code implementations4 Jan 2023 Cuong Nguyen, Thanh-Toan Do, Gustavo Carneiro

Developing meta-learning algorithms that are un-biased toward a subset of training tasks often requires hand-designed criteria to weight tasks, potentially resulting in sub-optimal solutions.

Few-Shot Learning

Towards the Identifiability in Noisy Label Learning: A Multinomial Mixture Approach

no code implementations4 Jan 2023 Cuong Nguyen, Thanh-Toan Do, Gustavo Carneiro

To meet this requirement without relying on additional $2C - 2$ manual annotations per instance, we propose a method that automatically generates additional noisy labels by estimating the noisy label distribution based on nearest neighbours.

Asymmetric Co-teaching with Multi-view Consensus for Noisy Label Learning

no code implementations1 Jan 2023 Fengbei Liu, Yuanhong Chen, Chong Wang, Yu Tain, Gustavo Carneiro

Also, the new sample selection is based on multi-view consensus, which uses the label views from training labels and model predictions to divide the training set into clean and noisy for training the multi-class model and to re-label the training samples with multiple top-ranked labels for training the multi-label model.

Learning with noisy labels Multi-Label Learning

Knowing What to Label for Few Shot Microscopy Image Cell Segmentation

1 code implementation18 Nov 2022 Youssef Dawoud, Arij Bouazizi, Katharina Ernst, Gustavo Carneiro, Vasileios Belagiannis

In this paper, we argue that the random selection of unlabelled training target images to be annotated and included in the support set may not enable an effective fine-tuning process, so we propose a new approach to optimise this image selection process.

Cell Segmentation

Bootstrapping the Relationship Between Images and Their Clean and Noisy Labels

1 code implementation17 Oct 2022 Brandon Smart, Gustavo Carneiro

Many state-of-the-art noisy-label learning methods rely on learning mechanisms that estimate the samples' clean labels during training and discard their original noisy labels.

Learning with noisy labels

Knowledge Distillation to Ensemble Global and Interpretable Prototype-Based Mammogram Classification Models

no code implementations26 Sep 2022 Chong Wang, Yuanhong Chen, Yuyuan Liu, Yu Tian, Fengbei Liu, Davis J. McCarthy, Michael Elliott, Helen Frazer, Gustavo Carneiro

On the other hand, prototype-based models improve interpretability by associating predictions with training image prototypes, but they are less accurate than global models and their prototypes tend to have poor diversity.

Knowledge Distillation

Multi-view Local Co-occurrence and Global Consistency Learning Improve Mammogram Classification Generalisation

1 code implementation21 Sep 2022 Yuanhong Chen, Hu Wang, Chong Wang, Yu Tian, Fengbei Liu, Michael Elliott, Davis J. McCarthy, Helen Frazer, Gustavo Carneiro

When analysing screening mammograms, radiologists can naturally process information across two ipsilateral views of each breast, namely the cranio-caudal (CC) and mediolateral-oblique (MLO) views.

On the Optimal Combination of Cross-Entropy and Soft Dice Losses for Lesion Segmentation with Out-of-Distribution Robustness

1 code implementation13 Sep 2022 Adrian Galdran, Gustavo Carneiro, Miguel Ángel González Ballester

Our findings are surprising: CE-Dice loss combinations that excel in segmenting in-distribution images have a poor performance when dealing with OoD data, which leads us to recommend the adoption of the CE loss for this kind of problems, due to its robustness and ability to generalize to OoD samples.

Image Segmentation Lesion Segmentation +2

Instance-Dependent Noisy Label Learning via Graphical Modelling

1 code implementation2 Sep 2022 Arpit Garg, Cuong Nguyen, Rafael Felix, Thanh-Toan Do, Gustavo Carneiro

Noisy labels are unavoidable yet troublesome in the ecosystem of deep learning because models can easily overfit them.

Learning with noisy labels

An Evolutionary Approach for Creating of Diverse Classifier Ensembles

no code implementations23 Aug 2022 Alvaro R. Ferreira Jr, Fabio A. Faria, Gustavo Carneiro, Vinicius V. de Melo

We address this point by proposing a framework for classifier selection and fusion based on a four-step protocol called CIF-E (Classifiers, Initialization, Fitness function, and Evolutionary algorithm).

Classification

Maximising the Utility of Validation Sets for Imbalanced Noisy-label Meta-learning

no code implementations17 Aug 2022 Dung Anh Hoang, Cuong Nguyen, Belagiannis Vasileios, Gustavo Carneiro

In this paper, we analyse the meta-learning algorithm and propose new criteria to characterise the utility of the validation set, based on: 1) the informativeness of the validation set; 2) the class distribution balance of the set; and 3) the correctness of the labels of the set.

Informativeness Meta-Learning

Edge-Based Self-Supervision for Semi-Supervised Few-Shot Microscopy Image Cell Segmentation

no code implementations3 Aug 2022 Youssef Dawoud, Katharina Ernst, Gustavo Carneiro, Vasileios Belagiannis

Deep neural networks currently deliver promising results for microscopy image cell segmentation, but they require large-scale labelled databases, which is a costly and time-consuming process.

Cell Segmentation Segmentation

Censor-aware Semi-supervised Learning for Survival Time Prediction from Medical Images

1 code implementation26 May 2022 Renato Hermoza, Gabriel Maicas, Jacinto C. Nascimento, Gustavo Carneiro

In this work, we propose a new training method that predicts survival time using all censored and uncensored data.

Survival Prediction

Mixup-based Deep Metric Learning Approaches for Incomplete Supervision

no code implementations28 Apr 2022 Luiz H. Buris, Daniel C. G. Pedronette, Joao P. Papa, Jurandy Almeida, Gustavo Carneiro, Fabio A. Faria

Deep learning architectures have achieved promising results in different areas (e. g., medicine, agriculture, and security).

Memorization Metric Learning

Translation Consistent Semi-supervised Segmentation for 3D Medical Images

1 code implementation28 Mar 2022 Yuyuan Liu, Yu Tian, Chong Wang, Yuanhong Chen, Fengbei Liu, Vasileios Belagiannis, Gustavo Carneiro

The most successful SSL approaches are based on consistency learning that minimises the distance between model responses obtained from perturbed views of the unlabelled data.

Brain Tumor Segmentation Image Segmentation +5

Contrastive Transformer-based Multiple Instance Learning for Weakly Supervised Polyp Frame Detection

1 code implementation23 Mar 2022 Yu Tian, Guansong Pang, Fengbei Liu, Yuyuan Liu, Chong Wang, Yuanhong Chen, Johan W Verjans, Gustavo Carneiro

Current polyp detection methods from colonoscopy videos use exclusively normal (i. e., healthy) training images, which i) ignore the importance of temporal information in consecutive video frames, and ii) lack knowledge about the polyps.

Multiple Instance Learning Supervised Anomaly Detection +1

Unsupervised Anomaly Detection in Medical Images with a Memory-augmented Multi-level Cross-attentional Masked Autoencoder

1 code implementation22 Mar 2022 Yu Tian, Guansong Pang, Yuyuan Liu, Chong Wang, Yuanhong Chen, Fengbei Liu, Rajvinder Singh, Johan W Verjans, Mengyu Wang, Gustavo Carneiro

Our UAD approach, the memory-augmented multi-level cross-attentional masked autoencoder (MemMC-MAE), is a transformer-based approach, consisting of a novel memory-augmented self-attention operator for the encoder and a new multi-level cross-attention operator for the decoder.

Image Reconstruction Unsupervised Anomaly Detection

BoMD: Bag of Multi-label Descriptors for Noisy Chest X-ray Classification

2 code implementations ICCV 2023 Yuanhong Chen, Fengbei Liu, Hu Wang, Chong Wang, Yu Tian, Yuyuan Liu, Gustavo Carneiro

Deep learning methods have shown outstanding classification accuracy in medical imaging problems, which is largely attributed to the availability of large-scale datasets manually annotated with clean labels.

Multi-Label Classification

In Defense of Kalman Filtering for Polyp Tracking from Colonoscopy Videos

no code implementations27 Jan 2022 David Butler, Yuan Zhang, Tim Chen, Seon Ho Shin, Rajvinder Singh, Gustavo Carneiro

We advocate that the field should instead focus on the development of simple and efficient detectors that an be combined with effective trackers to allow the implementation of real-time polyp detectors.

Mutual information neural estimation for unsupervised multi-modal registration of brain images

no code implementations25 Jan 2022 Gerard Snaauw, Michele Sasdelli, Gabriel Maicas, Stephan Lau, Johan Verjans, Mark Jenkinson, Gustavo Carneiro

We propose guiding the training of a deep learning-based registration method with MI estimation between an image-pair in an end-to-end trainable network.

Image Registration

ACPL: Anti-curriculum Pseudo-labelling for Semi-supervised Medical Image Classification

1 code implementation CVPR 2022 Fengbei Liu, Yu Tian, Yuanhong Chen, Yuyuan Liu, Vasileios Belagiannis, Gustavo Carneiro

Effective semi-supervised learning (SSL) in medical image analysis (MIA) must address two challenges: 1) work effectively on both multi-class (e. g., lesion classification) and multi-label (e. g., multiple-disease diagnosis) problems, and 2) handle imbalanced learning (because of the high variance in disease prevalence).

Image Classification Multi-Label Classification +1

Perturbed and Strict Mean Teachers for Semi-supervised Semantic Segmentation

1 code implementation CVPR 2022 Yuyuan Liu, Yu Tian, Yuanhong Chen, Fengbei Liu, Vasileios Belagiannis, Gustavo Carneiro

The accurate prediction by this model allows us to use a challenging combination of network, input data and feature perturbations to improve the consistency learning generalisation, where the feature perturbations consist of a new adversarial perturbation.

Semi-Supervised Semantic Segmentation

Pixel-wise Energy-biased Abstention Learning for Anomaly Segmentation on Complex Urban Driving Scenes

3 code implementations24 Nov 2021 Yu Tian, Yuyuan Liu, Guansong Pang, Fengbei Liu, Yuanhong Chen, Gustavo Carneiro

However, previous uncertainty approaches that directly associate high uncertainty to anomaly may sometimes lead to incorrect anomaly predictions, and external reconstruction models tend to be too inefficient for real-time self-driving embedded systems.

Ranked #2 on Anomaly Detection on Lost and Found (using extra training data)

Anomaly Detection Segmentation +1

A Hierarchical Multi-Task Approach to Gastrointestinal Image Analysis

no code implementations16 Nov 2021 Adrian Galdran, Gustavo Carneiro, Miguel A. González Ballester

We also describe in this paper our solution for the challenge task of polyp segmentation in colonoscopies, which was addressed with a pretrained double encoder-decoder network.

Segmentation

Convolutional Nets Versus Vision Transformers for Diabetic Foot Ulcer Classification

no code implementations12 Nov 2021 Adrian Galdran, Gustavo Carneiro, Miguel A. González Ballester

This paper compares well-established Convolutional Neural Networks (CNNs) to recently introduced Vision Transformers for the task of Diabetic Foot Ulcer Classification, in the context of the DFUC 2021 Grand-Challenge, in which this work attained the first position.

Classification Position

PropMix: Hard Sample Filtering and Proportional MixUp for Learning with Noisy Labels

1 code implementation22 Oct 2021 Filipe R. Cordeiro, Vasileios Belagiannis, Ian Reid, Gustavo Carneiro

The most competitive noisy label learning methods rely on an unsupervised classification of clean and noisy samples, where samples classified as noisy are re-labelled and "MixMatched" with the clean samples.

Image Classification with Label Noise Learning with noisy labels

Balanced-MixUp for Highly Imbalanced Medical Image Classification

1 code implementation20 Sep 2021 Adrian Galdran, Gustavo Carneiro, Miguel A. González Ballester

The resulting two sets of samples are then mixed-up to create a more balanced training distribution from which a neural network can effectively learn without incurring in heavily under-fitting the minority classes.

Image Classification Medical Image Classification

Self-supervised Pseudo Multi-class Pre-training for Unsupervised Anomaly Detection and Segmentation in Medical Images

2 code implementations3 Sep 2021 Yu Tian, Fengbei Liu, Guansong Pang, Yuanhong Chen, Yuyuan Liu, Johan W. Verjans, Rajvinder Singh, Gustavo Carneiro

Pre-training UAD methods with self-supervised learning, based on computer vision techniques, can mitigate this challenge, but they are sub-optimal because they do not explore domain knowledge for designing the pretext tasks, and their contrastive learning losses do not try to cluster the normal training images, which may result in a sparse distribution of normal images that is ineffective for anomaly detection.

Contrastive Learning Data Augmentation +2

Probabilistic task modelling for meta-learning

1 code implementation9 Jun 2021 Cuong C. Nguyen, Thanh-Toan Do, Gustavo Carneiro

We propose probabilistic task modelling -- a generative probabilistic model for collections of tasks used in meta-learning.

Meta-Learning Variational Inference

Self-supervised Lesion Change Detection and Localisation in Longitudinal Multiple Sclerosis Brain Imaging

no code implementations2 Jun 2021 Minh-Son To, Ian G Sarno, Chee Chong, Mark Jenkinson, Gustavo Carneiro

Hence, we introduce a new unsupervised anomaly detection and localisation method trained exclusively with serial images that do not contain any lesion changes.

Change Detection Decision Making +2

Kernel Adversarial Learning for Real-world Image Super-resolution

no code implementations19 Apr 2021 Hu Wang, Congbo Ma, Jianpeng Zhang, Gustavo Carneiro

Current deep image super-resolution (SR) approaches attempt to restore high-resolution images from down-sampled images or by assuming degradation from simple Gaussian kernels and additive noises.

Image Super-Resolution

ScanMix: Learning from Severe Label Noise via Semantic Clustering and Semi-Supervised Learning

1 code implementation21 Mar 2021 Ragav Sachdeva, Filipe R Cordeiro, Vasileios Belagiannis, Ian Reid, Gustavo Carneiro

We propose a new training algorithm, ScanMix, that explores semantic clustering and semi-supervised learning (SSL) to allow superior robustness to severe label noise and competitive robustness to non-severe label noise problems, in comparison to the state of the art (SOTA) methods.

Clustering Image Classification

LongReMix: Robust Learning with High Confidence Samples in a Noisy Label Environment

1 code implementation6 Mar 2021 Filipe R. Cordeiro, Ragav Sachdeva, Vasileios Belagiannis, Ian Reid, Gustavo Carneiro

Deep neural network models are robust to a limited amount of label noise, but their ability to memorise noisy labels in high noise rate problems is still an open issue.

Image Classification

NVUM: Non-Volatile Unbiased Memory for Robust Medical Image Classification

1 code implementation6 Mar 2021 Fengbei Liu, Yuanhong Chen, Yu Tian, Yuyuan Liu, Chong Wang, Vasileios Belagiannis, Gustavo Carneiro

In this paper, we propose a new training module called Non-Volatile Unbiased Memory (NVUM), which non-volatility stores running average of model logits for a new regularization loss on noisy multi-label problem.

Image Classification with Label Noise Learning with noisy labels +1

Self-supervised Mean Teacher for Semi-supervised Chest X-ray Classification

1 code implementation5 Mar 2021 Fengbei Liu, Yu Tian, Filipe R. Cordeiro, Vasileios Belagiannis, Ian Reid, Gustavo Carneiro

In this paper, we propose Self-supervised Mean Teacher for Semi-supervised (S$^2$MTS$^2$) learning that combines self-supervised mean-teacher pre-training with semi-supervised fine-tuning.

Contrastive Learning General Classification +3

Constrained Contrastive Distribution Learning for Unsupervised Anomaly Detection and Localisation in Medical Images

1 code implementation5 Mar 2021 Yu Tian, Guansong Pang, Fengbei Liu, Yuanhong Chen, Seon Ho Shin, Johan W. Verjans, Rajvinder Singh, Gustavo Carneiro

Unsupervised anomaly detection (UAD) learns one-class classifiers exclusively with normal (i. e., healthy) images to detect any abnormal (i. e., unhealthy) samples that do not conform to the expected normal patterns.

Contrastive Learning Representation Learning +1

Post-hoc Overall Survival Time Prediction from Brain MRI

1 code implementation22 Feb 2021 Renato Hermoza, Gabriel Maicas, Jacinto C. Nascimento, Gustavo Carneiro

In this paper, we introduce a new post-hoc method for OS time prediction that does not require segmentation map annotation for training.

Brain Tumor Segmentation Segmentation +1

Similarity of Classification Tasks

1 code implementation27 Jan 2021 Cuong Nguyen, Thanh-Toan Do, Gustavo Carneiro

Recent advances in meta-learning has led to remarkable performances on several few-shot learning benchmarks.

Classification Few-Shot Learning +1

Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learning

3 code implementations ICCV 2021 Yu Tian, Guansong Pang, Yuanhong Chen, Rajvinder Singh, Johan W. Verjans, Gustavo Carneiro

To address this issue, we introduce a novel and theoretically sound method, named Robust Temporal Feature Magnitude learning (RTFM), which trains a feature magnitude learning function to effectively recognise the positive instances, substantially improving the robustness of the MIL approach to the negative instances from abnormal videos.

Anomaly Detection In Surveillance Videos Contrastive Learning +2

Deep One-Class Classification via Interpolated Gaussian Descriptor

2 code implementations25 Jan 2021 Yuanhong Chen, Yu Tian, Guansong Pang, Gustavo Carneiro

The adversarial interpolation is enforced to consistently learn a smooth Gaussian descriptor, even when the training data is small or contaminated with anomalous samples.

Ranked #2 on Anomaly Detection on MNIST (using extra training data)

Classification One-Class Classification +1

Semantics for Robotic Mapping, Perception and Interaction: A Survey

no code implementations2 Jan 2021 Sourav Garg, Niko Sünderhauf, Feras Dayoub, Douglas Morrison, Akansel Cosgun, Gustavo Carneiro, Qi Wu, Tat-Jun Chin, Ian Reid, Stephen Gould, Peter Corke, Michael Milford

In robotics and related research fields, the study of understanding is often referred to as semantics, which dictates what does the world "mean" to a robot, and is strongly tied to the question of how to represent that meaning.

Autonomous Driving Navigate

Bayesian Metric Learning for Robust Training of Deep Models under Noisy Labels

no code implementations1 Jan 2021 Toan Tran, Hieu Vu, Gustavo Carneiro, Hung Bui

Label noise is a natural event of data collection and annotation and has been shown to have significant impact on the performance of deep learning models regarding accuracy reduction and sample complexity increase.

General Classification Metric Learning +1

A Chaos Theory Approach to Understand Neural Network Optimization

no code implementations1 Jan 2021 Michele Sasdelli, Thalaiyasingam Ajanthan, Tat-Jun Chin, Gustavo Carneiro

Then, we empirically show that for a large range of learning rates, SGD traverses the loss landscape across regions with largest eigenvalue of the Hessian similar to the inverse of the learning rate.

Second-order methods

Domain Generalisation with Domain Augmented Supervised Contrastive Learning (Student Abstract)

no code implementations27 Dec 2020 Hoang Son Le, Rini Akmeliawati, Gustavo Carneiro

Domain generalisation (DG) methods address the problem of domain shift, when there is a mismatch between the distributions of training and target domains.

Contrastive Learning Data Augmentation

A Survey on Deep Learning with Noisy Labels: How to train your model when you cannot trust on the annotations?

no code implementations5 Dec 2020 Filipe R. Cordeiro, Gustavo Carneiro

As deep learning models depend on correctly labeled data sets and label correctness is difficult to guarantee, it is crucial to consider the presence of noisy labels for deep learning training.

Learning with noisy labels Meta-Learning

EvidentialMix: Learning with Combined Open-set and Closed-set Noisy Labels

1 code implementation11 Nov 2020 Ragav Sachdeva, Filipe R. Cordeiro, Vasileios Belagiannis, Ian Reid, Gustavo Carneiro

In this work, we study a new variant of the noisy label problem that combines the open-set and closed-set noisy labels, and introduce a benchmark evaluation to assess the performance of training algorithms under this setup.

Deep Metric Learning Meets Deep Clustering: An Novel Unsupervised Approach for Feature Embedding

1 code implementation9 Sep 2020 Binh X. Nguyen, Binh D. Nguyen, Gustavo Carneiro, Erman Tjiputra, Quang D. Tran, Thanh-Toan Do

Based on pseudo labels, we propose a novel unsupervised metric loss which enforces the positive concentration and negative separation of samples in the embedding space.

Benchmarking Clustering +2

Self-supervised Depth Estimation to Regularise Semantic Segmentation in Knee Arthroscopy

no code implementations5 Jul 2020 Fengbei Liu, Yaqub Jonmohamadi, Gabriel Maicas, Ajay K. Pandey, Gustavo Carneiro

In this paper, we propose a novel self-supervised monocular depth estimation to regularise the training of the semantic segmentation in knee arthroscopy.

Monocular Depth Estimation Segmentation +1

Few-Shot Microscopy Image Cell Segmentation

1 code implementation29 Jun 2020 Youssef Dawoud, Julia Hornauer, Gustavo Carneiro, Vasileios Belagiannis

Instead, we assume that we can access a plethora of annotated image data sets from different domains (sources) and a limited number of annotated image data sets from the domain of interest (target), where each domain denotes not only different image appearance but also a different type of cell segmentation problem.

Cell Segmentation Few-Shot Learning +1

Few-Shot Anomaly Detection for Polyp Frames from Colonoscopy

1 code implementation26 Jun 2020 Yu Tian, Gabriel Maicas, Leonardo Zorron Cheng Tao Pu, Rajvinder Singh, Johan W. Verjans, Gustavo Carneiro

Anomaly detection methods generally target the learning of a normal image distribution (i. e., inliers showing healthy cases) and during testing, samples relatively far from the learned distribution are classified as anomalies (i. e., outliers showing disease cases).

Anomaly Detection

Region Proposals for Saliency Map Refinement for Weakly-supervised Disease Localisation and Classification

1 code implementation21 May 2020 Renato Hermoza, Gabriel Maicas, Jacinto C. Nascimento, Gustavo Carneiro

The deployment of automated systems to diagnose diseases from medical images is challenged by the requirement to localise the diagnosed diseases to justify or explain the classification decision.

Classification General Classification +2

Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volume

1 code implementation CVPR 2020 Adrian Johnston, Gustavo Carneiro

We show that the extension of the state-of-the-art self-supervised monocular trained depth estimator Monodepth2 with these two ideas allows us to design a model that produces the best results in the field in KITTI 2015 and Make3D, closing the gap with respect self-supervised stereo training and fully supervised approaches.

Monocular Depth Estimation

Semi-supervised Multi-domain Multi-task Training for Metastatic Colon Lymph Node Diagnosis From Abdominal CT

no code implementations23 Oct 2019 Saskia Glaser, Gabriel Maicas, Sergei Bedrikovetski, Tarik Sammour, Gustavo Carneiro

However, the lack of annotations for the localisation of the regions of interest (ROIs) containing lymph nodes can limit classification accuracy due to the small size of the relevant ROIs in this problem.

Computed Tomography (CT) General Classification

Hidden Stratification Causes Clinically Meaningful Failures in Machine Learning for Medical Imaging

no code implementations27 Sep 2019 Luke Oakden-Rayner, Jared Dunnmon, Gustavo Carneiro, Christopher Ré

Machine learning models for medical image analysis often suffer from poor performance on important subsets of a population that are not identified during training or testing.

BIG-bench Machine Learning

Generalised Zero-Shot Learning with Domain Classification in a Joint Semantic and Visual Space

no code implementations14 Aug 2019 Rafael Felix, Ben Harwood, Michele Sasdelli, Gustavo Carneiro

Most state-of-the-art GZSL approaches rely on a mapping between latent visual and semantic spaces without considering if a particular sample belongs to the set of seen or unseen classes.

domain classification General Classification +1

Few-Shot Meta-Denoising

no code implementations31 Jul 2019 Leslie Casas, Attila Klimmek, Gustavo Carneiro, Nassir Navab, Vasileios Belagiannis

A solution to mitigate the small training set issue is to pre-train a denoising model with small training sets containing pairs of clean and synthesized noisy signals, produced from empirical noise priors, and fine-tune on the available small training set.

Denoising Few-Shot Learning +1

Uncertainty in Model-Agnostic Meta-Learning using Variational Inference

1 code implementation27 Jul 2019 Cuong Nguyen, Thanh-Toan Do, Gustavo Carneiro

We introduce a new, rigorously-formulated Bayesian meta-learning algorithm that learns a probability distribution of model parameter prior for few-shot learning.

BIG-bench Machine Learning Classification +5

Unsupervised Task Design to Meta-Train Medical Image Classifiers

no code implementations17 Jul 2019 Gabriel Maicas, Cuong Nguyen, Farbod Motlagh, Jacinto C. Nascimento, Gustavo Carneiro

Meta-training has been empirically demonstrated to be the most effective pre-training method for few-shot learning of medical image classifiers (i. e., classifiers modeled with small training sets).

Classification Few-Shot Learning +1

Bayesian Generative Active Deep Learning

no code implementations26 Apr 2019 Toan Tran, Thanh-Toan Do, Ian Reid, Gustavo Carneiro

Deep learning models have demonstrated outstanding performance in several problems, but their training process tends to require immense amounts of computational and human resources for training and labeling, constraining the types of problems that can be tackled.

Active Learning Data Augmentation

A Theoretically Sound Upper Bound on the Triplet Loss for Improving the Efficiency of Deep Distance Metric Learning

no code implementations CVPR 2019 Thanh-Toan Do, Toan Tran, Ian Reid, Vijay Kumar, Tuan Hoang, Gustavo Carneiro

Another approach explored in the field relies on an ad-hoc linearization (in terms of N) of the triplet loss that introduces class centroids, which must be optimized using the whole training set for each mini-batch - this means that a naive implementation of this approach has run-time complexity O(N^2).

Metric Learning Retrieval

Multi-modal Ensemble Classification for Generalized Zero Shot Learning

no code implementations15 Jan 2019 Rafael Felix, Michele Sasdelli, Ian Reid, Gustavo Carneiro

In this paper, we mitigate these issues by proposing a new GZSL method based on multi-modal training and testing processes, where the optimization explicitly promotes a balanced classification accuracy between seen and unseen classes.

Bayesian Inference Classification +2

Probabilistic Object Detection: Definition and Evaluation

1 code implementation27 Nov 2018 David Hall, Feras Dayoub, John Skinner, Haoyang Zhang, Dimity Miller, Peter Corke, Gustavo Carneiro, Anelia Angelova, Niko Sünderhauf

We introduce Probabilistic Object Detection, the task of detecting objects in images and accurately quantifying the spatial and semantic uncertainties of the detections.

Object object-detection +1

Approximate Fisher Information Matrix to Characterise the Training of Deep Neural Networks

1 code implementation16 Oct 2018 Zhibin Liao, Tom Drummond, Ian Reid, Gustavo Carneiro

Furthermore, the proposed measurements also allow us to show that it is possible to optimise the training process with a new dynamic sampling training approach that continuously and automatically change the mini-batch size and learning rate during the training process.

General Classification Image Classification

Pre and Post-hoc Diagnosis and Interpretation of Malignancy from Breast DCE-MRI

no code implementations25 Sep 2018 Gabriel Maicas, Andrew P. Bradley, Jacinto C. Nascimento, Ian Reid, Gustavo Carneiro

Conversely, traditional approaches follow a pre-hoc approach that initially localises suspicious areas that are subsequently classified to establish the breast malignancy -- this approach is trained using strongly annotated data (i. e., it needs a delineation and classification of all lesions in an image).

Multi-modal Cycle-consistent Generalized Zero-Shot Learning

1 code implementation ECCV 2018 Rafael Felix, B. G. Vijay Kumar, Ian Reid, Gustavo Carneiro

In generalized zero shot learning (GZSL), the set of classes are split into seen and unseen classes, where training relies on the semantic features of the seen and unseen classes and the visual representations of only the seen classes, while testing uses the visual representations of the seen and unseen classes.

General Classification Generalized Zero-Shot Learning

Model Agnostic Saliency for Weakly Supervised Lesion Detection from Breast DCE-MRI

no code implementations20 Jul 2018 Gabriel Maicas, Gerard Snaauw, Andrew P. Bradley, Ian Reid, Gustavo Carneiro

There is a heated debate on how to interpret the decisions provided by deep learning models (DLM), where the main approaches rely on the visualization of salient regions to interpret the DLM classification process.

General Classification Lesion Detection

Bayesian Semantic Instance Segmentation in Open Set World

no code implementations ECCV 2018 Trung Pham, Vijay Kumar B G, Thanh-Toan Do, Gustavo Carneiro, Ian Reid

In this paper, we present a novel open-set semantic instance segmentation approach capable of segmenting all known and unknown object classes in images, based on the output of an object detector trained on known object classes.

Instance Segmentation Object +2

Producing radiologist-quality reports for interpretable artificial intelligence

no code implementations1 Jun 2018 William Gale, Luke Oakden-Rayner, Gustavo Carneiro, Andrew P. Bradley, Lyle J. Palmer

Current approaches to explaining the decisions of deep learning systems for medical tasks have focused on visualising the elements that have contributed to each decision.

Decision Making Descriptive

Training Medical Image Analysis Systems like Radiologists

no code implementations28 May 2018 Gabriel Maicas, Andrew P. Bradley, Jacinto C. Nascimento, Ian Reid, Gustavo Carneiro

This process bears no direct resemblance with radiologist training, which is based on solving a series of tasks of increasing difficulty, where each task involves the use of significantly smaller datasets than those used in machine learning.

BIG-bench Machine Learning Classification +3

Detecting hip fractures with radiologist-level performance using deep neural networks

no code implementations17 Nov 2017 William Gale, Luke Oakden-Rayner, Gustavo Carneiro, Andrew P. Bradley, Lyle J. Palmer

We developed an automated deep learning system to detect hip fractures from frontal pelvic x-rays, an important and common radiological task.

Smart Mining for Deep Metric Learning

no code implementations ICCV 2017 Ben Harwood, Vijay Kumar B G, Gustavo Carneiro, Ian Reid, Tom Drummond

In this paper, we propose a novel deep metric learning method that combines the triplet model and the global structure of the embedding space.

Metric Learning

Automated Detection of Individual Micro-calcifications from Mammograms using a Multi-stage Cascade Approach

no code implementations7 Oct 2016 Zhi Lu, Gustavo Carneiro, Neeraj Dhungel, Andrew P. Bradley

In mammography, the efficacy of computer-aided detection methods depends, in part, on the robust localisation of micro-calcifications ($\mu$C).

Clustering General Classification

Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue

2 code implementations16 Mar 2016 Ravi Garg, Vijay Kumar BG, Gustavo Carneiro, Ian Reid

In this work we propose a unsupervised framework to learn a deep convolutional neural network for single view depth predic- tion, without requiring a pre-training stage or annotated ground truth depths.

Depth Estimation

Learning Local Image Descriptors with Deep Siamese and Triplet Convolutional Networks by Minimising Global Loss Functions

2 code implementations CVPR 2016 Vijay Kumar B G, Gustavo Carneiro, Ian Reid

Current results from machine learning show that replacing this siamese by a triplet network can improve the classification accuracy in several problems, but this has yet to be demonstrated for local image descriptor learning.

General Classification

Weakly-Supervised Structured Output Learning With Flexible and Latent Graphs Using High-Order Loss Functions

no code implementations ICCV 2015 Gustavo Carneiro, Tingying Peng, Christine Bayer, Nassir Navab

We introduce two new structured output models that use a latent graph, which is flexible in terms of the number of nodes and structure, where the training process minimises a high-order loss function using a weakly annotated training set.

Competitive Multi-scale Convolution

no code implementations18 Nov 2015 Zhibin Liao, Gustavo Carneiro

In this paper, we introduce a new deep convolutional neural network (ConvNet) module that promotes competition among a set of multi-scale convolutional filters.

Image Classification

On the Importance of Normalisation Layers in Deep Learning with Piecewise Linear Activation Units

no code implementations3 Aug 2015 Zhibin Liao, Gustavo Carneiro

The combination of deep learning models and piecewise linear activation functions allows for the estimation of exponentially complex functions with the use of a large number of subnetworks specialized in the classification of similar input examples.

General Classification Image Classification

Robust Optimization for Deep Regression

1 code implementation ICCV 2015 Vasileios Belagiannis, Christian Rupprecht, Gustavo Carneiro, Nassir Navab

Convolutional Neural Networks (ConvNets) have successfully contributed to improve the accuracy of regression-based methods for computer vision tasks such as human pose estimation, landmark localization, and object detection.

Age Estimation object-detection +3

Deep Structured learning for mass segmentation from Mammograms

no code implementations27 Oct 2014 Neeraj Dhungel, Gustavo Carneiro, Andrew P. Bradley

In this paper, we present a novel method for the segmentation of breast masses from mammograms exploring structured and deep learning.

Mass Segmentation From Mammograms Segmentation

Non-rigid Segmentation using Sparse Low Dimensional Manifolds and Deep Belief Networks

no code implementations CVPR 2014 Jacinto C. Nascimento, Gustavo Carneiro

In this paper, we propose a new methodology for segmenting non-rigid visual objects, where the search procedure is onducted directly on a sparse low-dimensional manifold, guided by the classification results computed from a deep belief network.

Segmentation

Top-Down Segmentation of Non-rigid Visual Objects Using Derivative-Based Search on Sparse Manifolds

no code implementations CVPR 2013 Jacinto C. Nascimento, Gustavo Carneiro

In this paper, we propose the use of sparse manifolds to reduce the dimensionality of the rigid detection search space of current stateof-the-art top-down segmentation methodologies.

Segmentation

Cannot find the paper you are looking for? You can Submit a new open access paper.