Search Results for author: Soufiane Belharbi

Found 22 papers, 18 papers with code

Joint Multimodal Transformer for Dimensional Emotional Recognition in the Wild

no code implementations15 Mar 2024 Paul Waligora, Osama Zeeshan, Haseeb Aslam, Soufiane Belharbi, Alessandro Lameiras Koerich, Marco Pedersoli, Simon Bacon, Eric Granger

Subsequently, a joint multimodal transformer architecture integrates the individual modality embeddings, enabling the model to effectively capture inter-modal (between audio and visual) and intra-modal (within each modality) relationships.

Emotion Recognition

Guided Interpretable Facial Expression Recognition via Spatial Action Unit Cues

1 code implementation1 Feb 2024 Soufiane Belharbi, Marco Pedersoli, Alessandro Lameiras Koerich, Simon Bacon, Eric Granger

In particular, using this aus codebook, input image expression label, and facial landmarks, a single action units heatmap is built to indicate the most discriminative regions of interest in the image w. r. t the facial expression.

Facial Expression Recognition Facial Expression Recognition (FER)

DiPS: Discriminative Pseudo-Label Sampling with Self-Supervised Transformers for Weakly Supervised Object Localization

1 code implementation9 Oct 2023 Shakeeb Murtaza, Soufiane Belharbi, Marco Pedersoli, Aydin Sarraf, Eric Granger

Subsequently, these proposals are used as pseudo-labels to train our new transformer-based WSOL model designed to perform classification and localization tasks.

Object Pseudo Label +1

CoLo-CAM: Class Activation Mapping for Object Co-Localization in Weakly-Labeled Unconstrained Videos

1 code implementation16 Mar 2023 Soufiane Belharbi, Shakeeb Murtaza, Marco Pedersoli, Ismail Ben Ayed, Luke McCaffrey, Eric Granger

This paper proposes a novel CAM method for WSVOL that exploits spatiotemporal information in activation maps during training without constraining an object's position.

Object Object Localization

Constrained Sampling for Class-Agnostic Weakly Supervised Object Localization

no code implementations9 Sep 2022 Shakeeb Murtaza, Soufiane Belharbi, Marco Pedersoli, Aydin Sarraf, Eric Granger

Then, foreground and background pixels are sampled from these regions in order to train a WSOL model for generating activation maps that can accurately localize objects belonging to a specific class.

Object Weakly-Supervised Object Localization

TCAM: Temporal Class Activation Maps for Object Localization in Weakly-Labeled Unconstrained Videos

1 code implementation30 Aug 2022 Soufiane Belharbi, Ismail Ben Ayed, Luke McCaffrey, Eric Granger

Our proposed TCAM method achieves a new state-of-art in WSVOL accuracy, and visual results suggest that it can be adapted for subsequent tasks like visual object tracking and detection.

Object Object Localization +2

F-CAM: Full Resolution Class Activation Maps via Guided Parametric Upscaling

1 code implementation15 Sep 2021 Soufiane Belharbi, Aydin Sarraf, Marco Pedersoli, Ismail Ben Ayed, Luke McCaffrey, Eric Granger

Interpolation is required to restore full size CAMs, yet it does not consider the statistical properties of objects, such as color and texture, leading to activations with inconsistent boundaries, and inaccurate localizations.

Weakly-Supervised Object Localization

Holistic Guidance for Occluded Person Re-Identification

1 code implementation13 Apr 2021 Madhu Kiran, R Gnana Praveen, Le Thanh Nguyen-Meidine, Soufiane Belharbi, Louis-Antoine Blais-Morin, Eric Granger

Hence, our proposed student-teacher framework is trained to address the occlusion problem by matching the distributions of between- and within-class distances (DCDs) of occluded samples with that of holistic (non-occluded) samples, thereby using the latter as a soft labeled reference to learn well separated DCDs.

Denoising Person Re-Identification +1

Deep Interpretable Classification and Weakly-Supervised Segmentation of Histology Images via Max-Min Uncertainty

2 code implementations14 Nov 2020 Soufiane Belharbi, Jérôme Rony, Jose Dolz, Ismail Ben Ayed, Luke McCaffrey, Eric Granger

We propose novel regularization terms, which enable the model to seek both non-discriminative and discriminative regions, while discouraging unbalanced segmentations.

General Classification Weakly-supervised Learning +1

Deep Active Learning for Joint Classification & Segmentation with Weak Annotator

1 code implementation10 Oct 2020 Soufiane Belharbi, Ismail Ben Ayed, Luke McCaffrey, Eric Granger

CNN visualization and interpretation methods, like class-activation maps (CAMs), are typically used to highlight the image regions linked to class predictions.

Active Learning Classification +3

Convolutional STN for Weakly Supervised Object Localization

1 code implementation3 Dec 2019 Akhil Meethal, Marco Pedersoli, Soufiane Belharbi, Eric Granger

Weakly supervised object localization is a challenging task in which the object of interest should be localized while learning its appearance.

Object Weakly-Supervised Object Localization

Non-parametric Uni-modality Constraints for Deep Ordinal Classification

1 code implementation25 Nov 2019 Soufiane Belharbi, Ismail Ben Ayed, Luke McCaffrey, Eric Granger

We propose a new constrained-optimization formulation for deep ordinal classification, in which uni-modality of the label distribution is enforced implicitly via a set of inequality constraints over all the pairs of adjacent labels.

 Ranked #1 on Historical Color Image Dating on HCI (MAE metric)

Classification General Classification +2

Deep Weakly-Supervised Learning Methods for Classification and Localization in Histology Images: A Survey

1 code implementation8 Sep 2019 Jérôme Rony, Soufiane Belharbi, Jose Dolz, Ismail Ben Ayed, Luke McCaffrey, Eric Granger

Four key challenges are identified for the application of deep WSOL methods in histology -- under/over activation of CAMs, sensitivity to thresholding, and model selection.

General Classification Model Selection +2

Min-max Entropy for Weakly Supervised Pointwise Localization

1 code implementation25 Jul 2019 Soufiane Belharbi, Jérôme Rony, Jose Dolz, Ismail Ben Ayed, Luke McCaffrey, Eric Granger

Pointwise localization allows more precise localization and accurate interpretability, compared to bounding box, in applications where objects are highly unstructured such as in medical domain.

Weakly-Supervised Object Localization

Neural Networks Regularization Through Representation Learning

1 code implementation13 Jul 2018 Soufiane Belharbi

In this thesis, we tackle the neural network overfitting issue from a representation learning perspective by considering the situation where few training samples are available which is the case of many real world applications.

Data Augmentation Representation Learning +1

Deep Neural Networks Regularization for Structured Output Prediction

1 code implementation28 Apr 2015 Soufiane Belharbi, Romain Hérault, Clément Chatelain, Sébastien Adam

The motivation of this work is to learn the output dependencies that may lie in the output data in order to improve the prediction accuracy.

Facial Landmark Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.