Search Results for author: Concetto Spampinato

Found 42 papers, 16 papers with code

SalFoM: Dynamic Saliency Prediction with Video Foundation Models

no code implementations3 Apr 2024 Morteza Moradi, Mohammad Moradi, Francesco Rundo, Concetto Spampinato, Ali Borji, Simone Palazzo

Recent advancements in video saliency prediction (VSP) have shown promising performance compared to the human visual system, whose emulation is the primary goal of VSP.

Saliency Prediction Video Saliency Prediction

Diffexplainer: Towards Cross-modal Global Explanations with Diffusion Models

no code implementations3 Apr 2024 Matteo Pennisi, Giovanni Bellitto, Simone Palazzo, Mubarak Shah, Concetto Spampinato

We present DiffExplainer, a novel framework that, leveraging language-vision models, enables multimodal global explainability.

Selective Attention-based Modulation for Continual Learning

no code implementations29 Mar 2024 Giovanni Bellitto, Federica Proietto Salanitri, Matteo Pennisi, Matteo Boschini, Angelo Porrello, Simone Calderara, Simone Palazzo, Concetto Spampinato

We present SAM, a biologically-plausible selective attention-driven modulation approach to enhance classification models in a continual learning setting.

Continual Learning Saliency Prediction

Transformer-based Video Saliency Prediction with High Temporal Dimension Decoding

no code implementations15 Jan 2024 Morteza Moradi, Simone Palazzo, Concetto Spampinato

In recent years, finding an effective and efficient strategy for exploiting spatial and temporal information has been a hot research topic in video saliency prediction (VSP).

Saliency Prediction Video Saliency Prediction

Wake-Sleep Consolidated Learning

no code implementations6 Dec 2023 Amelia Sorrenti, Giovanni Bellitto, Federica Proietto Salanitri, Matteo Pennisi, Simone Palazzo, Concetto Spampinato

In the REM stage, the model is exposed to previously-unseen realistic visual sensory experience, and the dreaming process is activated, which enables the model to explore the potential feature space, thus preparing synapses to future knowledge.

Continual Learning Hippocampus

Radiomics Boosts Deep Learning Model for IPMN Classification

no code implementations11 Sep 2023 Lanhong Yao, Zheyuan Zhang, Ugur Demir, Elif Keles, Camila Vendrami, Emil Agarunov, Candice Bolan, Ivo Schoots, Marc Bruno, Rajesh Keswani, Frank Miller, Tamas Gonda, Cemal Yazici, Temel Tirkes, Michael Wallace, Concetto Spampinato, Ulas Bagci

We test our proposed decision-fusion model in multi-center data sets of 246 multi-contrast MRI scans and obtain superior performance to the state of the art (SOTA) in this field.

Classification Decision Making

MatFuse: Controllable Material Generation with Diffusion Models

1 code implementation22 Aug 2023 Giuseppe Vecchio, Renato Sortino, Simone Palazzo, Concetto Spampinato

Creating high-quality materials in computer graphics is a challenging and time-consuming task, which requires great expertise.

SVBRDF Estimation

Car-Driver Drowsiness Assessment through 1D Temporal Convolutional Networks

no code implementations27 Jul 2023 Francesco Rundo, Concetto Spampinato, Michael Rundo

Recently, the scientific progress of Advanced Driver Assistance System solutions (ADAS) has played a key role in enhancing the overall safety of driving.

Photoplethysmography (PPG)

Visual Saliency Detection in Advanced Driver Assistance Systems

no code implementations26 Jul 2023 Francesco Rundo, Michael Sebastian Rundo, Concetto Spampinato

A dedicated 1D temporal deep convolutional network has been devised to classify the collected PPG time-series, enabling us to assess the driver level of attentiveness.

Photoplethysmography (PPG) Saliency Detection +2

A Privacy-Preserving Walk in the Latent Space of Generative Models for Medical Applications

1 code implementation6 Jul 2023 Matteo Pennisi, Federica Proietto Salanitri, Giovanni Bellitto, Simone Palazzo, Ulas Bagci, Concetto Spampinato

Generative Adversarial Networks (GANs) have demonstrated their ability to generate synthetic samples that match a target distribution.

Privacy Preserving

RADiff: Controllable Diffusion Models for Radio Astronomical Maps Generation

no code implementations5 Jul 2023 Renato Sortino, Thomas Cecconello, Andrea DeMarco, Giuseppe Fiameni, Andrea Pilzer, Andrew M. Hopkins, Daniel Magro, Simone Riggi, Eva Sciacca, Adriano Ingallinera, Cristobal Bordiu, Filomena Bufano, Concetto Spampinato

We evaluate the effectiveness of this approach by training a semantic segmentation model on a real dataset augmented in two ways: 1) using synthetic images obtained from real masks, and 2) generating images from synthetic semantic masks.

Astronomy object-detection +2

MeT: A Graph Transformer for Semantic Segmentation of 3D Meshes

no code implementations3 Jul 2023 Giuseppe Vecchio, Luca Prezzavento, Carmelo Pino, Francesco Rundo, Simone Palazzo, Concetto Spampinato

Polygonal meshes have become the standard for discretely approximating 3D shapes, thanks to their efficiency and high flexibility in capturing non-uniform shapes.

Segmentation Semantic Segmentation

A baseline on continual learning methods for video action recognition

no code implementations20 Apr 2023 Giulia Castagnolo, Concetto Spampinato, Francesco Rundo, Daniela Giordano, Simone Palazzo

Continual learning has recently attracted attention from the research community, as it aims to solve long-standing limitations of classic supervisedly-trained models.

Action Recognition Continual Learning +2

Transformer-based Image Generation from Scene Graphs

1 code implementation8 Mar 2023 Renato Sortino, Simone Palazzo, Concetto Spampinato

In this work, we show how employing multi-head attention to encode the graph information, as well as using a transformer-based model in the latent space for image generation can improve the quality of the sampled data, without the need to employ adversarial models with the subsequent advantage in terms of training stability.

Image Generation from Scene Graphs

On the Effectiveness of Lipschitz-Driven Rehearsal in Continual Learning

1 code implementation12 Oct 2022 Lorenzo Bonicelli, Matteo Boschini, Angelo Porrello, Concetto Spampinato, Simone Calderara

By means of extensive experiments, we show that applying LiDER delivers a stable performance gain to several state-of-the-art rehearsal CL methods across multiple datasets, both in the presence and absence of pre-training.

Continual Learning

Transforming Image Generation from Scene Graphs

no code implementations1 Jul 2022 Renato Sortino, Simone Palazzo, Concetto Spampinato

Generating images from semantic visual knowledge is a challenging task, that can be useful to condition the synthesis process in complex, subtle, and unambiguous ways, compared to alternatives such as class labels or text descriptions.

Image Generation from Scene Graphs

Neural Transformers for Intraductal Papillary Mucosal Neoplasms (IPMN) Classification in MRI images

1 code implementation21 Jun 2022 Federica Proietto Salanitri, Giovanni Bellitto, Simone Palazzo, Ismail Irmakci, Michael B. Wallace, Candice W. Bolan, Megan Engels, Sanne Hoogenboom, Marco Aldinucci, Ulas Bagci, Daniela Giordano, Concetto Spampinato

Early detection of precancerous cysts or neoplasms, i. e., Intraductal Papillary Mucosal Neoplasms (IPMN), in pancreas is a challenging and complex task, and it may lead to a more favourable outcome.

FedER: Federated Learning through Experience Replay and Privacy-Preserving Data Synthesis

1 code implementation20 Jun 2022 Matteo Pennisi, Federica Proietto Salanitri, Giovanni Bellitto, Bruno Casella, Marco Aldinucci, Simone Palazzo, Concetto Spampinato

In the medical field, multi-center collaborations are often sought to yield more generalizable findings by leveraging the heterogeneity of patient and clinical data.

Federated Learning Privacy Preserving

Effects of Auxiliary Knowledge on Continual Learning

1 code implementation3 Jun 2022 Giovanni Bellitto, Matteo Pennisi, Simone Palazzo, Lorenzo Bonicelli, Matteo Boschini, Simone Calderara, Concetto Spampinato

In this paper we propose a new, simple, CL algorithm that focuses on solving the current task in a way that might facilitate the learning of the next ones.

Continual Learning Image Classification

SurfaceNet: Adversarial SVBRDF Estimation from a Single Image

2 code implementations ICCV 2021 Giuseppe Vecchio, Simone Palazzo, Concetto Spampinato

In this paper we present SurfaceNet, an approach for estimating spatially-varying bidirectional reflectance distribution function (SVBRDF) material properties from a single image.

Generative Adversarial Network SVBRDF Estimation +1

Information Bottleneck Attribution for Visual Explanations of Diagnosis and Prognosis

no code implementations7 Apr 2021 Ugur Demir, Ismail Irmakci, Elif Keles, Ahmet Topcu, Ziyue Xu, Concetto Spampinato, Sachin Jambawalikar, Evrim Turkbey, Baris Turkbey, Ulas Bagci

We provide an innovative visual explanation algorithm for general purpose and as an example application, we demonstrate its effectiveness for quantifying lesions in the lungs caused by the Covid-19 with high accuracy and robustness without using dense segmentation labels.

Correct block-design experiments mitigate temporal correlation bias in EEG classification

1 code implementation25 Nov 2020 Simone Palazzo, Concetto Spampinato, Joseph Schmidt, Isaak Kavasidis, Daniela Giordano, Mubarak Shah

We argue that the reason why Li et al. [1] observe such high correlation in EEG data is their unconventional experimental design and settings that violate the basic cognitive neuroscience design recommendations, first and foremost the one of limiting the experiments' duration, as instead done in [2].

Classification EEG +2

Hierarchical Domain-Adapted Feature Learning for Video Saliency Prediction

1 code implementation2 Oct 2020 Giovanni Bellitto, Federica Proietto Salanitri, Simone Palazzo, Francesco Rundo, Daniela Giordano, Concetto Spampinato

When the base hierarchical model is empowered with domain-specific modules, performance improves, outperforming state-of-the-art models on three out of five metrics on the DHF1K benchmark and reaching the second-best results on the other two.

Saliency Prediction Unsupervised Domain Adaptation +2

Diagnosing Colorectal Polyps in the Wild with Capsule Networks

1 code implementation10 Jan 2020 Rodney LaLonde, Pujan Kandel, Concetto Spampinato, Michael B. Wallace, Ulas Bagci

In this study, we design a novel capsule network architecture (D-Caps) to improve the viability of optical biopsy of colorectal polyps.

Image Classification

Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Features

no code implementations25 Oct 2018 Simone Palazzo, Concetto Spampinato, Isaak Kavasidis, Daniela Giordano, Joseph Schmidt, Mubarak Shah

After verifying that visual information can be extracted from EEG data, we introduce a multimodal approach that uses deep image and EEG encoders, trained in a siamese configuration, for learning a joint manifold that maximizes a compatibility measure between visual features and brain representations.

Classification EEG +3

Generative Adversarial Networks Conditioned by Brain Signals

no code implementations ICCV 2017 Simone Palazzo, Concetto Spampinato, Isaak Kavasidis, Daniela Giordano, Mubarak Shah

In this work, we build on the latter class of approaches and investigate the possibility of driving and conditioning the image generation process by means of brain signals recorded, through an electroencephalograph (EEG), while users look at images from a set of 40 ImageNet object categories with the objective of generating the seen images.

EEG Image Generation

Deep Learning Human Mind for Automated Visual Classification

2 code implementations CVPR 2017 Concetto Spampinato, Simone Palazzo, Isaak Kavasidis, Daniela Giordano, Mubarak Shah, Nasim Souly

In particular, we employ EEG data evoked by visual object stimuli combined with Recurrent Neural Networks (RNN) to learn a discriminative brain activity manifold of visual categories.

Classification EEG +3

Gamifying Video Object Segmentation

no code implementations5 Jan 2016 Simone Palazzo, Concetto Spampinato, Daniela Giordano

Video object segmentation can be considered as one of the most challenging computer vision problems.

Interactive Video Object Segmentation Object +3

Cannot find the paper you are looking for? You can Submit a new open access paper.