Search Results for author: Enver Sangineto

Found 35 papers, 22 papers with code

Semantic Residual Prompts for Continual Learning

no code implementations11 Mar 2024 Martin Menabue, Emanuele Frascaroli, Matteo Boschini, Enver Sangineto, Lorenzo Bonicelli, Angelo Porrello, Simone Calderara

Most of these methods organize these vectors in a pool of key-value pairs, and use the input image as query to retrieve the prompts (values).

Continual Learning

StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Model

1 code implementation ICCV 2023 Zipeng Xu, Enver Sangineto, Nicu Sebe

Despite the progress made in the style transfer task, most previous work focus on transferring only relatively simple features like color or texture, while missing more abstract concepts such as overall art expression or painter-specific traits.

Style Transfer

SpectralCLIP: Preventing Artifacts in Text-Guided Style Transfer from a Spectral Perspective

1 code implementation16 Mar 2023 Zipeng Xu, Songlong Xing, Enver Sangineto, Nicu Sebe

However, directly using CLIP to guide style transfer leads to undesirable artifacts (mainly written words and unrelated visual entities) spread over the image.

Image Generation Style Transfer

One Transformer for All Time Series: Representing and Training with Time-Dependent Heterogeneous Tabular Data

no code implementations13 Feb 2023 Simone Luetto, Fabrizio Garuti, Enver Sangineto, Lorenzo Forni, Rita Cucchiara

There is a recent growing interest in applying Deep Learning techniques to tabular data, in order to replicate the success of other Artificial Intelligence areas in this structured domain.

Time Series Time Series Analysis

Input Perturbation Reduces Exposure Bias in Diffusion Models

1 code implementation27 Jan 2023 Mang Ning, Enver Sangineto, Angelo Porrello, Simone Calderara, Rita Cucchiara

Denoising Diffusion Probabilistic Models have shown an impressive generation quality, although their long sampling chain leads to high computational costs.

Denoising Image Generation +1

Unsupervised High-Resolution Portrait Gaze Correction and Animation

1 code implementation1 Jul 2022 Jichao Zhang, Jingjing Chen, Hao Tang, Enver Sangineto, Peng Wu, Yan Yan, Nicu Sebe, Wei Wang

Solving this problem using an unsupervised method remains an open problem, especially for high-resolution face images in the wild, which are not easy to annotate with gaze and head pose labels.

Image Inpainting Vocal Bursts Intensity Prediction

Spatial Entropy as an Inductive Bias for Vision Transformers

1 code implementation9 Jun 2022 Elia Peruzzo, Enver Sangineto, Yahui Liu, Marco De Nadai, Wei Bi, Bruno Lepri, Nicu Sebe

In this work, we propose a different and complementary direction, in which a local bias is introduced using an auxiliary self-supervised task, performed jointly with standard supervised training.

Inductive Bias Semantic Segmentation

Temporal Alignment for History Representation in Reinforcement Learning

1 code implementation7 Apr 2022 Aleksandr Ermolov, Enver Sangineto, Nicu Sebe

Inspired by human memory, we propose to represent history with only important changes in the environment and, in our approach, to obtain automatically this representation using self-supervision.

Atari Games reinforcement-learning +1

3D-Aware Semantic-Guided Generative Model for Human Synthesis

1 code implementation2 Dec 2021 Jichao Zhang, Enver Sangineto, Hao Tang, Aliaksandr Siarohin, Zhun Zhong, Nicu Sebe, Wei Wang

However, they usually struggle to generate high-quality images representing non-rigid objects, such as the human body, which is of a great interest for many computer graphics applications.

3D-Aware Image Synthesis

Smoothing the Disentangled Latent Style Space for Unsupervised Image-to-Image Translation

no code implementations CVPR 2021 Yahui Liu, Enver Sangineto, Yajing Chen, Linchao Bao, Haoxian Zhang, Nicu Sebe, Bruno Lepri, Wei Wang, Marco De Nadai

In this paper, we propose a new training protocol based on three specific losses which help a translation network to learn a smooth and disentangled latent style space in which: 1) Both intra- and inter-domain interpolations correspond to gradual changes in the generated images and 2) The content of the source image is better preserved during the translation.

Translation Unsupervised Image-To-Image Translation

Efficient Training of Visual Transformers with Small Datasets

1 code implementation NeurIPS 2021 Yahui Liu, Enver Sangineto, Wei Bi, Nicu Sebe, Bruno Lepri, Marco De Nadai

This task encourages the VTs to learn spatial relations within an image and makes the VT training much more robust when training data are scarce.

Inductive Bias

Controllable Person Image Synthesis with Spatially-Adaptive Warped Normalization

1 code implementation31 May 2021 Jichao Zhang, Aliaksandr Siarohin, Hao Tang, Enver Sangineto, Wei Wang, Humphrey Sh, Nicu Sebe

Moreover, we propose a novel Self-Training Part Replacement (STPR) strategy to refine the model for the texture-transfer task, which improves the quality of the generated clothes and the preservation ability of non-target regions.

Image-to-Image Translation Pose Transfer +1

Dual In-painting Model for Unsupervised Gaze Correction and Animation in the Wild

1 code implementation9 Aug 2020 Jichao Zhang, Jingjing Chen, Hao Tang, Wei Wang, Yan Yan, Enver Sangineto, Nicu Sebe

In this paper we address the problem of unsupervised gaze correction in the wild, presenting a solution that works without the need for precise annotations of the gaze angle and the head pose.

Online Continual Learning under Extreme Memory Constraints

1 code implementation ECCV 2020 Enrico Fini, Stéphane Lathuilière, Enver Sangineto, Moin Nabi, Elisa Ricci

Continual Learning (CL) aims to develop agents emulating the human ability to sequentially learn new tasks while being able to retain knowledge obtained from past experiences.

Continual Learning

Whitening for Self-Supervised Representation Learning

8 code implementations13 Jul 2020 Aleksandr Ermolov, Aliaksandr Siarohin, Enver Sangineto, Nicu Sebe

Most of the current self-supervised representation learning (SSL) methods are based on the contrastive loss and the instance-discrimination task, where augmented versions of the same image instance ("positives") are contrasted with instances extracted from other images ("negatives").

Representation Learning Self-Supervised Learning

Coarse-to-Fine Gaze Redirection with Numerical and Pictorial Guidance

1 code implementation7 Apr 2020 Jingjing Chen, Jichao Zhang, Enver Sangineto, Jiayuan Fan, Tao Chen, Nicu Sebe

In this paper, we propose to alleviate these problems by means of a novel gaze redirection framework which exploits both a numerical and a pictorial direction guidance, jointly with a coarse-to-fine learning strategy.

gaze redirection Image Generation

Event Discovery for History Representation in Reinforcement Learning

no code implementations25 Sep 2019 Aleksandr Ermolov, Enver Sangineto, Nicu Sebe

To address this problem, a possible solution is to provide the agent with information about past observations.

reinforcement-learning Reinforcement Learning (RL)

Attention-based Fusion for Multi-source Human Image Generation

no code implementations7 May 2019 Stéphane Lathuilière, Enver Sangineto, Aliaksandr Siarohin, Nicu Sebe

We present a generalization of the person-image generation task, in which a human image is generated conditioned on a target pose and a set X of source appearance images.

Image Generation

Whitening and Coloring transform for GANs

no code implementations ICLR 2019 Aliaksandr Siarohin, Enver Sangineto, Nicu Sebe

In this paper we propose to generalize both BN and cBN using a Whitening and Coloring based batch normalization.

Appearance and Pose-Conditioned Human Image Generation using Deformable GANs

1 code implementation30 Apr 2019 Aliaksandr Siarohin, Stéphane Lathuilière, Enver Sangineto, Nicu Sebe

Specifically, given an image xa of a person and a target pose P(xb), extracted from a different image xb, we synthesize a new image of that person in pose P(xb), while preserving the visual details in xa.

Data Augmentation Generative Adversarial Network +2

Metric-Learning based Deep Hashing Network for Content Based Retrieval of Remote Sensing Images

1 code implementation2 Apr 2019 Subhankar Roy, Enver Sangineto, Begüm Demir, Nicu Sebe

Hashing methods have been recently found very effective in retrieval of remote sensing (RS) images due to their computational efficiency and fast search speed.

Computational Efficiency Deep Hashing +1

Whitening and Coloring batch transform for GANs

1 code implementation ICLR 2019 Aliaksandr Siarohin, Enver Sangineto, Nicu Sebe

In this paper we propose to generalize both BN and cBN using a Whitening and Coloring based batch normalization.

Image Generation

FOIL it! Find One mismatch between Image and Language caption

no code implementations ACL 2017 Ravi Shekhar, Sandro Pezzelle, Yauhen Klimovich, Aurelie Herbelot, Moin Nabi, Enver Sangineto, Raffaella Bernardi

In this paper, we aim to understand whether current language and vision (LaVi) models truly grasp the interaction between the two modalities.

Plug-and-Play CNN for Crowd Motion Analysis: An Application in Abnormal Event Detection

no code implementations2 Oct 2016 Mahdyar Ravanbakhsh, Moin Nabi, Hossein Mousavi, Enver Sangineto, Nicu Sebe

In this paper, we show that keeping track of the changes in the CNN feature across time can facilitate capturing the local abnormality.

Anomaly Detection Event Detection +1

Self Paced Deep Learning for Weakly Supervised Object Detection

1 code implementation24 May 2016 Enver Sangineto, Moin Nabi, Dubravko Culibrk, Nicu Sebe

The main idea is to iteratively select a subset of images and boxes that are the most reliable, and use them for training.

Multiple Instance Learning Object +2

Unsupervised Tube Extraction Using Transductive Learning and Dense Trajectories

1 code implementation ICCV 2015 Mihai Marian Puscas, Enver Sangineto, Dubravko Culibrk, Nicu Sebe

The combination of appearance-based static ''objectness'' (Selective Search), motion information (Dense Trajectories) and transductive learning (detectors are forced to "overfit" on the unsupervised data used for training) makes the proposed approach extremely robust.

object-detection Object Detection +2

Cannot find the paper you are looking for? You can Submit a new open access paper.