Search Results for author:
Found 45 papers, 17 papers with code
SCD: Self-Contrastive Decorrelation of Sentence Embeddings
In this paper, we propose Self-Contrastive Decorrelation (SCD), a self-supervised approach.
Contrastive Perplexity for Controlled Generation: An Application in Detoxifying Large Language Models
Optimizing the training objective entails aligning text perplexities in a contrastive fashion.
Semi-supervised learning made simple with self-supervised clustering
Self-supervised learning models have been shown to learn rich visual representations without requiring human annotations.
A soft nearest-neighbor framework for continual semi-supervised learning
Despite significant advances, the performance of state-of-the-art continual learning approaches hinges on the unrealistic scenario of fully labeled data.
miCSE: Mutual Information Contrastive Learning for Low-shot Sentence Embeddings
This study opens up avenues for efficient self-supervised learning methods that are more robust than current contrastive methods for sentence embedding.
Mixture-of-experts VAEs can disregard variation in surjective multimodal data
Machine learning systems are often deployed in domains that entail data from multiple modalities, for example, phenotypic and genotypic characteristics describe patients in healthcare.
Uncertainty-aware Contrastive Distillation for Incremental Semantic Segmentation
This problem has been widely investigated in the research community and several Incremental Learning (IL) approaches have been proposed in the past years.
SCD: Self-Contrastive Decorrelation for Sentence Embeddings
In this paper, we propose Self-Contrastive Decorrelation (SCD), a self-supervised approach.
Hierarchical Multimodal Variational Autoencoders
Humans find structure in natural phenomena by absorbing stimuli from multiple input sources such as vision, text, and speech.
Attention-based Contrastive Learning for Winograd Schemas
Self-supervised learning has recently attracted considerable attention in the NLP community for its ability to learn discriminative features using a contrastive objective.
Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models
Can we get existing language models and refine them for zero-shot commonsense reasoning?
A Unified Objective for Novel Class Discovery
In this paper, we study the problem of Novel Class Discovery (NCD).
Ranked #3 on
Novel Object Detection
on LVIS v1.0 val
Solo-learn: A Library of Self-supervised Methods for Visual Representation Learning
This paper presents solo-learn, a library of self-supervised methods for visual representation learning.
EaSe: A Diagnostic Tool for VQA based on Answer Diversity
We propose EASE, a simple diagnostic tool for Visual Question Answering (VQA) which quantifies the difficulty of an image, question sample.
Learning Private Representations with Focal Entropy
Specifically, we propose focal entropy - a variant of entropy embedded in an adversarial representation learning setting to leverage privacy sanitization.
Multimodal Prototypical Networks for Few-shot Learning
Although providing exceptional results for many computer vision tasks, state-of-the-art deep learning algorithms catastrophically struggle in low data scenarios.
Learning Graph-Based Priors for Generalized Zero-Shot Learning
The task of zero-shot learning (ZSL) requires correctly predicting the label of samples from classes which were unseen at training time.
Online Continual Learning under Extreme Memory Constraints
Continual Learning (CL) aims to develop agents emulating the human ability to sequentially learn new tasks while being able to retain knowledge obtained from past experiences.
Contrastive Self-Supervised Learning for Commonsense Reasoning
We achieve such commonsense reasoning by constructing pair-wise contrastive auxiliary predictions.
Multimodal Self-Supervised Learning for Medical Image Analysis
We introduce the multimodal puzzle task, which facilitates rich representation learning from multiple image modalities.
Pruning at a Glance: Global Neural Pruning for Model Compression
We prove the viability of our method by producing highly compressed models, namely VGG-16, ResNet-56, and ResNet-110 respectively on CIFAR10 without losing any performance compared to the baseline, as well as ResNet-34 and ResNet-50 on ImageNet without a significant loss of accuracy.
Learning to Answer by Learning to Ask: Getting the Best of GPT-2 and BERT Worlds
In this work, we propose a variant of the self-attention Transformer network architectures model to generate meaningful and diverse questions.
Privacy-preserving Representation Learning by Disentanglement
The proposed approach deals with the setting where the private features are not explicit, and is estimated though the course of learning.
Attention Is (not) All You Need for Commonsense Reasoning
The recently introduced BERT model exhibits strong performance on several language understanding benchmarks.
Ranked #7 on
Natural Language Understanding
on PDP60
Budget-Aware Adapters for Multi-Domain Learning
To implement this idea we derive specialized deep models for each domain by adapting a pre-trained architecture but, differently from other methods, we propose a novel strategy to automatically adjust the computational complexity of the network.
Learning to remember: Dynamic Generative Memory for Continual Learning
Continuously trainable models should be able to learn from a stream of data over an undefined period of time.
Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning
In order to tackle these challenges, we introduce Dynamic Generative Memory (DGM) - a synaptic plasticity driven framework for continual learning.
Ranked #4 on
Continual Learning
on ImageNet-50 (5 tasks)
Low-Shot Learning from Imaginary 3D Model
Since the advent of deep learning, neural networks have demonstrated remarkable results in many visual recognition tasks, constantly pushing the limits.
Self Paced Adversarial Training for Multimodal Few-shot Learning
State-of-the-art deep learning algorithms yield remarkable results in many visual recognition tasks.
Pruning at a Glance: A Structured Class-Blind Pruning Technique for Model Compression
High performance of deep learning models typically comes at cost of considerable model size and computation time.
The Wisdom of MaSSeS: Majority, Subjectivity, and Semantic Similarity in the Evaluation of VQA
We show that our metric is effective in providing a more fine-grained evaluation both on the quantitative and qualitative level.
Cross-modal Hallucination for Few-shot Fine-grained Recognition
State-of-the-art deep learning algorithms generally require large amounts of data for model training.
Differentially Private Federated Learning: A Client Level Perspective
In such an attack, a client's contribution during training and information about their data set is revealed through analyzing the distributed model.
Abnormal Event Detection in Videos using Generative Adversarial Nets
In this paper we address the abnormality detection problem in crowded scenes.
Ranked #4 on
Abnormal Event Detection In Video
on UCSD Ped2
Self-Crowdsourcing Training for Relation Extraction
In this paper we introduce a self-training strategy for crowdsourcing.
Training Adversarial Discriminators for Cross-channel Abnormal Event Detection in Crowds
Abnormal crowd behaviour detection attracts a large interest due to its importance in video surveillance scenarios.
FOIL it! Find One mismatch between Image and Language caption
In this paper, we aim to understand whether current language and vision (LaVi) models truly grasp the interaction between the two modalities.
Efficient Convolutional Neural Network with Binary Quantization Layer
We use binary encoding of CNN features to overcome the difficulty of the clustering on the high-dimensional CNN feature space.
Plug-and-Play CNN for Crowd Motion Analysis: An Application in Abnormal Event Detection
In this paper, we show that keeping track of the changes in the CNN feature across time can facilitate capturing the local abnormality.
CNN-aware Binary Map for General Semantic Segmentation
To the best of our knowledge our method is the first attempt on general semantic image segmentation using CNN.
Emotion-Based Crowd Representation for Abnormality Detection
We aim at publishing the dataset with the article, to be used as a benchmark for the communities.
Self Paced Deep Learning for Weakly Supervised Object Detection
The main idea is to iteratively select a subset of images and boxes that are the most reliable, and use them for training.
Ranked #31 on
Weakly Supervised Object Detection
on PASCAL VOC 2007
Mid-level Representation for Visual Recognition
We investigate on discovering and learning a set of mid-level patches to be used for representing the images of an object category.
Learning With Dataset Bias in Latent Subcategory Models
However, previous work has highlighted the possible danger of simply training a model from the combined datasets, due to the presence of bias.
