TASK	DATASET	MODEL	METRIC NAME	METRIC VALUE	GLOBAL RANK
Zero-Shot Learning	Caltech-101	ZLaP	Accuracy	84	# 1
Zero-Shot Learning	Caltech-101	ZLaP*	Accuracy	83.1	# 2
Transductive Zero-Shot Classification	Caltech-101	ZLaP	Accuracy	83.7	# 1
Zero-Shot Learning	CIFAR-10	ZLaP	Accuracy	93.4	# 2
Transductive Zero-Shot Classification	CIFAR-10	ZLaP	Accuracy	93.6	# 1
Zero-Shot Learning	CIFAR-10	ZLaP*	Accuracy	93.6	# 1
Zero-Shot Learning	CIFAR-100	ZLaP	Accuracy	74	# 2
Zero-Shot Learning	CIFAR-100	ZLaP*	Accuracy	74.2	# 1
Transductive Zero-Shot Classification	CIFAR-100	ZLaP	Accuarcy	73.3	# 1
Transductive Zero-Shot Classification	CUB-200-2011	ZLaP	Accuracy	64.1	# 1
Zero-Shot Learning	CUB-200-2011	ZLaP*	Accuracy	64.2	# 2
Zero-Shot Learning	CUB-200-2011	ZLaP	Accuracy	64.3	# 1
Zero-Shot Learning	DTD	ZLaP*	Accuracy	51	# 2
Zero-Shot Learning	DTD	ZLaP	Accuracy	51.2	# 1
Transductive Zero-Shot Classification	DTD	ZLaP	Accuracy	51.8	# 1
Zero-Shot Learning	EuroSAT	ZLaP	Accuracy	63.2	# 1
Zero-Shot Learning	EuroSAT	ZLaP*	Accuracy	62.7	# 2
Transductive Zero-Shot Classification	EuroSAT	ZLaP	Accuracy	60.9	# 1
Zero-Shot Learning	FGVC-Aircraft	ZLaP	Accuracy	29.1	# 1
Transductive Zero-Shot Classification	FGVC-Aircraft	ZLaP	Accuracy	28.4	# 1
Zero-Shot Learning	FGVC-Aircraft	ZLaP*	Accuracy	29	# 2
Transductive Zero-Shot Classification	Flowers-102	ZLaP	Accuracy	73.4	# 1
Zero-Shot Learning	Flowers-102	ZLaP*	Accuracy	75.5	# 2
Zero-Shot Learning	Flowers-102	ZLaP	Accuracy	75.9	# 1
Transductive Zero-Shot Classification	Food-101	ZLaP	Accuracy	87.9	# 1
Zero-Shot Learning	Food-101	ZLaP*	Accuracy	87.9	# 1
Zero-Shot Learning	Food-101	ZLaP	Accuracy	87.8	# 2
Zero-Shot Learning	ImageNet	ZLaP	Top 1 Accuracy	72.1	# 1
Zero-Shot Learning	ImageNet	ZLaP*	Top 1 Accuracy	72.1	# 1
Transductive Zero-Shot Classification	ImageNet	ZLaP	Top 1 Accuracy	72.7	# 1
Zero-Shot Learning	Oxford-IIIT Pets	ZLaP*	Accuracy	89	# 2
Zero-Shot Learning	Oxford-IIIT Pets	ZLaP	Accuracy	90	# 1
Transductive Zero-Shot Classification	Oxford-IIIT Pets	ZLaP	Accuracy	92.8	# 1
Zero-Shot Learning	Stanford Cars	ZLaP*	Accuracy	71.8	# 1
Transductive Zero-Shot Classification	Stanford Cars	ZLaP	Accuracy	72.1	# 1
Zero-Shot Learning	Stanford Cars	ZLaP	Accuracy	71.2	# 2
Zero-Shot Learning	SUN397	ZLaP	Accuracy	71	# 2
Transductive Zero-Shot Classification	SUN397	ZLaP	Accuracy	71.9	# 1
Zero-Shot Learning	SUN397	ZLaP*	Accuracy	71.4	# 1
Zero-Shot Learning	UCF101	ZLaP	Accuracy	76.3	# 1
Transductive Zero-Shot Classification	UCF101	ZLaP	Accuracy	77.7	# 1
Zero-Shot Learning	UCF101	ZLaP*	Accuracy	76.3	# 1

Badge	Markdown
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-caltech-101)](https://paperswithcode.com/sota/zero-shot-learning-on-caltech-101?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-6)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-6?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-7)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-7?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-cifar-10)](https://paperswithcode.com/sota/zero-shot-learning-on-cifar-10?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-cifar-100)](https://paperswithcode.com/sota/zero-shot-learning-on-cifar-100?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-8)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-8?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-cub)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-cub?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-cub-200-2011)](https://paperswithcode.com/sota/zero-shot-learning-on-cub-200-2011?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-dtd)](https://paperswithcode.com/sota/zero-shot-learning-on-dtd?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-dtd)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-dtd?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-eurosat)](https://paperswithcode.com/sota/zero-shot-learning-on-eurosat?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-1)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-1?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-fgvc-aircraft)](https://paperswithcode.com/sota/zero-shot-learning-on-fgvc-aircraft?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-fgvc)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-fgvc?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-2)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-2?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-flowers-102)](https://paperswithcode.com/sota/zero-shot-learning-on-flowers-102?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-food)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-food?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-food-101)](https://paperswithcode.com/sota/zero-shot-learning-on-food-101?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-imagenet)](https://paperswithcode.com/sota/zero-shot-learning-on-imagenet?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-oxford-iiit-pets)](https://paperswithcode.com/sota/zero-shot-learning-on-oxford-iiit-pets?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-3)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-3?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-stanford-cars)](https://paperswithcode.com/sota/zero-shot-learning-on-stanford-cars?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-5)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-5?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-4)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-4?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-sun397)](https://paperswithcode.com/sota/zero-shot-learning-on-sun397?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/zero-shot-learning-on-ucf101)](https://paperswithcode.com/sota/zero-shot-learning-on-ucf101?p=label-propagation-for-zero-shot)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/label-propagation-for-zero-shot/transductive-zero-shot-classification-on-9)](https://paperswithcode.com/sota/transductive-zero-shot-classification-on-9?p=label-propagation-for-zero-shot)`

Label Propagation for Zero-shot Classification with Vision-Language Models

CVPR 2024 · Vladan Stojnić, Yannis Kalantidis, Giorgos Tolias ·

Vision-Language Models (VLMs) have demonstrated impressive performance on zero-shot classification, i.e. classification when provided merely with a list of class names. In this paper, we tackle the case of zero-shot classification in the presence of unlabeled data. We leverage the graph structure of the unlabeled data and introduce ZLaP, a method based on label propagation (LP) that utilizes geodesic distances for classification. We tailor LP to graphs containing both text and image features and further propose an efficient method for performing inductive inference based on a dual solution and a sparsification step. We perform extensive experiments to evaluate the effectiveness of our method on 14 common datasets and show that ZLaP outperforms the latest related works. Code: https://github.com/vladan-stojnic/ZLaP

PDF Abstract CVPR 2024 PDF CVPR 2024 Abstract

Code

Add Remove Mark official

vladan-stojnic/zlap official

Tasks

Add Remove

Classification

Image Classification

Multi-label zero-shot learning

Transductive Learning

Transductive Zero-Shot Classification

Zero-Shot Learning

Datasets

CIFAR-10

ImageNet

CIFAR-100

CUB-200-2011

UCF101

Oxford 102 Flower

DTD

Stanford Cars

Food-101

Caltech-101

EuroSAT

FGVC-Aircraft MSCOCO Oxford-IIIT Pets

SUN397

Results from the Paper

Edit

Ranked #1 on Zero-Shot Learning on UCF101

Get a GitHub badge

Task	Dataset	Model	Metric Name	Metric Value	Global Rank	Benchmark
Zero-Shot Learning	Caltech-101	ZLaP	Accuracy	84	# 1	Compare
Zero-Shot Learning	Caltech-101	ZLaP*	Accuracy	83.1	# 2	Compare
Transductive Zero-Shot Classification	Caltech-101	ZLaP	Accuracy	83.7	# 1	Compare
Zero-Shot Learning	CIFAR-10	ZLaP	Accuracy	93.4	# 2	Compare
Transductive Zero-Shot Classification	CIFAR-10	ZLaP	Accuracy	93.6	# 1	Compare
Zero-Shot Learning	CIFAR-10	ZLaP*	Accuracy	93.6	# 1	Compare
Zero-Shot Learning	CIFAR-100	ZLaP	Accuracy	74	# 2	Compare
Zero-Shot Learning	CIFAR-100	ZLaP*	Accuracy	74.2	# 1	Compare
Transductive Zero-Shot Classification	CIFAR-100	ZLaP	Accuarcy	73.3	# 1	Compare
Transductive Zero-Shot Classification	CUB-200-2011	ZLaP	Accuracy	64.1	# 1	Compare
Zero-Shot Learning	CUB-200-2011	ZLaP*	Accuracy	64.2	# 2	Compare
Zero-Shot Learning	CUB-200-2011	ZLaP	Accuracy	64.3	# 1	Compare
Zero-Shot Learning	DTD	ZLaP*	Accuracy	51	# 2	Compare
Zero-Shot Learning	DTD	ZLaP	Accuracy	51.2	# 1	Compare
Transductive Zero-Shot Classification	DTD	ZLaP	Accuracy	51.8	# 1	Compare
Zero-Shot Learning	EuroSAT	ZLaP	Accuracy	63.2	# 1	Compare
Zero-Shot Learning	EuroSAT	ZLaP*	Accuracy	62.7	# 2	Compare
Transductive Zero-Shot Classification	EuroSAT	ZLaP	Accuracy	60.9	# 1	Compare
Zero-Shot Learning	FGVC-Aircraft	ZLaP	Accuracy	29.1	# 1	Compare
Transductive Zero-Shot Classification	FGVC-Aircraft	ZLaP	Accuracy	28.4	# 1	Compare
Zero-Shot Learning	FGVC-Aircraft	ZLaP*	Accuracy	29	# 2	Compare
Transductive Zero-Shot Classification	Flowers-102	ZLaP	Accuracy	73.4	# 1	Compare
Zero-Shot Learning	Flowers-102	ZLaP*	Accuracy	75.5	# 2	Compare
Zero-Shot Learning	Flowers-102	ZLaP	Accuracy	75.9	# 1	Compare
Transductive Zero-Shot Classification	Food-101	ZLaP	Accuracy	87.9	# 1	Compare
Zero-Shot Learning	Food-101	ZLaP*	Accuracy	87.9	# 1	Compare
Zero-Shot Learning	Food-101	ZLaP	Accuracy	87.8	# 2	Compare
Zero-Shot Learning	ImageNet	ZLaP	Top 1 Accuracy	72.1	# 1	Compare
Zero-Shot Learning	ImageNet	ZLaP*	Top 1 Accuracy	72.1	# 1	Compare
Transductive Zero-Shot Classification	ImageNet	ZLaP	Top 1 Accuracy	72.7	# 1	Compare
Zero-Shot Learning	Oxford-IIIT Pets	ZLaP*	Accuracy	89	# 2	Compare
Zero-Shot Learning	Oxford-IIIT Pets	ZLaP	Accuracy	90	# 1	Compare
Transductive Zero-Shot Classification	Oxford-IIIT Pets	ZLaP	Accuracy	92.8	# 1	Compare
Zero-Shot Learning	Stanford Cars	ZLaP*	Accuracy	71.8	# 1	Compare
Transductive Zero-Shot Classification	Stanford Cars	ZLaP	Accuracy	72.1	# 1	Compare
Zero-Shot Learning	Stanford Cars	ZLaP	Accuracy	71.2	# 2	Compare
Zero-Shot Learning	SUN397	ZLaP	Accuracy	71	# 2	Compare
Transductive Zero-Shot Classification	SUN397	ZLaP	Accuracy	71.9	# 1	Compare
Zero-Shot Learning	SUN397	ZLaP*	Accuracy	71.4	# 1	Compare
Zero-Shot Learning	UCF101	ZLaP	Accuracy	76.3	# 1	Compare
Transductive Zero-Shot Classification	UCF101	ZLaP	Accuracy	77.7	# 1	Compare
Zero-Shot Learning	UCF101	ZLaP*	Accuracy	76.3	# 1	Compare

Methods

Add Remove

ZLaP • ZLaP*

Edit Social Preview

Label Propagation for Zero-shot Classification with Vision-Language Models

Code Edit Add Remove Mark official

Tasks Edit Add Remove

Datasets Edit

Results from the Paper Edit

Methods Edit Add Remove

Code

Add Remove Mark official

Tasks

Add Remove

Datasets

Results from the Paper

Edit

Methods

Add Remove