Open-vocabulary object detection

65 papers with code • 0 benchmarks • 0 datasets

This task has no description! Would you like to contribute one?

Most implemented papers

Open-vocabulary Object Detection via Vision and Language Knowledge Distillation

tensorflow/tpu ICLR 2022

On COCO, ViLD outperforms the previous state-of-the-art by 4. 8 on novel AP and 11. 4 on overall AP.

Open-Vocabulary DETR with Conditional Matching

yuhangzang/ov-detr 22 Mar 2022

To this end, we propose a novel open-vocabulary detector based on DETR -- hence the name OV-DETR -- which, once trained, can detect any object given its class name or an exemplar image.

Simple Open-Vocabulary Object Detection with Vision Transformers

google-research/scenic 12 May 2022

Combining simple architectures with large-scale pre-training has led to massive improvements in image classification.

Scaling Open-Vocabulary Object Detection

google-research/scenic NeurIPS 2023

However, with OWL-ST, we can scale to over 1B examples, yielding further large improvement: With an L/14 architecture, OWL-ST improves AP on LVIS rare classes, for which the model has seen no human box annotations, from 31. 2% to 44. 6% (43% relative improvement).

YOLO-World: Real-Time Open-Vocabulary Object Detection

ailab-cvc/yolo-world CVPR 2024

The You Only Look Once (YOLO) series of detectors have established themselves as efficient and practical tools.

Open Vocabulary Object Detection with Proposal Mining and Prediction Equalization

peixianchen/medet 22 Jun 2022

Open-vocabulary object detection (OVD) aims to scale up vocabulary size to detect objects of novel categories beyond the training vocabulary.

Region-Aware Pretraining for Open-Vocabulary Object Detection with Vision Transformers

google-research/google-research CVPR 2023

We present Region-aware Open-vocabulary Vision Transformers (RO-ViT) - a contrastive image-text pretraining recipe to bridge the gap between image-level pretraining and open-vocabulary object detection.

Taming Self-Training for Open-Vocabulary Object Detection

xiaofeng94/sas-det CVPR 2024

This work identifies two challenges of using self-training in OVD: noisy PLs from VLMs and frequent distribution changes of PLs.

Region-centric Image-Language Pretraining for Open-Vocabulary Detection

google-research/google-research 29 Sep 2023

We present a new open-vocabulary detection approach based on region-centric image-language pretraining to bridge the gap between image-level pretraining and open-vocabulary object detection.

Real-time Transformer-based Open-Vocabulary Detection with Efficient Fusion Head

om-ai-lab/OmDet 11 Mar 2024

End-to-end transformer-based detectors (DETRs) have shown exceptional performance in both closed-set and open-vocabulary object detection (OVD) tasks through the integration of language modalities.