Datasets

7,685 machine learning datasets
🔔   Share your dataset with the ML community!
Filter by Modality
Images 46 Videos 8 RGB-D 7 3D 5 Point cloud 3 Texts 3 Biology 2 LiDAR 2 3d meshes 1 6D 1 Biomedical 1 Hyperspectral images 1 Medical 1 RGB Video 1 Speech 1 Stereo 1 Actions 0 Audio 0 Cad 0 Dialog 0 EEG 0 Environment 0 Financial 0 Graphs 0 Interactive 0 Lyrics 0 MRI 0 Midi 0 Music 0 PSG 0 Parallel 0 Physics 0 Ranking 0 Replay data 0 Tables 0 Tabular 0 Time series 0 Tracking 0 fMRI 0
Filter by Task (clear)
Instance Segmentation Question Answering 322 Semantic Segmentation 250 Object Detection 229 Image Classification 199 Speech Recognition 194 Language Modelling 138 Text Generation 122 Text Classification 118 Pose Estimation 110 Named Entity Recognition 107 Reading Comprehension 94 Visual Question Answering 94 Action Recognition 91 Sentiment Analysis 84 Face Recognition 80 Information Retrieval 79 Text Summarization 79 Speaker Recognition 74 Machine Translation 72 Natural Language Inference 72 Domain Adaptation 71 Anomaly Detection 68 Autonomous Driving 65 Natural Language Understanding 64 Depth Estimation 63 Relation Extraction 63 Data Augmentation 62 Image Generation 62 Image Retrieval 57 Link Prediction 57 Person Re-Identification 55 Image Captioning 54 Node Classification 53 Classification 52 Optical Character Recognition 51 Word Embeddings 50 Object Tracking 47 Multi-Task Learning 46 Common Sense Reasoning 45 Abstractive Text Summarization 44 Face Detection 43 Emotion Recognition 42 Temporal Action Localization 42 Coreference Resolution 41 Scene Understanding 41 Machine Reading Comprehension 40 Recommendation Systems 39 3D Reconstruction 38 Semantic Parsing 38 Graph Classification 37 Object Recognition 37 Video Understanding 37 Decision Making 36 Knowledge Graphs 36 Visual Reasoning 36 2D Semantic Segmentation 34 Medical Image Segmentation 34 3D Human Pose Estimation 33 3D Object Detection 33 Entity Linking 33 Few-Shot Learning 33 Fine-Grained Image Classification 32 Image Super-Resolution 32 Misinformation 32 Self-Supervised Learning 32 Unsupervised Domain Adaptation 32 Zero-Shot Learning 32 Facial Expression Recognition 30 Hate Speech Detection 30 Metric Learning 30 Optical Flow Estimation 30 Speech Synthesis 30 Action Detection 29 Dialogue Generation 29 Image-to-Image Translation 29 Autonomous Vehicles 28 Document Summarization 28 Activity Recognition 27 Accented Speech Recognition 26 Handwriting Recognition 26 Multi-Label Classification 26 3D Pose Estimation 25 Multi-Object Tracking 25 Neural Architecture Search 25 Sequence-to-sequence Language Modeling 25 Token Classification 25 Trajectory Prediction 25 Action Classification 24 Audio Classification 24 Code Generation 24 Continual Learning 24 Super-Resolution 24 Video Captioning 24 Video Question Answering 24 Video Retrieval 24 Fake News Detection 23 Open-Domain Question Answering 23 Part-Of-Speech Tagging 23 Question Generation 23 Skeleton Based Action Recognition 23 3D Semantic Segmentation 22 Domain Generalization 22 Face Verification 22 Music Generation 22 Emotion Classification 21 Few-Shot Image Classification 21 Human-Object Interaction Detection 21 Music Information Retrieval 21 Novel View Synthesis 21 Data-to-Text Generation 20 Drug Discovery 20 Hand Pose Estimation 20 Monocular Depth Estimation 20 Panoptic Segmentation 20 Scene Classification 20 Stance Detection 20 Visual Object Tracking 20 2D object detection 19 Object Counting 19 Crowd Counting 18 Denoising 18 Graph Clustering 18 Image Clustering 18 Image Inpainting 18 Meta-Learning 18 Relation Classification 18 Semantic Textual Similarity 18 Sound Event Detection 18 Visual Localization 18 Visual Odometry 18 2D Human Pose Estimation 17 Automatic Speech Recognition 17 Dialect Identification 17 Face Anti-Spoofing 17 Fairness 17 Imitation Learning 17 Motor Imagery Decoding (left-hand vs right-hand) 17 SMAC+ 17 Scene Text Recognition 17 Slot Filling 17 Face Alignment 16 Gesture Recognition 16 Knowledge Graph Completion 16 Quantization 16 Salient Object Detection 16 Simultaneous Localization and Mapping 16 Style Transfer 16 Task-Oriented Dialogue Systems 16 Text-To-Speech Synthesis 16 Video Prediction 16 Visual Navigation 16 Visual Tracking 16 Action Recognition In Videos 15 Age Estimation 15 Cross-Lingual Transfer 15 Cross-Modal Retrieval 15 Density Estimation 15 Image Dehazing 15 Image Denoising 15 Intent Detection 15 Language Identification 15 Paraphrase Identification 15 RGB Salient Object Detection 15 Scene Recognition 15 Sign Language Recognition 15 Speech Enhancement 15 Time Series Forecasting 15 Unsupervised Anomaly Detection 15 Word Sense Disambiguation 15 Active Learning 14 Audio Source Separation 14 Clustering Algorithms Evaluation 14 Lane Detection 14 Node Classification on Non-Homophilic (Heterophilic) Graphs 14 Out-of-Distribution Detection 14 Self-Driving Cars 14 Speech Emotion Recognition 14 Text Simplification 14 Translation 14 Zero-shot Text Search 14 3D Hand Pose Estimation 13 Action Segmentation 13 Computed Tomography (CT) 13 Deblurring 13 DeepFake Detection 13 Dependency Parsing 13 Fact Verification 13 Gaze Estimation 13 Grammatical Error Correction 13 Graph Regression 13 Multi-Document Summarization 13 Multiple Object Tracking 13 Object Localization 13 Paraphrase Generation 13 Pedestrian Detection 13 Scene Text Detection 13 Speech Separation 13 Spoken Language Understanding 13 Transfer Learning 13 Video Object Segmentation 13 3D Action Recognition 12 3D Instance Segmentation 12 Activity Detection 12 Aspect-Based Sentiment Analysis 12 Disentanglement 12 Document Classification 12 Emotion Recognition in Conversation 12 Event Extraction 12 Facial Landmark Detection 12 Human Detection 12 Intent Classification 12 Medical Diagnosis 12 Multi-Label Text Classification 12 NER 12 Robotic Grasping 12 Sentence Classification 12 Stereo Matching 12 Stochastic Optimization 12 Time Series 12 Video Classification 12 Vision and Language Navigation 12 Weakly Supervised Object Detection 12 3D Face Reconstruction 11 Animal Pose Estimation 11 Binarization 11 Entity Resolution 11 Generalized Zero-Shot Learning 11 Hand Gesture Recognition 11 Image Enhancement 11 Imputation 11 Learning with noisy labels 11 Math Word Problem Solving 11 Relational Reasoning 11 Saliency Detection 11 Sarcasm Detection 11 Semi-Supervised Image Classification 11 Video Frame Interpolation 11 Video Super-Resolution 11 Visual Place Recognition 11 6D Pose Estimation 10 Acoustic Scene Classification 10 Answer Selection 10 COVID-19 Diagnosis 10 Cell Segmentation 10 Code Search 10 Conversational Response Selection 10 Dimensionality Reduction 10 Entity Disambiguation 10 Entity Typing 10 Graph Embedding 10 Handwriting generation 10 Image Compression 10 Image Restoration 10 Lesion Segmentation 10 Long-tail Learning 10 Motion Forecasting 10 Nested Named Entity Recognition 10 Open-Domain Dialog 10 Referring Expression Segmentation 10 Robot Navigation 10 Sentence Embeddings 10 Weather Forecasting 10 motion prediction 10 3D Human Reconstruction 9 Abusive Language 9 Automatic Post-Editing 9 Color Image Denoising 9 Column Type Annotation 9 Community Detection 9 Contrastive Learning 9 Depth Completion 9 Dialogue State Tracking 9 Face Swapping 9 Fact Checking 9 Federated Learning 9 Generalizable Person Re-identification 9 Handwritten Text Recognition 9 Hierarchical Multi-label Classification 9 Image Quality Assessment 9 Image Segmentation 9 Joint Entity and Relation Extraction 9 Knowledge Base Question Answering 9 Learning-To-Rank 9 Low-Light Image Enhancement 9 Multi-class Classification 9 Object Detection In Indoor Scenes 9 Outlier Detection 9 Prompt Engineering 9 Real-Time Semantic Segmentation 9 Semantic Role Labeling 9 Semantic Similarity 9 Text-Image Retrieval 9 Vehicle Re-Identification 9 Video Generation 9 Video Quality Assessment 9 Video Summarization 9 Visual Dialog 9 reinforcement Learning 9 Action Anticipation 8 Adversarial Attack 8 Citation Recommendation 8 Continuous Control 8 Dialogue Understanding 8 Discourse Parsing 8 Driver Attention Monitoring 8 Edge Detection 8 Explainable artificial intelligence 8 General Classification 8 Head Pose Estimation 8 Human Part Segmentation 8 Human action generation 8 Hyperspectral Image Classification 8 Image Registration 8 Image/Document Clustering 8 Incremental Learning 8 KG-to-Text Generation 8 Keypoint Detection 8 Keyword Spotting 8 Motion Estimation 8 Person Search 8 Point Cloud Registration 8 Real-Time Object Detection 8 Retrieval 8 Small Data Image Classification 8 Table annotation 8 Temporal Tagging 8 Trajectory Forecasting 8 Video Inpainting 8 Video Segmentation 8 3D Depth Estimation 7 3D Object Recognition 7 3D Object Tracking 7 3D Shape Reconstruction 7 Action Quality Assessment 7 Ad-hoc video search 7 Adversarial Robustness 7 Audio Tagging 7 AutoML 7 Automated Theorem Proving 7 Blind Super-Resolution 7 Boundary Detection 7 Change Detection 7 Chinese Reading Comprehension 7 Code Summarization 7 Colorectal Polyps Characterization 7 Colorization 7 Conditional Image Generation 7 Conversational Question Answering 7 Disaster Response 7 Document Layout Analysis 7 Event Detection 7 Extreme Summarization 7 Face Identification 7 Few-Shot Object Detection 7 Fine-Grained Image Recognition 7 Font Recognition 7 Gait Recognition 7 General Reinforcement Learning 7 Graph Matching 7 Homography Estimation 7 Human Behavior Forecasting 7 Image Matting 7 Image Reconstruction 7 Interactive Segmentation 7 Lesion Classification 7 License Plate Recognition 7 Lipreading 7 Molecular Property Prediction 7 Motion Segmentation 7 Multi-agent Reinforcement Learning 7 Multimodal Activity Recognition 7 Opinion Mining 7 Semi-Supervised Video Object Segmentation 7 Single Image Dehazing 7 Source Code Summarization 7 Speaker Diarization 7 Surface Normals Estimation 7 Table Detection 7 Text-To-Sql 7 Traffic Sign Recognition 7 Unsupervised Semantic Segmentation 7 Unsupervised Semantic Segmentation with Language-image Pre-training 7 Unsupervised Video Object Segmentation 7 Video Object Detection 7 3D Medical Imaging Segmentation 6 AMR Parsing 6 Abnormal Event Detection In Video 6 Atari Games 6 Audio Generation 6 Bayesian Inference 6 Breast Cancer Detection 6 Community Question Answering 6 Constituency Parsing 6 Cross-Lingual Question Answering 6 Dialogue Act Classification 6 Dictionary Learning 6 Document Ranking 6 EEG 6 Environmental Sound Classification 6 Explanation Generation 6 Feature Engineering 6 Few-Shot Relation Classification 6 Food Recognition 6 Formation Energy 6 Fraud Detection 6 Goal-Oriented Dialog 6 Hand-Gesture Recognition 6 LIDAR Semantic Segmentation 6 License Plate Detection 6 Lip Reading 6 Mathematical Question Answering 6 Multimodal Deep Learning 6 Multiple Instance Learning 6 Multivariate Time Series Forecasting 6 Multivariate Time Series Imputation 6 Music Transcription 6 News Classification 6 Node Clustering 6 Passage Retrieval 6 Product Recommendation 6 Program Repair 6 Robust Object Detection 6 Scene Segmentation 6 Sign Language Translation 6 Text-to-Image Generation 6 Time Series Prediction 6 Tumor Segmentation 6 Video Object Tracking 6 Video Recognition 6 Video-Based Person Re-Identification 6 Virtual Try-on 6 3D Absolute Human Pose Estimation 5 3D Classification 5 3D Face Modelling 5 3D Human Shape Estimation 5 3D Multi-Object Tracking 5 3D Point Cloud Classification 5 AMR-to-Text Generation 5 Adversarial Defense 5 Aesthetics Quality Assessment 5 Anomaly Detection In Surveillance Videos 5 Argument Mining 5 Autonomous Navigation 5 Band Gap 5 Bias Detection 5 Biomedical Information Retrieval 5 Body Detection 5 Brain Tumor Segmentation 5 Causal Inference 5 Change Point Detection 5 Chart Question Answering 5 Chatbot 5 Chinese Named Entity Recognition 5 Class-agnostic Object Detection 5 Click-Through Rate Prediction 5 Code Documentation Generation 5 Content-Based Image Retrieval 5 Core set discovery 5 Defect Detection 5 Dense Video Captioning 5 Document Text Classification 5 Entity Alignment 5 Event-based vision 5 Extractive Text Summarization 5 Face Model 5 Face Presentation Attack Detection 5 Face Sketch Synthesis 5 Feature Importance 5 Few-Shot Audio Classification 5 Fine-Grained Visual Categorization 5 Fine-Grained Visual Recognition 5 Genre classification 5 Graph Generation 5 Graph Learning 5 Handwriting Verification 5 Handwritten Digit Recognition 5 Heart rate estimation 5 Human Interaction Recognition 5 Image Deblurring 5 JPEG Artifact Correction 5 Joint Demosaicing and Denoising 5 Keyword Extraction 5 Language Acquisition 5 Lexical Entailment 5 Line Segment Detection 5 Low-Resource Neural Machine Translation 5 Material Recognition 5 Medical Image Registration 5 Medical Named Entity Recognition 5 Medical Relation Extraction 5 Motion Synthesis 5 Multi-Label Learning 5 Multi-Person Pose Estimation 5 Multimodal Emotion Recognition 5 Music Source Separation 5 Noise Level Prediction 5 Offline RL 5 imbalanced classification 5
Filter by Language
English 15 French 2 Chinese 1 Mandarin Chinese 1 Abkhazian 0 Achinese 0 Adyghe 0 Afar 0 Afrikaans 0 Akan 0 Akkadian 0 Akuntsu 0 Albanian 0 American Sign Language 0 Amharic 0 Ancient Greek 0 Ancient Hebrew 0 Apurinã 0 Arabic 0 Aragonese 0 Argentine Sign Language 0 Armenian 0 Arpitan 0 Assamese 0 Assyrian Neo-Aramaic 0 Asturian 0 Avaric 0 Aymara 0 Azerbaijani 0 Bambara 0 Bangala 0 Bangladeshi Sign Language 0 Banjar 0 Bashkir 0 Basque 0 Bavarian 0 Belarusian 0 Bengali 0 Bhojpuri 0 Bishnupriya 0 Bislama 0 Bodo (India) 0 Bosnian 0 Breton 0 Buginese 0 Bulgarian 0 Burmese 0 Catalan 0 Cebuano 0 Central Bikol 0 Central Khmer 0 Central Kurdish 0 Central Pashto 0 Chamorro 0 Chavacano 0 Chechen 0 Cherokee 0 Cheyenne 0 Choctaw 0 Chukot 0 Church Slavic 0 Chuvash 0 Congo Swahili 0 Coptic 0 Cornish 0 Corsican 0 Cree 0 Creek 0 Crimean Tatar 0 Croatian 0 Czech 0 Danish 0 Dhivehi 0 Dimli (individual language) 0 Dutch 0 Dzongkha 0 Eastern Mari 0 Egyptian Arabic 0 Erzya 0 Esperanto 0 Estonian 0 Ewe 0 Extremaduran 0 Faroese 0 Fiji Hindi 0 Fijian 0 Filipino 0 Finnish 0 Fon 0 Friulian 0 Fulah 0 Gagauz 0 Galician 0 Gan Chinese 0 Ganda 0 Geez 0 Georgian 0 German 0 German Sign Language 0 Gilaki 0 Goan Konkani 0 Gothic 0 Greek 0 Greek Sign Language 0 Guarani 0 Gujarati 0 Gulf Arabic 0 Haitian 0 Hakha Chin 0 Hakka Chinese 0 Hausa 0 Hawaiian 0 Hebrew 0 Herero 0 Hindi 0 Hiri Motu 0 Hungarian 0 Icelandic 0 Ido 0 Igbo 0 Iloko 0 Indonesian 0 Interlingua (International Auxiliary Language Association) 0 Interlingue 0 Inuktitut 0 Inupiaq 0 Iranian Persian 0 Irish 0 Italian 0 Jamaican Creole English 0 Japanese 0 Javanese 0 Jejueo 0 Kabardian 0 Kabyle 0 Kalaallisut 0 Kalmyk 0 Kannada 0 Kanuri 0 Kara-Kalpak 0 Karachay-Balkar 0 Karelian 0 Kashmiri 0 Kashubian 0 Kazakh 0 Khunsari 0 Kikuyu 0 Kinyarwanda 0 Kirghiz 0 Komi 0 Komi-Permyak 0 Komi-Zyrian 0 Kongo 0 Korean 0 Kuanyama 0 Kurdish 0 Kölsch 0 Ladino 0 Lak 0 Lao 0 Latgalian 0 Latin 0 Latvian 0 Lezghian 0 Ligurian 0 Limburgan 0 Lingala 0 Literary Chinese 0 Lithuanian 0 Livvi 0 Lojban 0 Lombard 0 Low German 0 Lower Sorbian 0 Luo (Cameroon) 0 Luo (Kenya and Tanzania) 0 Luxembourgish 0 Macedonian 0 Maithili 0 Malagasy 0 Malay (individual language) 0 Malay (macrolanguage) 0 Malayalam 0 Maltese 0 Manipuri 0 Manx 0 Maori 0 Marathi 0 Marshallese 0 Mazanderani 0 Mbyá Guaraní 0 Min Dong Chinese 0 Minangkabau 0 Mingrelian 0 Mirandese 0 Modern Greek 0 Modern Greek (1453-) 0 Moksha 0 Mongolian 0 Moroccan Arabic 0 Multilingual 0 Mundurukú 0 Narom 0 Nauru 0 Navajo 0 Naxi 0 Nayini 0 Ndonga 0 Neapolitan 0 Nepali (individual language) 0 Nepali (macrolanguage) 0 Newari 0 Nigerian Pidgin 0 Northern Frisian 0 Northern Huishui Hmong 0 Northern Kurdish 0 Northern Luri 0 Northern Sami 0 Norwegian 0 Norwegian Bokmål 0 Norwegian Nynorsk 0 Novial 0 Nyanja 0 Occitan (post 1500) 0 Odia 0 Official Aramaic (700-300 BCE) 0 Old English (ca. 450-1100) 0 Old French 0 Old Russian 0 Old Turkish 0 Oriya (macrolanguage) 0 Oromo 0 Ossetian 0 Pali 0 Pampanga 0 Pangasinan 0 Papiamento 0 Pedi 0 Pennsylvania German 0 Persian 0 Pfaelzisch 0 Picard 0 Piemontese 0 Pitcairn-Norfolk 0 Polish 0 Pontic 0 Portuguese 0 Portuguse 0 Punjabi 0 Pushto 0 Quechua 0 Rajasthani 0 Romanian 0 Romansh 0 Rundi 0 Russia Buriat 0 Russian 0 Rusyn 0 Saidi Arabic 0 Samoan 0 Sango 0 Sanskrit 0 Santali 0 Sardinian 0 Saterfriesisch 0 Scots 0 Scottish Gaelic 0 Serbian 0 Serbo-Croatian 0 Shona 0 Sichuan Yi 0 Sicilian 0 Silesian 0 Sindhi 0 Sinhala 0 Skolt Sami 0 Slovak 0 Slovenian 0 Soi 0 Somali 0 South Azerbaijani 0 South Levantine Arabic 0 Southern Sotho 0 Spanish 0 Sranan Tongo 0 Standard Arabic 0 Sundanese 0 Swahili 0 Swahili (macrolanguage) 0 Swati 0 Swedish 0 Swedish Sign Language 0 Swiss German 0 Swiss-German Sign Language 0 Tagalog 0 Tahitian 0 Tai 0 Tajik 0 Tamil 0 Tatar 0 Telugu 0 Tetum 0 Thai 0 Tibetan 0 Tigrinya 0 Tok Pisin 0 Tonga (Tonga Islands) 0 Tosk Albanian 0 Tsonga 0 Tswana 0 Tulu 0 Tumbuka 0 Tunisian Arabic 0 Tupinambá 0 Turkish 0 Turkish Sign Language 0 Turkmen 0 Tuvinian 0 Twi 0 Udmurt 0 Uighur 0 Ukrainian 0 Upper Sorbian 0 Urdu 0 Uzbek 0 Venda 0 Venetian 0 Veps 0 Vietnamese 0 Vlaams 0 Vlax Romani 0 Volapük 0 Votic 0 Walloon 0 Waray (Philippines) 0 Warlpiri 0 Welsh 0 Western Frisian 0 Western Mari 0 Western Panjabi 0 Wolof 0 Wu Chinese 0 Xhosa 0 Yakut 0 Yiddish 0 Yoruba 0 Yue Chinese 0 Zaza 0 Zeeuws 0 Zhuang 0 Zulu 0

61 dataset results for Instance Segmentation

COCO (Microsoft Common Objects in Context)

The MS COCO (Microsoft Common Objects in Context) dataset is a large-scale object detection, segmentation, key-point detection, and captioning dataset. The dataset consists of 328K images.

7,057 PAPERS • 83 BENCHMARKS

Cityscapes

Cityscapes is a large-scale database which focuses on semantic understanding of urban street scenes. It provides semantic, instance-wise, and dense pixel annotations for 30 classes grouped into 8 categories (flat surfaces, humans, vehicles, constructions, objects, nature, sky, and void). The dataset consists of around 5000 fine annotated images and 20000 coarse annotated ones. Data was captured in 50 cities during several months, daytimes, and good weather conditions. It was originally recorded as video so the frames were manually selected to have the following features: large number of dynamic objects, varying scene layout, and varying background.

2,534 PAPERS • 37 BENCHMARKS

nuScenes

The nuScenes dataset is a large-scale autonomous driving dataset. The dataset has 3D bounding boxes for 1000 scenes collected in Boston and Singapore. Each scene is 20 seconds long and annotated at 2Hz. This results in a total of 28130 samples for training, 6019 samples for validation and 6008 samples for testing. The dataset has the full autonomous vehicle data suite: 32-beam LiDAR, 6 cameras and radars with complete 360° coverage. The 3D object detection challenge evaluates the performance on 10 classes: cars, trucks, buses, trailers, construction vehicles, pedestrians, motorcycles, bicycles, traffic cones and barriers.

739 PAPERS • 15 BENCHMARKS

ADE20K

The ADE20K semantic segmentation dataset contains more than 20K scene-centric images exhaustively annotated with pixel-level objects and object parts labels. There are totally 150 semantic categories, which include stuffs like sky, road, grass, and discrete objects like person, car, bed.

604 PAPERS • 16 BENCHMARKS

NYUv2 (NYU-Depth V2)

The NYU-Depth V2 data set is comprised of video sequences from a variety of indoor scenes as recorded by both the RGB and Depth cameras from the Microsoft Kinect. It features:

601 PAPERS • 17 BENCHMARKS

LVIS

LVIS is a dataset for long tail instance segmentation. It has annotations for over 1000 object categories in 164k images.

194 PAPERS • 7 BENCHMARKS

BDD100K

Datasets drive vision progress, yet existing driving datasets are impoverished in terms of visual content and supported tasks to study multitask learning for autonomous driving. Researchers are usually constrained to study a small set of problems on one dataset, while real-world computer vision applications require performing tasks of various complexities. We construct BDD100K, the largest driving video dataset with 100K videos and 10 tasks to evaluate the exciting progress of image recognition algorithms on autonomous driving. The dataset possesses geographic, environmental, and weather diversity, which is useful for training models that are less likely to be surprised by new conditions. Based on this diverse dataset, we build a benchmark for heterogeneous multitask learning and study how to solve the tasks together. Our experiments show that special training strategies are needed for existing models to perform such heterogeneous tasks. BDD100K opens the door for future studies in thi

162 PAPERS • 13 BENCHMARKS

YouTubeVIS

YouTubeVIS is a new dataset tailored for tasks like simultaneous detection, segmentation and tracking of object instances in videos and is collected based on the current largest video object segmentation dataset YouTubeVOS.

96 PAPERS • 2 BENCHMARKS

PartNet

PartNet is a consistent, large-scale dataset of 3D objects annotated with fine-grained, instance-level, and hierarchical 3D part information. The dataset consists of 573,585 part instances over 26,671 3D models covering 24 object categories. This dataset enables and serves as a catalyst for many tasks such as shape analysis, dynamic 3D scene modeling and simulation, affordance analysis, and others.

89 PAPERS • 3 BENCHMARKS

Objects365

Objects365 is a large-scale object detection dataset, Objects365, which has 365 object categories over 600K training images. More than 10 million, high-quality bounding boxes are manually labeled through a three-step, carefully designed annotation pipeline. It is the largest object detection dataset (with full annotation) so far and establishes a more challenging benchmark for the community.

58 PAPERS • 1 BENCHMARK

KITTI-360

KITTI-360 is a large-scale dataset that contains rich sensory information and full annotations. It is the successor of the popular KITTI dataset, providing more comprehensive semantic/instance labels in 2D and 3D, richer 360 degree sensory information (fisheye images and pushbroom laser scans), very accurate and geo-localized vehicle and camera poses, and a series of new challenging benchmarks.

40 PAPERS • 1 BENCHMARK

WildDash

WildDash is a benchmark evaluation method is presented that uses the meta-information to calculate the robustness of a given algorithm with respect to the individual hazards.

35 PAPERS • 2 BENCHMARKS

iSAID

iSAID contains 655,451 object instances for 15 categories across 2,806 high-resolution images. The images of iSAID is the same as the DOTA-v1.0 dataset, which are manily collected from the Google Earth, some are taken by satellite JL-1, the others are taken by satellite GF-2 of the China Centre for Resources Satellite Data and Application.

30 PAPERS • 3 BENCHMARKS

Hypersim

For many fundamental scene understanding tasks, it is difficult or impossible to obtain per-pixel ground truth labels from real images. Hypersim is a photorealistic synthetic dataset for holistic indoor scene understanding. It contains 77,400 images of 461 indoor scenes with detailed per-pixel labels and corresponding ground truth geometry.

24 PAPERS • 1 BENCHMARK

ScribbleSup (PASCAL-Scribble Dataset)

The PASCAL-Scribble Dataset is an extension of the PASCAL dataset with scribble annotations for semantic segmentation. The annotations follow two different protocols. In the first protocol, the PASCAL VOC 2012 set is annotated, with 20 object categories (aeroplane, bicycle, ...) and one background category. There are 12,031 images annotated, including 10,582 images in the training set and 1,449 images in the validation set. In the second protocol, the 59 object/stuff categories and one background category involved in the PASCAL-CONTEXT dataset are used. Besides the 20 object categories in the first protocol, there are 39 extra categories (snow, tree, ...) included. This protocol is followed to annotate the PASCAL-CONTEXT dataset. 4,998 images in the training set have been annotated.

22 PAPERS • NO BENCHMARKS YET

SIXray

The SIXray dataset is constructed by the Pattern Recognition and Intelligent System Development Laboratory, University of Chinese Academy of Sciences. It contains 1,059,231 X-ray images which are collected from some several subway stations. There are six common categories of prohibited items, namely, gun, knife, wrench, pliers, scissors and hammer. It has three subsets called SIXray10, SIXray100 and SIXray1000, There are image-level annotations provided by human security inspectors for the whole dataset. In addition the images in the test set are annotated with a bounding-box for each prohibited item to evaluate the performance of object localization.

21 PAPERS • 1 BENCHMARK

STPLS3D

Our project (STPLS3D) aims to provide a large-scale aerial photogrammetry dataset with synthetic and real annotated 3D point clouds for semantic and instance segmentation tasks.

20 PAPERS • 2 BENCHMARKS

OCID (Object Clutter Indoor Dataset)

Developing robot perception systems for handling objects in the real-world requires computer vision algorithms to be carefully scrutinized with respect to the expected operating domain. This demands large quantities of ground truth data to rigorously evaluate the performance of algorithms.

13 PAPERS • 1 BENCHMARK

3D-FUTURE

3D-FUTURE (3D FUrniture shape with TextURE) is a 3D dataset that contains 20,240 photo-realistic synthetic images captured in 5,000 diverse scenes, and 9,992 involved unique industrial 3D CAD shapes of furniture with high-resolution informative textures developed by professional designers.

10 PAPERS • NO BENCHMARKS YET

GRIT (General Robust Image Task Benchmark)

The General Robust Image Task (GRIT) Benchmark is an evaluation-only benchmark for evaluating the performance and robustness of vision systems across multiple image prediction tasks, concepts, and data sources. GRIT hopes to encourage our research community to pursue the following research directions:

9 PAPERS • 7 BENCHMARKS

AIRS
AIRS

The AIRS (Aerial Imagery for Roof Segmentation) dataset provides a wide coverage of aerial imagery with 7.5 cm resolution and contains over 220,000 buildings. The task posed for AIRS is defined as roof segmentation.

8 PAPERS • 1 BENCHMARK

Fashionpedia
Fashionpedia

Fashionpedia consists of two parts: (1) an ontology built by fashion experts containing 27 main apparel categories, 19 apparel parts, 294 fine-grained attributes and their relationships; (2) a dataset with everyday and celebrity event fashion images annotated with segmentation masks and their associated per-mask fine-grained attributes, built upon the Fashionpedia ontology.

7 PAPERS • NO BENCHMARKS YET

TACO

TACO is a growing image dataset of waste in the wild. It contains images of litter taken under diverse environments: woods, roads and beaches. These images are manually labelled and segmented according to a hierarchical taxonomy to train and evaluate object detection algorithms. The annotations are provided in COCO format.

7 PAPERS • NO BENCHMARKS YET

SpaceNet 2 (SpaceNet 2: Building Detection v2)

SpaceNet 2: Building Detection v2 - is a dataset for building footprint detection in geographically diverse settings from very high resolution satellite images. It contains over 302,701 building footprints, 3/8-band Worldview-3 satellite imagery at 0.3m pixel res., across 5 cities (Rio de Janeiro, Las Vegas, Paris, Shanghai, Khartoum), and covers areas that are both urban and suburban in nature. The dataset was split using 60%/20%/20% for train/test/validation.

5 PAPERS • 1 BENCHMARK

UVO (Unidentified Video Objects: A Benchmark for Dense, Open-World Segmentation)

UVO is a new benchmark for open-world class-agnostic object segmentation in videos. Besides shifting the problem focus to the open-world setup, UVO is significantly larger, providing approximately 8 times more videos compared with DAVIS, and 7 times more mask (instance) annotations per video compared with YouTube-VOS and YouTube-VIS. UVO is also more challenging as it includes many videos with crowded scenes and complex background motions. Some highlights of the dataset include:

5 PAPERS • NO BENCHMARKS YET

KINS
KINS

Augments the KITTI with more instance pixel-level annotation for 8 categories.

4 PAPERS • 1 BENCHMARK

LIVECell (Label-free In Vitro image Examples of Cells)

The LIVECell (Label-free In Vitro image Examples of Cells) dataset is a large-scale microscopic image dataset for instance-segmentation of individual cells in 2D cell cultures.

4 PAPERS • 1 BENCHMARK

CryoNuSeg

CryoNuSeg is a fully annotated FS-derived cryosectioned and H&E-stained nuclei instance segmentation dataset. The dataset contains images from 10 human organs that were not exploited in other publicly available datasets, and is provided with three manual mark-ups to allow measuring intra-observer and inter-observer variability.

3 PAPERS • NO BENCHMARKS YET

Fraunhofer IPA Bin-Picking

The Fraunhofer IPA Bin-Picking dataset is a large-scale dataset comprising both simulated and real-world scenes for various objects (potentially having symmetries) and is fully annotated with 6D poses. A pyhsics simulation is used to create scenes of many parts in bulk by dropping objects in a random position and orientation above a bin. Additionally, this dataset extends the Siléane dataset by providing more samples. This allows to e.g. train deep neural networks and benchmark the performance on the public Siléane dataset

3 PAPERS • NO BENCHMARKS YET

ISBDA
ISBDA

Consists of user-generated aerial videos from social media with annotations of instance-level building damage masks. This provides the first benchmark for quantitative evaluation of models to assess building damage using aerial videos.

3 PAPERS • NO BENCHMARKS YET

RobotPush

RobotPush is a dataset for object singulation – the task of separating cluttered objects through physical interaction. The dataset contains 3456 training images with labels and 1024 validation images with labels. It consists of simulated and real-world data collected from a PR2 robot that equipped with a Kinect 2 camera. The dataset also contains ground truth instance segmentation masks for 110 images in the test set.

3 PAPERS • NO BENCHMARKS YET

SpaceNet 1 (SpaceNet 1: Building Detection v1)

SpaceNet 1: Building Detection v1 is a dataset for building footprint detection. The data is comprised of 382,534 building footprints, covering an area of 2,544 sq. km of 3/8 band WorldView-2 imagery (0.5 m pixel res.) across the city of Rio de Janeiro, Brazil. The images are processed as 200m×200m tiles with associated building footprint vectors for training.

3 PAPERS • 2 BENCHMARKS

TTPLA (Transmission Towers and Power Lines (TTPLA))

TTPLA is a public dataset which is a collection of aerial images on Transmission Towers (TTs) and Power Lines (PLs). It can be used for detection and segmentation of transmission towers and power lines. It consists of 1,100 images with the resolution of 3,840×2,160 pixels, as well as manually labelled 8,987 instances of TTs and PLs.

3 PAPERS • NO BENCHMARKS YET

TrashCan

The TrashCan dataset is an instance-segmentation dataset of underwater trash. It is comprised of annotated images (7,212 images) which contain observations of trash, ROVs, and a wide variety of undersea flora and fauna. The annotations in this dataset take the format of instance segmentation annotations: bitmaps containing a mask marking which pixels in the image contain each object. The imagery in TrashCan is sourced from the J-EDI (JAMSTEC E-Library of Deep-sea Images) dataset, curated by the Japan Agency of Marine Earth Science and Technology (JAMSTEC).

3 PAPERS • NO BENCHMARKS YET

WGISD (Embrapa Wine Grape Instance Segmentation Dataset)

Embrapa Wine Grape Instance Segmentation Dataset (WGISD) contains grape clusters properly annotated in 300 images and a novel annotation methodology for segmentation of complex objects in natural images.

3 PAPERS • NO BENCHMARKS YET

MVTec D2S (MVTec Densely Segmented Supermarket)

MVTec D2S is a benchmark for instance-aware semantic segmentation in an industrial domain. It contains 21,000 high-resolution images with pixel-wise labels of all object instances. The objects comprise groceries and everyday products from 60 categories. The benchmark is designed such that it resembles the real-world setting of an automatic checkout, inventory, or warehouse system. The training images only contain objects of a single class on a homogeneous background, while the validation and test sets are much more complex and diverse.

2 PAPERS • NO BENCHMARKS YET

Occluded COCO

Occluded COCO is automatically generated subset of COCO val dataset, collecting partially occluded objects for a large variety of categories in real images in a scalable manner, where target object is partially occluded but the segmentation mask is connected.

2 PAPERS • 1 BENCHMARK

Separated COCO

Separated COCO is automatically generated subsets of COCO val dataset, collecting separated objects for a large variety of categories in real images in a scalable manner, where target object segmentation mask is separated into distinct regions by the occluder.

2 PAPERS • 1 BENCHMARK

TBBR (Thermal Bridges on Building Rooftops)

The dataset of Thermal Bridges on Building Rooftops (TBBR dataset) consists of annotated combined RGB and thermal drone images with a height map. All images were converted to a uniform format of 3000$\times$4000 pixels, aligned, and cropped to 2400$\times$3400 to remove empty borders.

2 PAPERS • 2 BENCHMARKS

WISDOM
WISDOM (Warehouse Instance Segmentation Dataset for Object Manipulation)

Synthetic training dataset of 50,000 depth images and 320,000 object masks using simulated heaps of 3D CAD models.

2 PAPERS • 1 BENCHMARK

BPCIS (Bacterial Phase Contrast for Instance Segementation)

BPCIS is collection of 364 bacterial phase contrast images and corresponding label matrices for instance segmentation. Labels were made according to fluorescence channels where possible. Prior to manual annotation, images were automatically cropped into microcolonies and tiled into ensemble images to reduce the empty (non-cell) image regions for training and testing. Subsequent to annotation, we performed non-rigid registration of phase contrast to cell masks.

1 PAPER • NO BENCHMARKS YET

CCSE (Chinese Character Stroke Extraction)

Chinese Character Stroke Extraction (CCSE) is a benchmark containing two large-scale datasets: Kaiti CCSE (CCSE-Kai) and Handwritten CCSE (CCSE-HW). It is designed for stroke extraction problems.

1 PAPER • NO BENCHMARKS YET

DeepSportRadar-v1

DeepSportradar is a benchmark suite of computer vision tasks, datasets and benchmarks for automated sport understanding. DeepSportradar currently supports four challenging tasks related to basketball: ball 3D localization, camera calibration, player instance segmentation and player re-identification. For each of the four tasks, a detailed description of the dataset, objective, performance metrics, and the proposed baseline method are provided.

1 PAPER • NO BENCHMARKS YET

HT1080WT cells - 3D collagen type I matrices
HT1080WT cells - 3D collagen type I matrices (HT1080WT cells embedded in 3D collagen type I matrices - manual annotations for cell instance segmentation and tracking)

Human fibrosarcoma HT1080WT (ATCC) cells at low cell densities embedded in 3D collagen type I matrices [1]. The time-lapse videos were recorded every 2 minutes for 16.7 hours and covered a field of view of 1002 pixels × 1004 pixels with a pixel size of 0.802 μm/pixel The videos were pre-processed to correct frame-to-frame drift artifacts, resulting in a final size of 983 pixels × 985 pixels pixels.

1 PAPER • NO BENCHMARKS YET

ICDAR 2021 Competition on Historical Map Segmentation

Revision: v1.0.0-full-20210527a DOI: 10.5281/zenodo.4817662 Authors: J. Chazalon, E. Carlinet, Y. Chen, J. Perret, C. Mallet, B. Duménieu and T. Géraud Official competition website: https://icdar21-mapseg.github.io/

1 PAPER • NO BENCHMARKS YET

Image-based size estimation of broccoli heads under varying degrees of occlusion

This publicly available dataset contains 1613 RGB-D images of field-grown broccoli plants. The dataset also includes the polygon and circle annotations of the broccoli heads.

1 PAPER • NO BENCHMARKS YET

Lindenthal Camera Traps

This data set contains 775 video sequences, captured in the wildlife park Lindenthal (Cologne, Germany) as part of the AMMOD project, using an Intel RealSense D435 stereo camera. In addition to color and infrared images, the D435 is able to infer the distance (or “depth”) to objects in the scene using stereo vision. Observed animals include various birds (at daytime) and mammals such as deer, goats, sheep, donkeys, and foxes (primarily at nighttime). A subset of 412 images is annotated with a total of 1038 individual animal annotations, including instance masks, bounding boxes, class labels, and corresponding track IDs to identify the same individual over the entire video.

1 PAPER • NO BENCHMARKS YET

MIS-Check Dam (Minor Irrigation Structures- Check Dam)

Minor Irrigation Structures Check-Dam Dataset is a public dataset annotated by domain experts using images from Google static map for instance segmentation and object detection tasks.

1 PAPER • NO BENCHMARKS YET

Contact us on: hello@paperswithcode.com . Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Data policy Cookies policy