Datasets

8,568 machine learning datasets
🔔   Share your dataset with the ML community!
Filter by Modality
Texts 190 Images 58 Audio 17 Videos 17 Speech 14 Medical 12 3D 4 Graphs 4 LiDAR 4 Tabular 3 Time series 3 Environment 2 Point cloud 2 RGB Video 2 3d meshes 1 Actions 1 Biomedical 1 Interactive 1 Lyrics 1 Parallel 1 RGB-D 1 Ranking 1 Stereo 1 6D 0 Biology 0 Cad 0 Dialog 0 EEG 0 Financial 0 Hyperspectral images 0 MRI 0 Midi 0 Music 0 PSG 0 Physics 0 Replay data 0 Tables 0 Tracking 0 fMRI 0
Filter by Task
Question Answering 20 Machine Translation 16 Language Modelling 15 Reading Comprehension 14 Text Generation 12 Machine Reading Comprehension 10 Named Entity Recognition (NER) 9 Text Summarization 9 Scene Text Detection 8 Speech Recognition 8 Text Classification 8 Dialogue Generation 7 Natural Language Inference 7 Task-Oriented Dialogue Systems 7 Cross-Lingual Transfer 6 Domain Adaptation 6 Chinese Named Entity Recognition 5 Image Classification 5 Natural Language Understanding 5 Object Detection 5 Relation Extraction 5 SSTOD 5 Semantic Segmentation 5 Sentiment Analysis 5 Slot Filling 5 Translation 5 Word Embeddings 5 Chinese Reading Comprehension 4 Conversational Response Selection 4 License Plate Detection 4 Misinformation 4 Open-Domain Dialog 4 Optical Character Recognition (OCR) 4 Part-Of-Speech Tagging 4 Question Generation 4 Token Classification 4 Video Captioning 4 Abstractive Text Summarization 3 Chinese Word Segmentation 3 Classification 3 Cloze (multi-choices) (Few-Shot) 3 Cloze (multi-choices) (One-Shot) 3 Cloze (multi-choices) (Zero-Shot) 3 Coreference Resolution 3 Cross-Lingual NER 3 Cross-Lingual Question Answering 3 Data Augmentation 3 Document Summarization 3 Entity Alignment 3 Fake News Detection 3 Grammatical Error Correction 3 Image Generation 3 Instance Segmentation 3 Intent Detection 3 Language Identification 3 Link Prediction 3 Medical Image Segmentation 3 Multi-Label Classification 3 Multi-Task Learning 3 Neural Architecture Search 3 Open-Domain Question Answering 3 Pose Estimation 3 Reading Comprehension (Few-Shot) 3 Reading Comprehension (One-Shot) 3 Reading Comprehension (Zero-Shot) 3 Scene Text Recognition 3 Semantic Similarity 3 Speaker Diarization 3 Style Transfer 3 Unsupervised Domain Adaptation 3 Zero-Shot Cross-Lingual Transfer 3 Zero-Shot Learning 3 3D Lane Detection 2 Automatic Post-Editing 2 Chinese Sentence Pair Classification 2 Class-agnostic Object Detection 2 Code Generation 2 Computed Tomography (CT) 2 Conditional Image Generation 2 Conversational Response Generation 2 Cross-Lingual Natural Language Inference 2 Cross-Lingual POS Tagging 2 Cross-Modal Retrieval 2 Depth Estimation 2 Dialogue Understanding 2 Emotion Recognition 2 Emotion Recognition in Conversation 2 Entity Linking 2 Entity Typing 2 Event Detection 2 Event Extraction 2 FLUE 2 Generalized Zero-Shot Learning 2 Hate Speech Detection 2 Image Captioning 2 Image Dehazing 2 Image Inpainting 2 Image Retrieval 2 Image Super-Resolution 2 Intent Classification 2 Knowledge Distillation 2 Knowledge Graphs 2 License Plate Recognition 2 Math Word Problem Solving 2 Max-Shot Cross-Lingual Visual Reasoning 2 Meta-Learning 2 Multi-Document Summarization 2 Multi-Label Text Classification 2 Multi-Person Pose Estimation 2 Multi-modal Entity Alignment 2 Multimodal Emotion Recognition 2 Multivariate Time Series Forecasting 2 Node Classification 2 Novel View Synthesis 2 Object Localization 2 Object Proposal Generation 2 Panoptic Segmentation 2 Paraphrase Generation 2 Quantization 2 Real-Time Object Detection 2 Real-time Instance Segmentation 2 Recommendation Systems 2 Relation Classification 2 Robotic Grasping 2 Speaker Recognition 2 Speech Separation 2 Speech-to-Text Translation 2 Spelling Correction 2 Spoken Language Understanding 2 Text Matching 2 Text Spotting 2 Text-To-Speech Synthesis 2 Time Series Forecasting 2 Visual Question Answering (VQA) 2 Visual Reasoning 2 Weakly Supervised Object Detection 2 Zero-Shot Cross-Lingual Visual Reasoning 2 Zero-Shot Object Detection 2 3D Depth Estimation 1 3D Multi-Object Tracking 1 3D Multi-Person Pose Estimation 1 3D Multi-Person Pose Estimation (absolute) 1 3D Multi-Person Pose Estimation (root-relative) 1 3D Object Classification 1 3D Object Detection 1 3D Object Detection From Stereo Images 1 3D Object Recognition 1 3D Object Retrieval 1 3D Object Tracking 1 3D Point Cloud Classification 1 3D Point Cloud Data Augmentation 1 3D Point Cloud Linear Classification 1 3D Single Object Tracking 1 A-VB Culture 1 A-VB High 1 A-VB Two 1 Abusive Language 1 Action Recognition 1 Action Segmentation 1 Active Object Detection 1 Activeness Detection 1 Adversarial Defense 1 Adversarial Robustness 1 Age Estimation 1 Anchor link prediction 1 Answer Generation 1 Arithmetic Reasoning 1 Aspect-Based Sentiment Analysis (ABSA) 1 Aspect-Category-Opinion-Sentiment Quadruple Extraction 1 Audio Classification 1 Audio Source Separation 1 Audio-Visual Speech Recognition 1 Automatic Speech Recognition 1 Automatic Speech Recognition (ASR) 1 Autonomous Driving 1 Binarization 1 Biologically-plausible Training 1 Birds Eye View Object Detection 1 Blood pressure estimation 1 Box-supervised Instance Segmentation 1 CW Attack Detection 1 Catalog Extraction 1 Causal Inference 1 Chinese Landscape Painting Generation 1 Citation Recommendation 1 Classification Consistency 1 Classification with Binary Neural Network 1 Classification with Binary Weight Network 1 Clinical Concept Extraction 1 Code Search 1 Colon Cancer Detection In Confocal Laser Microscopy Images 1 Color Image Denoising 1 Colorectal Gland Segmentation: 1 Colorectal Polyps Characterization 1 Common Sense Reasoning 1 Common Sense Reasoning (Few-Shot) 1 Common Sense Reasoning (One-Shot) 1 Common Sense Reasoning (Zero-Shot) 1 Complex Query Answering 1 Connective Detection 1 Continual Learning 1 Contrastive Learning 1 Conversational Sentiment Quadruple Extraction 1 Cross-Lingual ASR 1 Cross-Lingual Abstractive Summarization 1 Cross-Lingual Bitext Mining 1 Cross-Lingual Document Classification 1 Cross-Lingual Entity Linking 1 Cross-Lingual Paraphrase Identification 1 Cross-Lingual Sentiment Classification 1 Cross-lingual zero-shot dependency parsing 1 Cultural Vocal Bursts Intensity Prediction 1 Curved Text Detection 1 Data Free Quantization 1 Decipherment 1 Dense Pixel Correspondence Estimation 1 Density Estimation 1 Dependency Parsing 1 Depth Completion 1 Dialog Act Classification 1 Dialog Relation Extraction 1 Dialogue Act Classification 1 Dialogue State Tracking 1 Dimensionality Reduction 1 Discourse Parsing 1 Discourse Segmentation 1 Document AI 1 Document Classification 1 Document Level Machine Translation 1 Document Translation 1 Document-level Event Extraction 1 Domain Generalization 1 Emotion-Cause Pair Extraction 1 Emotional Dialogue Acts 1 End-To-End Dialogue Modelling 1 Entity Disambiguation 1 Entity Resolution 1 Explainable artificial intelligence 1 Explanation Generation 1 FG-1-PG-1 1 Face Age Editing 1 Face Anonymization 1 Face Generation 1 Face Swapping 1 Face Transfer 1 Face Verification 1 Feature Engineering 1 Few-Shot 3D Point Cloud Classification 1 Few-Shot Audio Classification 1 Few-Shot Image Classification 1 Few-Shot Learning 1 Few-Shot Object Detection 1 Few-Shot Point Cloud Classification 1 Few-shot NER 1 Fine-Grained Action Detection 1 Font Generation 1 Food Recognition 1 Generalized Zero-Shot Object Detection 1 Genre classification 1 Gesture Generation 1 Gesture Recognition 1 Gloss-free Sign Language Translation 1 Grammatical Error Detection 1 Handwritten Chinese Text Recognition 1 Histopathological Image Classification 1 Homography Estimation 1 Horizon Line Estimation 1 Hypertension detection 1 Image Classification with Differential Privacy 1 Image Clustering 1 Image Colorization 1 Image Compressed Sensing 1 Image Compression 1 Image Deblurring 1 Image Outpainting 1 Image to Point Cloud Registration 1 Image-level Supervised Instance Segmentation 1 Image-to-Image Translation 1 Image-to-Text Retrieval 1 Implicit Discourse Relation Classification 1 Incremental Learning 1 Information Retrieval 1 Intent Recognition 1 Interactive Segmentation 1 JPEG Decompression 1 Key Information Extraction 1 Keypoint Detection 1 Keyword Extraction 1 Knowledge Graph Completion 1 LABELED_DEPENDENCIES 1 LEMMA 1 Layout-to-Image Generation 1 Learning with noisy labels 1 Length-of-Stay prediction 1 Linear-Probe Classification 1 Liver Segmentation 1 Long-tail Learning 1 Low-Resource Neural Machine Translation 1 Lung Nodule Detection 1 MORPH 1 Max-Shot Cross-Lingual Image-to-Text Retrieval 1 Max-Shot Cross-Lingual Text-to-Image Retrieval 1 Max-Shot Cross-Lingual Visual Natural Language Inference 1 Max-Shot Cross-Lingual Visual Question Answering 1 Medical Code Prediction 1 Medical Concept Normalization 1 Medical Diagnosis 1 Medical Relation Extraction 1 Medical Visual Question Answering 1 Metric Learning 1 Micro-Expression Recognition 1 Model Compression 1 Monocular 3D Object Detection 1 Monocular Cross-View Road Scene Parsing(Vehicle) 1 Monocular Depth Estimation 1 Morphological Analysis 1 Mortality Prediction 1 Multi-Choice MRC 1 Multi-Label Classification Of Biomedical Texts 1 Multi-Label Image Classification 1 Multi-Label Learning 1 Multi-Object Tracking 1 Multi-agent Reinforcement Learning 1 Multi-modal Dialogue Generation 1 Multi-object discovery 1 Multi-task Language Understanding 1 Multilingual Machine Comprehension in English Hindi 1 Multilingual NLP 1 Multilingual Named Entity Recognition 1 Multilingual text classification 1 Multimodal Sentiment Analysis 1 Multiple Instance Learning 1 Multiple Object Tracking 1 Multiple-choice 1 Music Information Retrieval 1 Music Source Separation 1 NER 1 Named Entity Recognition 1 Natural Language Inference (Few-Shot) 1 Natural Language Inference (One-Shot) 1 Natural Language Inference (Zero-Shot) 1 Natural Questions 1 Network Pruning 1 Neural Network Compression 1 Node Clustering 1 Non-exemplar-based Class Incremental Learning 1 Object Counting 1 Object Detection In Aerial Images 1 Object Recognition 1 Object Tracking 1 Offline Handwritten Chinese Character Recognition 1 Offline RL 1 One-Shot Instance Segmentation 1 One-Shot Object Detection 1 One-stage Anchor-free Oriented Object Detection 1 Open Information Extraction 1 Open Vocabulary Object Detection 1 Open World Object Detection 1 Open-World Semi-Supervised Learning 1 Open-set video tagging 1 Optical Flow Estimation 1 Out-of-Distribution Detection 1 Outlier Detection 1 POS 1 Parameter Prediction 1 Paraphrase Identification 1 Partial Domain Adaptation 1 Passage Retrieval 1 Pedestrian Attribute Recognition 1 Person Re-Identification 1 Personality Recognition in Conversation 1 Personality Trait Recognition 1 Personalized and Emotional Conversation 1 Phrase Grounding 1 Point Cloud Registration 1 Point-Supervised Instance Segmentation 1 Poll Generation 1 Polyphone disambiguation 1 Prediction Of Occupancy Grid Maps 1 Pretrained Multilingual Language Models 1 Prompt Engineering 1 Propaganda technique identification 1 Protein Secondary Structure Prediction 1 Question Similarity 1 Real-Time Semantic Segmentation 1 Record linking 1 Region Proposal 1 Relation Linking 1 Retrieval 1 Robust Object Detection 1 Robust classification 1 SENTS 1 Scene Flow Estimation 1 Self-Supervised Image Classification 1 Self-Supervised Learning 1 Semantic Frame Parsing 1 Semantic Role Labeling 1 Semantic Textual Similarity 1 Semi Supervised Learning for Image Captioning 1 Semi-Supervised Image Classification 1 Sentence Classification 1 Sentence Embeddings 1 Short-Text Conversation 1 Sign Language Recognition 1 Sign Language Retrieval 1 Sign Language Translation 1 Single-object discovery 1 Small Data Image Classification 1 Span-Extraction MRC 1 Sparse Learning 1 Spatio-Temporal Forecasting 1 Speaker Verification 1 Speech Emotion Recognition 1 Speech Synthesis 1 Speech-to-Speech Translation 1 Stereo Depth Estimation 1 Stereo Disparity Estimation 1 Stochastic Optimization 1 Stock Market Prediction 1 Stock Prediction 1 Stock Price Prediction 1 Stock Trend Prediction 1 Story Completion 1 TAG 1 Term Extraction 1 Text Effects Transfer 1 Text Simplification 1 Text Style Transfer 1 Text to Video Retrieval 1 Text-Based Stock Prediction 1 Text-To-SQL 1 Text-to-Image Generation 1 Text-to-video search 1 Training-free 3D Point Cloud Classification 1 Trajectory Prediction 1 Transfer Learning 1 Tumor Segmentation 1 UNLABELED_DEPENDENCIES 1 Unconditional Image Generation 1 Univariate Time Series Forecasting 1 Unsupervised 3D Multi-Person Pose Estimation 1 Unsupervised Image Classification 1 Unsupervised Monocular Depth Estimation 1 Unsupervised Object Detection 1 Unsupervised Object Localization 1 Unsupervised Semantic Segmentation 1 Unsupervised Semantic Segmentation with Language-image Pre-training 1 Urdu Speech Recognition 1 Variational Inference 1 Vehicle Pose Estimation 1 Vehicle Re-Identification 1 Video Inpainting 1 Video Matting 1 Video Prediction 1 Video Question Answering 1 Video Retrieval 1 Video-Text Retrieval 1 Vietnamese Machine Reading Comprehension 1 Vision-Language Navigation 1 Visual Odometry 1 Visual Place Recognition 1 Visual Question Answering 1 Vocal Bursts Intensity Prediction 1 Vocal Bursts Type Prediction 1 Vocal Bursts Valence Prediction 1 Voice Conversion 1 Weakly Supervised Action Localization 1 Weakly-Supervised Named Entity Recognition 1 Weakly-Supervised Object Localization 1 Weakly-supervised instance segmentation 1 Weather Forecasting 1 Word Sense Disambiguation 1 XLM-R 1 Zero-Shot Cross-Lingual Image-to-Text Retrieval 1 Zero-Shot Cross-Lingual Text-to-Image Retrieval 1 Zero-Shot Cross-Lingual Visual Natural Language Inference 1 Zero-Shot Cross-Lingual Visual Question Answering 1 Zero-Shot Cross-Modal Retrieval 1 Zero-Shot Transfer 3D Point Cloud Classification 1 Zero-Shot Transfer Image Classification 1 Zero-Shot Video Retrieval 1 Zero-shot 3D Point Cloud Classification 1 Zero-shot Image Retrieval 1 coreference-resolution 1 multi-word expression embedding 1 multi-word expression sememe prediction 1 object-detection 1 speech-recognition 1 text annotation 1 text2text-generation 1
Filter by Language (clear)
Chinese English 2484 German 160 French 136 Russian 108 Spanish 108 Arabic 77 Japanese 77 Italian 75 Portuguese 64 Hindi 59 Korean 53 Turkish 48 Vietnamese 43 Dutch 41 Bengali 40 Persian 40 Polish 37 Tamil 36 Czech 35 Indonesian 32 Danish 29 Finnish 29 Romanian 29 Telugu 27 Urdu 25 Marathi 24 Multilingual 24 Hungarian 23 Malayalam 22 Swedish 21 Thai 21 Estonian 20 Greek 20 Hebrew 20 Basque 19 Bulgarian 19 Gujarati 18 Mandarin Chinese 18 Kannada 17 Punjabi 16 Slovak 16 Ukrainian 16 Norwegian 15 Slovenian 15 Catalan 14 Croatian 14 Latvian 14 Lithuanian 13 Swahili 13 Assamese 12 Kazakh 12 Amharic 11 Serbian 11 Albanian 10 Armenian 10 Iranian Persian 10 Irish 9 Kurdish 9 Maltese 9 Oriya (macrolanguage) 9 Sinhala 9 Welsh 9 American Sign Language 8 Breton 8 Georgian 8 Icelandic 8 Macedonian 8 Mongolian 8 Sanskrit 8 Yoruba 8 Afrikaans 7 Azerbaijani 7 Burmese 7 Esperanto 7 Hausa 7 Igbo 7 Odia 7 Uzbek 7 Galician 6 Malay (individual language) 6 Oromo 6 Sindhi 6 Somali 6 Tagalog 6 Bambara 5 Belarusian 5 Central Kurdish 5 Egyptian Arabic 5 Filipino 5 Guarani 5 Haitian 5 Javanese 5 Latin 5 Malagasy 5 Nepali (macrolanguage) 5 Norwegian Bokmål 5 Norwegian Nynorsk 5 Quechua 5 Scottish Gaelic 5 Serbo-Croatian 5 Standard Arabic 5 Sundanese 5 Tigrinya 5 Wolof 5 Bosnian 4 Central Khmer 4 Chechen 4 Dhivehi 4 Fulah 4 Ganda 4 Iloko 4 Kabyle 4 Kinyarwanda 4 Kirghiz 4 Lao 4 Lingala 4 Nigerian Pidgin 4 South Azerbaijani 4 Tatar 4 Tibetan 4 Upper Sorbian 4 Aragonese 3 Bashkir 3 Bavarian 3 Bishnupriya 3 Cebuano 3 Chuvash 3 Erzya 3 Faroese 3 Fon 3 Goan Konkani 3 Maithili 3 Malay (macrolanguage) 3 Nyanja 3 Romansh 3 Russia Buriat 3 Swati 3 Swiss German 3 Tajik 3 Tsonga 3 Tswana 3 Twi 3 Uighur 3 Waray (Philippines) 3 Western Panjabi 3 Xhosa 3 Yiddish 3 Asturian 2 Avaric 2 Aymara 2 Bangala 2 Bhojpuri 2 Central Bikol 2 Cherokee 2 Church Slavic 2 Cornish 2 Dimli (individual language) 2 Eastern Mari 2 Ewe 2 German Sign Language 2 Gothic 2 Gulf Arabic 2 Ido 2 Interlingue 2 Inuktitut 2 Jejueo 2 Kalaallisut 2 Kalmyk 2 Karachay-Balkar 2 Komi 2 Komi-Permyak 2 Lezghian 2 Limburgan 2 Livvi 2 Lojban 2 Lombard 2 Low German 2 Lower Sorbian 2 Luo (Kenya and Tanzania) 2 Luxembourgish 2 Manipuri 2 Manx 2 Maori 2 Mazanderani 2 Minangkabau 2 Mingrelian 2 Mirandese 2 Modern Greek 2 Moksha 2 Moroccan Arabic 2 Naxi 2 Neapolitan 2 Nepali (individual language) 2 Newari 2 Northern Frisian 2 Northern Kurdish 2 Northern Luri 2 Northern Sami 2 Occitan (post 1500) 2 Ossetian 2 Pampanga 2 Pedi 2 Piemontese 2 Pushto 2 Rundi 2 Sardinian 2 Shona 2 Sichuan Yi 2 Sicilian 2 Southern Sotho 2 Swiss-German Sign Language 2 Tai 2 Tosk Albanian 2 Turkish Sign Language 2 Turkmen 2 Tuvinian 2 Udmurt 2 Venetian 2 Volapük 2 Walloon 2 Western Frisian 2 Western Mari 2 Wu Chinese 2 Yakut 2 Yue Chinese 2 Zulu 2 Abkhazian 1 Achinese 1 Adyghe 1 Afar 1 Akan 1 Akkadian 1 Akuntsu 1 Ancient Greek 1 Ancient Hebrew 1 Apurinã 1 Argentine Sign Language 1 Arpitan 1 Assyrian Neo-Aramaic 1 Bangladeshi Sign Language 1 Banjar 1 Bemba (Zambia) 1 Bislama 1 Bodo (India) 1 Buginese 1 Central Pashto 1 Chamorro 1 Chavacano 1 Cheyenne 1 Choctaw 1 Chukot 1 Congo Swahili 1 Coptic 1 Corsican 1 Cree 1 Creek 1 Crimean Tatar 1 Dogri (macrolanguage) 1 Dzongkha 1 Extremaduran 1 Fiji Hindi 1 Fijian 1 Friulian 1 Gagauz 1 Gan Chinese 1 Geez 1 Gilaki 1 Greek Sign Language 1 Hakha Chin 1 Hakka Chinese 1 Halh Mongolian 1 Hawaiian 1 Herero 1 Hiri Motu 1 Interlingua (International Auxiliary Language Association) 1 Inupiaq 1 Jamaican Creole English 1 Kabardian 1 Kabuverdianu 1 Kachin 1 Kanuri 1 Kara-Kalpak 1 Karelian 1 Kashmiri 1 Kashubian 1 Khunsari 1 Kikuyu 1 Komi-Zyrian 1 Kongo 1 Krio 1 Kuanyama 1 Kölsch 1 Ladino 1 Lak 1 Latgalian 1 Ligurian 1 Literary Chinese 1 Lozi 1 Lunda 1 Luo (Cameroon) 1 Lushai 1 Marshallese 1 Mbyá Guaraní 1 Mesopotamian Arabic 1 Min Dong Chinese 1 Modern Greek (1453-) 1 Mundurukú 1 Najdi Arabic 1 Narom 1 Nauru 1 Navajo 1 Nayini 1 Ndonga 1 Nigerian Fulfulde 1 North Azerbaijani 1 North Levantine Arabic 1 Northern Uzbek 1 Novial 1 Official Aramaic (700-300 BCE) 1 Old English (ca. 450-1100) 1 Old French 1 Old Russian 1 Old Turkish 1 Pali 1 Pangasinan 1 Papiamento 1 Pennsylvania German 1 Pfaelzisch 1 Picard 1 Pitcairn-Norfolk 1 Plateau Malagasy 1 Pontic 1 Rajasthani 1 Rusyn 1 Samoan 1 Sango 1 Saterfriesisch 1 Scots 1 Shan 1 Silesian 1 Skolt Sami 1 Soi 1 South Levantine Arabic 1 Southern Pashto 1 Sranan Tongo 1 Standard Latvian 1 Swahili (macrolanguage) 1 Swedish Sign Language 1 Tahitian 1 Tetum 1 Tok Pisin 1 Tonga (Tonga Islands) 1 Tonga (Zambia) 1 Tulu 1 Tumbuka 1 Tunisian Arabic 1 Tupinambá 1 Venda 1 Veps 1 Vlaams 1 Vlax Romani 1 Votic 1 Warlpiri 1 West Central Oromo 1 Zaza 1 Zeeuws 1 Zhuang 1 Dogri (individual language) 0 Northern Huishui Hmong 0 Portuguse 0 Saidi Arabic 0 Santali 0

285 dataset results for Chinese

ImageNet

The ImageNet dataset contains 14,197,122 annotated images according to the WordNet hierarchy. Since 2010 the dataset is used in the ImageNet Large Scale Visual Recognition Challenge (ILSVRC), a benchmark in image classification and object detection. The publicly released dataset contains a set of manually annotated training images. A set of test images is also released, with the manual annotations withheld. ILSVRC annotations fall into one of two categories: (1) image-level annotation of a binary label for the presence or absence of an object class in the image, e.g., “there are cars in this image” but “there are no tigers,” and (2) object-level annotation of a tight bounding box and class label around an object instance in the image, e.g., “there is a screwdriver centered at position (20,25) with width of 50 pixels and height of 30 pixels”. The ImageNet project does not own the copyright of the images, therefore only thumbnails and URLs of images are provided.

11,932 PAPERS • 113 BENCHMARKS

COCO (Microsoft Common Objects in Context)

The MS COCO (Microsoft Common Objects in Context) dataset is a large-scale object detection, segmentation, key-point detection, and captioning dataset. The dataset consists of 328K images.

8,710 PAPERS • 85 BENCHMARKS

KITTI

KITTI (Karlsruhe Institute of Technology and Toyota Technological Institute) is one of the most popular datasets for use in mobile robotics and autonomous driving. It consists of hours of traffic scenarios recorded with a variety of sensor modalities, including high-resolution RGB, grayscale stereo cameras, and a 3D laser scanner. Despite its popularity, the dataset itself does not contain ground truth for semantic segmentation. However, various researchers have manually annotated parts of the dataset to fit their necessities. Álvarez et al. generated ground truth for 323 images from the road detection challenge with three classes: road, vertical, and sky. Zhang et al. annotated 252 (140 for training and 112 for testing) acquisitions – RGB and Velodyne scans – from the tracking challenge for ten object categories: building, sky, road, vegetation, sidewalk, car, pedestrian, cyclist, sign/pole, and fence. Ros et al. labeled 170 training images and 46 testing images (from the visual odome

2,890 PAPERS • 122 BENCHMARKS

NeRF
NeRF (Neural Radiance Fields)

Neural Radiance Fields (NeRF) is a method for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. The dataset contains three parts with the first 2 being synthetic renderings of objects called Diffuse Synthetic 360◦ and Realistic Synthetic 360◦ while the third is real images of complex scenes. Diffuse Synthetic 360◦ consists of four Lambertian objects with simple geometry. Each object is rendered at 512x512 pixels from viewpoints sampled on the upper hemisphere. Realistic Synthetic 360◦ consists of eight objects of complicated geometry and realistic non-Lambertian materials. Six of them are rendered from viewpoints sampled on the upper hemisphere and the two left are from viewpoints sampled on a full sphere with all of them at 800x800 pixels. The real images of complex scenes consist of 8 forward-facing scenes captured with a cellphone at a size of 1008x756 pixels.

1,581 PAPERS • 1 BENCHMARK

ModelNet

The ModelNet40 dataset contains synthetic object point clouds. As the most widely used benchmark for point cloud analysis, ModelNet40 is popular because of its various categories, clean shapes, well-constructed dataset, etc. The original ModelNet40 consists of 12,311 CAD-generated meshes in 40 categories (such as airplane, car, plant, lamp), of which 9,843 are used for training while the rest 2,468 are reserved for testing. The corresponding point cloud data points are uniformly sampled from the mesh surfaces, and then further preprocessed by moving to the origin and scaling into a unit sphere.

1,113 PAPERS • 16 BENCHMARKS

MIMIC-III (The Medical Information Mart for Intensive Care III)

The Medical Information Mart for Intensive Care III (MIMIC-III) dataset is a large, de-identified and publicly-available collection of medical records. Each record in the dataset includes ICD-9 codes, which identify diagnoses and procedures performed. Each code is partitioned into sub-codes, which often include specific circumstantial details. The dataset consists of 112,000 clinical reports records (average length 709.3 tokens) and 1,159 top-level ICD-9 codes. Each report is assigned to 7.6 codes, on average. Data includes vital signs, medications, laboratory measurements, observations and notes charted by care providers, fluid balance, procedure codes, diagnostic codes, imaging reports, hospital length of stay, survival data, and more.

769 PAPERS • 8 BENCHMARKS

Universal Dependencies

The Universal Dependencies (UD) project seeks to develop cross-linguistically consistent treebank annotation of morphology and syntax for multiple languages. The first version of the dataset was released in 2015 and consisted of 10 treebanks over 10 languages. Version 2.7 released in 2020 consists of 183 treebanks over 104 languages. The annotation consists of UPOS (universal part-of-speech tags), XPOS (language-specific part-of-speech tags), Feats (universal morphological features), Lemmas, dependency heads and universal dependency labels.

491 PAPERS • 15 BENCHMARKS

FB15k-237
FB15k-237

FB15k-237 is a link prediction dataset created from FB15k. While FB15k consists of 1,345 relations, 14,951 entities, and 592,213 triples, many triples are inverses that cause leakage from the training to testing and validation splits. FB15k-237 was created by Toutanova and Chen (2015) to ensure that the testing and evaluation datasets do not have inverse relation test leakage. In summary, FB15k-237 dataset contains 310,116 triples with 14,541 entities and 237 relation types.

357 PAPERS • 3 BENCHMARKS

XNLI (Cross-lingual Natural Language Inference)

The Cross-lingual Natural Language Inference (XNLI) corpus is the extension of the Multi-Genre NLI (MultiNLI) corpus to 15 languages. The dataset was created by manually translating the validation and test sets of MultiNLI into each of those 15 languages. The English training set was machine translated for all languages. The dataset is composed of 122k train, 2490 validation and 5010 test examples.

295 PAPERS • 11 BENCHMARKS

Common Voice

Common Voice is an audio dataset that consists of a unique MP3 and corresponding text file. There are 9,283 recorded hours in the dataset. The dataset also includes demographic metadata like age, sex, and accent. The dataset consists of 7,335 validated hours in 60 languages.

268 PAPERS • 264 BENCHMARKS

SICK (Sentences Involving Compositional Knowledge)

The Sentences Involving Compositional Knowledge (SICK) dataset is a dataset for compositional distributional semantics. It includes a large number of sentence pairs that are rich in the lexical, syntactic and semantic phenomena. Each pair of sentences is annotated in two dimensions: relatedness and entailment. The relatedness score ranges from 1 to 5, and Pearson’s r is used for evaluation; the entailment relation is categorical, consisting of entailment, contradiction, and neutral. There are 4439 pairs in the train split, 495 in the trial split used for development and 4906 in the test split. The sentence pairs are generated from image and video caption datasets before being paired up using some algorithm.

216 PAPERS • 3 BENCHMARKS

OpenSubtitles

OpenSubtitles is collection of multilingual parallel corpora. The dataset is compiled from a large database of movie and TV subtitles and includes a total of 1689 bitexts spanning 2.6 billion sentences across 60 languages.

193 PAPERS • 1 BENCHMARK

MuST-C

MuST-C currently represents the largest publicly available multilingual corpus (one-to-many) for speech translation. It covers eight language directions, from English to German, Spanish, French, Italian, Dutch, Portuguese, Romanian and Russian. The corpus consists of audio, transcriptions and translations of English TED talks, and it comes with a predefined training, validation and test split.

180 PAPERS • 2 BENCHMARKS

MELD (Multimodal EmotionLines Dataset)

Multimodal EmotionLines Dataset (MELD) has been created by enhancing and extending EmotionLines dataset. MELD contains the same dialogue instances available in EmotionLines, but it also encompasses audio and visual modality along with text. MELD has more than 1400 dialogues and 13000 utterances from Friends TV series. Multiple speakers participated in the dialogues. Each utterance in a dialogue has been labeled by any of these seven emotions -- Anger, Disgust, Sadness, Joy, Neutral, Surprise and Fear. MELD also has sentiment (positive, negative and neutral) annotation for each utterance.

166 PAPERS • 2 BENCHMARKS

XQuAD

XQuAD (Cross-lingual Question Answering Dataset) is a benchmark dataset for evaluating cross-lingual question answering performance. The dataset consists of a subset of 240 paragraphs and 1190 question-answer pairs from the development set of SQuAD v1.1 (Rajpurkar et al., 2016) together with their professional translations into ten languages: Spanish, German, Greek, Russian, Turkish, Arabic, Vietnamese, Thai, Chinese, and Hindi. Consequently, the dataset is entirely parallel across 11 languages.

142 PAPERS • 2 BENCHMARKS

MLQA (MultiLingual Question Answering)

MLQA (MultiLingual Question Answering) is a benchmark dataset for evaluating cross-lingual question answering performance. MLQA consists of over 5K extractive QA instances (12K in English) in SQuAD format in seven languages - English, Arabic, German, Spanish, Hindi, Vietnamese and Simplified Chinese. MLQA is highly parallel, with QA instances parallel between 4 different languages on average.

141 PAPERS • 1 BENCHMARK

Hate Speech
Hate Speech

Dataset of hate speech annotated on Internet forum posts in English at sentence-level. The source forum in Stormfront, a large online community of white nacionalists. A total of 10,568 sentence have been been extracted from Stormfront and classified as conveying hate speech or not.

136 PAPERS • 1 BENCHMARK

Total-Text

Total-Text is a text detection dataset that consists of 1,555 images with a variety of text types including horizontal, multi-oriented, and curved text instances. The training split and testing split have 1,255 images and 300 images, respectively.

131 PAPERS • 2 BENCHMARKS

PAWS-X

PAWS-X contains 23,659 human translated PAWS evaluation pairs and 296,406 machine translated training pairs in six typologically distinct languages: French, Spanish, German, Chinese, Japanese, and Korean. All translated pairs are sourced from examples in PAWS-Wiki.

124 PAPERS • 3 BENCHMARKS

MSRA-TD500 (MSRA Text Detection 500 Database)

The MSRA-TD500 dataset is a text detection dataset that contains 300 training images and 200 test images. Text regions are arbitrarily orientated and annotated at sentence level. Different from the other datasets, it contains both English and Chinese text.

113 PAPERS • 1 BENCHMARK

JFT-300M

JFT-300M is an internal Google dataset used for training image classification models. Images are labeled using an algorithm that uses complex mixture of raw web signals, connections between web-pages and user feedback. This results in over one billion labels for the 300M images (a single image can have multiple labels). Of the billion image labels, approximately 375M are selected via an algorithm that aims to maximize label precision of selected images.

110 PAPERS • 1 BENCHMARK

Microsoft Academic Graph
Microsoft Academic Graph

The Microsoft Academic Graph is a heterogeneous graph containing scientific publication records, citation relationships between those publications, as well as authors, institutions, journals, conferences, and fields of study.

109 PAPERS • 1 BENCHMARK

GTEA (Georgia Tech Egocentric Activity)

The Georgia Tech Egocentric Activities (GTEA) dataset contains seven types of daily activities such as making sandwich, tea, or coffee. Each activity is performed by four different people, thus totally 28 videos. For each video, there are about 20 fine-grained action instances such as take bread, pour ketchup, in approximately one minute.

98 PAPERS • 2 BENCHMARKS

ASPEC (Asian Scientific Paper Excerpt Corpus)

ASPEC, Asian Scientific Paper Excerpt Corpus, is constructed by the Japan Science and Technology Agency (JST) in collaboration with the National Institute of Information and Communications Technology (NICT). It consists of a Japanese-English paper abstract corpus of 3M parallel sentences (ASPEC-JE) and a Japanese-Chinese paper excerpt corpus of 680K parallel sentences (ASPEC-JC). This corpus is one of the achievements of the Japanese-Chinese machine translation project which was run in Japan from 2006 to 2010.

83 PAPERS • NO BENCHMARKS YET

CC100
CC100

This corpus comprises of monolingual data for 100+ languages and also includes data for romanized languages. This was constructed using the urls and paragraph indices provided by the CC-Net repository by processing January-December 2018 Commoncrawl snapshots. Each file comprises of documents separated by double-newlines and paragraphs within the same document separated by a newline. The data is generated using the open source CC-Net repository.

82 PAPERS • NO BENCHMARKS YET

ETT (Electricity Transformer Temperature)

The Electricity Transformer Temperature (ETT) is a crucial indicator in the electric power long-term deployment. This dataset consists of 2 years data from two separated counties in China. To explore the granularity on the Long sequence time-series forecasting (LSTF) problem, different subsets are created, {ETTh1, ETTh2} for 1-hour-level and ETTm1 for 15-minutes-level. Each data point consists of the target value ”oil temperature” and 6 power load features. The train/val/test is 12/4/4 months.

80 PAPERS • 10 BENCHMARKS

CrowdPose

The CrowdPose dataset contains about 20,000 images and a total of 80,000 human poses with 14 labeled keypoints. The test set includes 8,000 images. The crowded images containing homes are extracted from MSCOCO, MPII and AI Challenger.

78 PAPERS • 2 BENCHMARKS

Douban
Douban (Douban Conversation Corpus)

We release Douban Conversation Corpus, comprising a training data set, a development set and a test set for retrieval based chatbot. The statistics of Douban Conversation Corpus are shown in the following table.

75 PAPERS • 4 BENCHMARKS

LUNA16

The LUNA16 (LUng Nodule Analysis) dataset is a dataset for lung segmentation. It consists of 1,186 lung nodules annotated in 888 CT scans.

74 PAPERS • 1 BENCHMARK

Math23K
Math23K (Math23K for Math Word Problem Solving)

Math23K is a dataset created for math word problem solving, contains 23, 162 Chinese problems crawled from the Internet. Refer to our paper for more details: The dataset is originally introduced in the paper Deep Neural Solver for Math Word Problems. The original files are originally split into train/test split, while other research efforts (https://github.com/2003pro/Graph2Tree) perform the train/dev/test split.

74 PAPERS • 1 BENCHMARK

VATEX (Video And TEXt)

VATEX is multilingual, large, linguistically complex, and diverse dataset in terms of both video and natural language descriptions. It has two tasks for video-and-language research: (1) Multilingual Video Captioning, aimed at describing a video in various languages with a compact unified captioning model, and (2) Video-guided Machine Translation, to translate a source language description into the target language using the video information as additional spatiotemporal context.

73 PAPERS • 3 BENCHMARKS

Kvasir (The Kvasir Dataset)

The KVASIR Dataset was released as part of the medical multimedia challenge presented by MediaEval. It is based on images obtained from the GI tract via an endoscopy procedure. The dataset is composed of images that are annotated and verified by medical doctors, and captures 8 different classes. The classes are based on three anatomical landmarks (z-line, pylorus, cecum), three pathological findings (esophagitis, polyps, ulcerative colitis) and two other classes (dyed and lifted polyps, dyed resection margins) related to the polyp removal process. Overall, the dataset contains 8,000 endoscopic images, with 1,000 image examples per class.

69 PAPERS • 3 BENCHMARKS

OntoNotes 5.0
OntoNotes 5.0

OntoNotes 5.0 is a large corpus comprising various genres of text (news, conversational telephone speech, weblogs, usenet newsgroups, broadcast, talk shows) in three languages (English, Chinese, and Arabic) with structural information (syntax and predicate argument structure) and shallow semantics (word sense linked to an ontology and coreference).

68 PAPERS • 12 BENCHMARKS

CoNLL 2002

The shared task of CoNLL-2002 concerns language-independent named entity recognition. The types of named entities include: persons, locations, organizations and names of miscellaneous entities that do not belong to the previous three groups. The participants of the shared task were offered training and test data for at least two languages. Information sources other than the training data might have been used in this shared task.

67 PAPERS • 3 BENCHMARKS

MuPoTS-3D (Multiperson Pose Test Set in 3DMulti-person Pose estimation Test Set in 3D)

MuPoTs-3D (Multi-person Pose estimation Test Set in 3D) is a dataset for pose estimation composed of more than 8,000 frames from 20 real-world scenes with up to three subjects. The poses are annotated with a 14-point skeleton model.

63 PAPERS • 4 BENCHMARKS

DuReader

DuReader is a large-scale open-domain Chinese machine reading comprehension dataset. The dataset consists of 200K questions, 420K answers and 1M documents. The questions and documents are based on Baidu Search and Baidu Zhidao. The answers are manually generated. The dataset additionally provides question type annotations – each question was manually annotated as either Entity, Description or YesNo and one of Fact or Opinion.

59 PAPERS • 4 BENCHMARKS

CN-CELEB
CN-CELEB

CN-Celeb is a large-scale speaker recognition dataset collected `in the wild'. This dataset contains more than 130,000 utterances from 1,000 Chinese celebrities, and covers 11 different genres in real world.

58 PAPERS • 1 BENCHMARK

CMRC (Chinese Machine Reading Comprehension 2018)

CMRC is a dataset is annotated by human experts with near 20,000 questions as well as a challenging set which is composed of the questions that need reasoning over multiple clues.

57 PAPERS • 1 BENCHMARK

LIP (Look into Person)

The LIP (Look into Person) dataset is a large-scale dataset focusing on semantic understanding of a person. It contains 50,000 images with elaborated pixel-wise annotations of 19 semantic human part labels and 2D human poses with 16 key points. The images are collected from real-world scenarios and the subjects appear with challenging poses and view, heavy occlusions, various appearances and low resolution.

56 PAPERS • 1 BENCHMARK

DBP15K
DBP15K

DBP15k contains four language-specific KGs that are respectively extracted from English (En), Chinese (Zh), French (Fr) and Japanese (Ja) DBpedia, each of which contains around 65k-106k entities. Three sets of 15k alignment labels are constructed to align entities between each of the other three languages and En.

55 PAPERS • 3 BENCHMARKS

DVS128 Gesture
DVS128 Gesture

Comprises 11 hand gesture categories from 29 subjects under 3 illumination conditions.

54 PAPERS • 2 BENCHMARKS

LCSTS

LCSTS is a large corpus of Chinese short text summarization dataset constructed from the Chinese microblogging website Sina Weibo, which is released to the public. This corpus consists of over 2 million real Chinese short texts with short summaries given by the author of each text. The authors also manually tagged the relevance of 10,666 short summaries with their corresponding short texts 10,666 short summaries with their corresponding short texts.

53 PAPERS • 2 BENCHMARKS

CoNaLa
CoNaLa (CMU CoNaLa, the Code/Natural Language Challenge)

The CMU CoNaLa, the Code/Natural Language Challenge dataset is a joint project from the Carnegie Mellon University NeuLab and Strudel labs. Its purpose is for testing the generation of code snippets from natural language. The data comes from StackOverflow questions. There are 2379 training and 500 test examples that were manually annotated. Every example has a natural language intent and its corresponding python snippet. In addition to the manually annotated dataset, there are also 598,237 mined intent-snippet pairs. These examples are similar to the hand-annotated ones except that they contain a probability if the pair is valid.

51 PAPERS • 1 BENCHMARK

DRCD (Delta Reading Comprehension Dataset)

Delta Reading Comprehension Dataset (DRCD) is an open domain traditional Chinese machine reading comprehension (MRC) dataset. This dataset aimed to be a standard Chinese machine reading comprehension dataset, which can be a source dataset in transfer learning. The dataset contains 10,014 paragraphs from 2,108 Wikipedia articles and 30,000+ questions generated by annotators.

50 PAPERS • 5 BENCHMARKS

MLDoc
MLDoc (Multilingual Document Classification Corpus)

Multilingual Document Classification Corpus (MLDoc) is a cross-lingual document classification dataset covering English, German, French, Spanish, Italian, Russian, Japanese and Chinese. It is a subset of the Reuters Corpus Volume 2 selected according to the following design choices:

50 PAPERS • 11 BENCHMARKS

Weibo NER

The Weibo NER dataset is a Chinese Named Entity Recognition dataset drawn from the social media website Sina Weibo.

48 PAPERS • 2 BENCHMARKS

OSCAR

OSCAR or Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture. The dataset used for training multilingual models such as BART incorporates 138 GB of text.

46 PAPERS • NO BENCHMARKS YET

WikiLingua

WikiLingua includes ~770k article and summary pairs in 18 languages from WikiHow. Gold-standard article-summary alignments across languages are extracted by aligning the images that are used to describe each how-to step in an article.

44 PAPERS • 5 BENCHMARKS

Contact us on: hello@paperswithcode.com . Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Data policy Cookies policy