Datasets

10,527 machine learning datasets
🔔   Share your dataset with the ML community!
Filter by Modality
Texts 221 Images 83 Videos 22 Audio 19 Speech 16 Medical 14 3D 7 Graphs 5 LiDAR 5 Time series 4 Point cloud 3 Tabular 3 3d meshes 2 Actions 2 Environment 2 Interactive 2 RGB Video 2 RGB-D 2 Biomedical 1 Lyrics 1 MRI 1 Parallel 1 Ranking 1 Stereo 1 6D 0 Biology 0 Cad 0 Dialog 0 EEG 0 Financial 0 Hyperspectral images 0 Midi 0 Music 0 PSG 0 Physics 0 Replay data 0 Tables 0 Tracking 0 fMRI 0
Filter by Task
Question Answering 22 Language Modelling 17 Text Generation 17 Machine Translation 16 Reading Comprehension 14 Machine Reading Comprehension 10 Named Entity Recognition (NER) 10 Dialogue Generation 9 Speech Recognition 9 Text Summarization 9 Image Classification 8 Scene Text Detection 8 Semantic Segmentation 8 Natural Language Inference 7 Task-Oriented Dialogue Systems 7 Cross-Lingual Transfer 6 Open-Domain Dialog 6 Sentiment Analysis 6 Text Classification 6 Chinese Named Entity Recognition 5 Domain Adaptation 5 Misinformation 5 Natural Language Understanding 5 Object Detection 5 Relation Extraction 5 SSTOD 5 Slot Filling 5 Translation 5 Visual Question Answering (VQA) 5 Word Embeddings 5 Chinese Reading Comprehension 4 Classification 4 Cloze (multi-choices) (Few-Shot) 4 Cloze (multi-choices) (One-Shot) 4 Cloze (multi-choices) (Zero-Shot) 4 Conversational Response Selection 4 Cross-Lingual NER 4 Data Augmentation 4 Instance Segmentation 4 License Plate Detection 4 License Plate Recognition 4 Mathematical Reasoning 4 Optical Character Recognition (OCR) 4 Part-Of-Speech Tagging 4 Pose Estimation 4 Reading Comprehension (Few-Shot) 4 Reading Comprehension (One-Shot) 4 Reading Comprehension (Zero-Shot) 4 Style Transfer 4 Video Captioning 4 Zero-Shot Learning 4 Abstractive Text Summarization 3 Chinese Word Segmentation 3 Code Generation 3 Coreference Resolution 3 Cross-Lingual Question Answering 3 Document Summarization 3 Emotion Recognition in Conversation 3 Entity Alignment 3 Fake News Detection 3 Food Recognition 3 Gesture Generation 3 Grammatical Error Correction 3 Image Generation 3 Intent Detection 3 Knowledge Distillation 3 Link Prediction 3 Math Word Problem Solving 3 Medical Image Segmentation 3 Multi-Label Classification 3 Multi-Task Learning 3 Neural Architecture Search 3 Open-Domain Question Answering 3 Panoptic Segmentation 3 Question Generation 3 Recommendation Systems 3 Scene Text Recognition 3 Semantic Similarity 3 Speaker Diarization 3 Visual Reasoning 3 Zero-Shot Cross-Lingual Transfer 3 3D Lane Detection 2 Action Recognition 2 Adversarial Robustness 2 Automatic Post-Editing 2 Chinese Sentence Pair Classification 2 Computed Tomography (CT) 2 Conversational Response Generation 2 Cross-Lingual Natural Language Inference 2 Cross-Lingual POS Tagging 2 Cross-Modal Retrieval 2 Cross-modal retrieval with noisy correspondence 2 Depth Estimation 2 Dialogue Understanding 2 Emotion Recognition 2 Entity Linking 2 Entity Typing 2 Event Detection 2 Event Extraction 2 FLUE 2 Hate Speech Detection 2 Image Captioning 2 Image Clustering 2 Image Dehazing 2 Image Inpainting 2 Image Retrieval 2 Image Super-Resolution 2 Image-text Retrieval 2 Image-to-Image Translation 2 Intent Classification 2 Key Information Extraction 2 Key-value Pair Extraction 2 Knowledge Graphs 2 Language Identification 2 Max-Shot Cross-Lingual Visual Reasoning 2 Meta-Learning 2 Multi-Document Summarization 2 Multi-Person Pose Estimation 2 Multi-modal Entity Alignment 2 Multilingual Named Entity Recognition 2 Multimodal Emotion Recognition 2 Multiple-choice 2 Node Classification 2 Novel View Synthesis 2 Object Localization 2 Object Recognition 2 Paraphrase Generation 2 Professional Psychology 2 Quantization 2 Real-Time Object Detection 2 Real-time Instance Segmentation 2 Relation Classification 2 Robotic Grasping 2 Semantic Parsing 2 Speaker Recognition 2 Speech Separation 2 Speech-to-Text Translation 2 Spelling Correction 2 Spoken Language Understanding 2 Text Matching 2 Text Spotting 2 Text to Video Retrieval 2 Text-To-Speech Synthesis 2 Time Series Forecasting 2 Token Classification 2 Unsupervised Domain Adaptation 2 Unsupervised Semantic Segmentation with Language-image Pre-training 2 Visual Question Answering 2 Weakly Supervised Object Detection 2 Zero-Shot Composed Image Retrieval (ZS-CIR) 2 Zero-Shot Cross-Lingual Visual Reasoning 2 Zero-Shot Cross-Modal Retrieval 2 Zero-shot Text-to-Image Retrieval 2 1 2D Object Detection 1 2D Semantic Segmentation 1 3D Anomaly Detection 1 3D Depth Estimation 1 3D Face Animation 1 3D Multi-Object Tracking 1 3D Multi-Person Pose Estimation 1 3D Multi-Person Pose Estimation (absolute) 1 3D Multi-Person Pose Estimation (root-relative) 1 3D Object Classification 1 3D Object Detection 1 3D Object Detection From Stereo Images 1 3D Object Recognition 1 3D Object Retrieval 1 3D Object Tracking 1 3D Parameter-Efficient Fine-Tuning for Classification 1 3D Point Cloud Classification 1 3D Point Cloud Data Augmentation 1 3D Point Cloud Linear Classification 1 3D Single Object Tracking 1 A-VB Culture 1 A-VB High 1 A-VB Two 1 Abusive Language 1 Action Segmentation 1 Active Object Detection 1 Activeness Detection 1 Adversarial Defense 1 Age Estimation 1 Anchor link prediction 1 Anomaly Detection 1 Answer Generation 1 Arithmetic Reasoning 1 Aspect-Based Sentiment Analysis (ABSA) 1 Aspect-Category-Opinion-Sentiment Quadruple Extraction 1 Attribute 1 Audio Classification 1 Audio Source Separation 1 Audio-Visual Speech Recognition 1 Automatic Speech Recognition (ASR) 1 Autonomous Driving 1 Bias Detection 1 Binarization 1 Birds Eye View Object Detection 1 Box-supervised Instance Segmentation 1 Catalog Extraction 1 Causal Inference 1 Chinese Landscape Painting Generation 1 Citation Recommendation 1 Classification with Binary Neural Network 1 Clinical Concept Extraction 1 Code Search 1 College Mathematics 1 Colon Cancer Detection In Confocal Laser Microscopy Images 1 Colorectal Gland Segmentation: 1 Colorectal Polyps Characterization 1 Common Sense Reasoning 1 Common Sense Reasoning (Few-Shot) 1 Common Sense Reasoning (One-Shot) 1 Common Sense Reasoning (Zero-Shot) 1 Complex Query Answering 1 Conditional Image Generation 1 Connective Detection 1 Continual Semantic Segmentation 1 Conversational Sentiment Quadruple Extraction 1 Core Psychological Reasoning 1 Cross-Lingual ASR 1 Cross-Lingual Abstractive Summarization 1 Cross-Lingual Bitext Mining 1 Cross-Lingual Document Classification 1 Cross-Lingual Entity Linking 1 Cross-Lingual Paraphrase Identification 1 Cross-Lingual Sentiment Classification 1 Cross-lingual zero-shot dependency parsing 1 Cultural Vocal Bursts Intensity Prediction 1 Curved Text Detection 1 Decipherment 1 DeepFake Detection 1 Dense Pixel Correspondence Estimation 1 Dependency Parsing 1 Depth Completion 1 Depth Prediction 1 Dialog Act Classification 1 Dialog Relation Extraction 1 Dialogue Act Classification 1 Dialogue Evaluation 1 Dialogue State Tracking 1 Dimensionality Reduction 1 Discourse Parsing 1 Discourse Segmentation 1 Document AI 1 Document Classification 1 Document Level Machine Translation 1 Document Translation 1 Document-level Event Extraction 1 Domain Generalization 1 Drone navigation 1 Drone-view target localization 1 Egocentric Pose Estimation 1 Elementary Mathematics 1 Emotion-Cause Pair Extraction 1 Emotional Dialogue Acts 1 End-To-End Dialogue Modelling 1 Entity Disambiguation 1 Entity Resolution 1 Event data classification 1 Explainable artificial intelligence 1 Explanation Generation 1 FG-1-PG-1 1 Face Age Editing 1 Face Detection 1 Face Generation 1 Face Swapping 1 Face Transfer 1 Facial Emotion Recognition 1 Facial Expression Recognition 1 Facial Expression Recognition (FER) 1 Fact Checking 1 Fact Verification 1 Feature Upsampling 1 Few Shot Open Set Object Detection 1 Few-Shot 3D Point Cloud Classification 1 Few-Shot Audio Classification 1 Few-Shot Image Classification 1 Few-Shot Learning 1 Few-Shot Object Detection 1 Few-Shot Point Cloud Classification 1 Few-shot NER 1 Fill Mask 1 Fine-Grained Action Detection 1 Fine-Grained Image Recognition 1 Font Generation 1 Gaze Estimation 1 Generalized Zero-Shot Learning 1 Generalized Zero-Shot Object Detection 1 Generative 3D Object Classification 1 Genre classification 1 Gesture Recognition 1 Gloss-free Sign Language Translation 1 Grammatical Error Detection 1 Hallucination Evaluation 1 Handwritten Chinese Text Recognition 1 High School Mathematics 1 Histopathological Image Classification 1 Homography Estimation 1 Horizon Line Estimation 1 Image Classification with Differential Privacy 1 Image Colorization 1 Image Compressed Sensing 1 Image Deblurring 1 Image Outpainting 1 Image to Point Cloud Registration 1 Image-level Supervised Instance Segmentation 1 Image-to-Text Retrieval 1 Implicit Discourse Relation Classification 1 Information Retrieval 1 Intent Recognition 1 Interactive Segmentation 1 JPEG Decompression 1 Keypoint Detection 1 Keyword Extraction 1 Knowledge Graph Completion 1 LABELED_DEPENDENCIES 1 LEMMA 1 LIDAR Semantic Segmentation 1 Lane Detection 1 Layout-to-Image Generation 1 Learning with noisy labels 1 Lesion Classification 1 Lesion Segmentation 1 Liver Segmentation 1 Low-Resource Neural Machine Translation 1 Lung Nodule Detection 1 MORPH 1 Math 1 Mathematical Question Answering 1 Max-Shot Cross-Lingual Image-to-Text Retrieval 1 Max-Shot Cross-Lingual Text-to-Image Retrieval 1 Max-Shot Cross-Lingual Visual Natural Language Inference 1 Max-Shot Cross-Lingual Visual Question Answering 1 Medical Concept Normalization 1 Medical Diagnosis 1 Medical Image Classification 1 Medical Relation Extraction 1 Medical Visual Question Answering 1 Metric Learning 1 Micro-Expression Recognition 1 Micro-expression Generation 1 Model Compression 1 Monocular 3D Object Detection 1 Monocular Cross-View Road Scene Parsing(Road) 1 Monocular Cross-View Road Scene Parsing(Vehicle) 1 Monocular Depth Estimation 1 Morphological Analysis 1 Multi-Choice MRC 1 Multi-Label Image Classification 1 Multi-Label Learning 1 Multi-Label Text Classification 1 Multi-Object Tracking 1 Multi-agent Reinforcement Learning 1 Multi-modal Dialogue Generation 1 Multi-object discovery 1 Multi-task Language Understanding 1 Multilingual Machine Comprehension in English Hindi 1 Multilingual NLP 1 Multilingual text classification 1 Multimodal Forgery Detection 1 Multimodal Reasoning 1 Multimodal Sentiment Analysis 1 Multiple Instance Learning 1 Multiple Object Tracking 1 Multivariate Time Series Forecasting 1 Music Information Retrieval 1 Music Source Separation 1 NER 1 NMT 1 Natural Language Inference (Few-Shot) 1 Natural Language Inference (One-Shot) 1 Natural Language Inference (Zero-Shot) 1 Natural Questions 1 Network Pruning 1 News Retrieval 1 Node Clustering 1 Object Counting 1 Object Detection In Aerial Images 1 Object Proposal Generation 1 Object Tracking 1 Offline Handwritten Chinese Character Recognition 1 Offline RL 1 One-Shot Instance Segmentation 1 One-Shot Object Detection 1 One-stage Anchor-free Oriented Object Detection 1 Open Information Extraction 1 Open Vocabulary Object Detection 1 Open Vocabulary Panoptic Segmentation 1 Open Vocabulary Semantic Segmentation 1 Open World Object Detection 1 Open-set video tagging 1 Optic Disc Segmentation 1 Optical Flow Estimation 1 Outlier Detection 1 Overlapped 100-10 1 Overlapped 100-5 1 Overlapped 100-50 1 Overlapped 25-25 1 Overlapped 50-50 1 POS 1 Paraphrase Identification 1 Passage Retrieval 1 Pedestrian Attribute Recognition 1 Person Re-Identification 1 Personality Recognition in Conversation 1 Personality Trait Recognition 1 Personalized and Emotional Conversation 1 Phrase Grounding 1 Point Cloud Classification 1 Point Cloud Registration 1 Point Cloud Segmentation 1 Point-Supervised Instance Segmentation 1 Poll Generation 1 Polyphone disambiguation 1 Pose Tracking 1 Pose Transfer 1 Prediction Of Occupancy Grid Maps 1 Pretrained Multilingual Language Models 1 Prompt Engineering 1 Propaganda detection 1 Propaganda technique identification 1 Question Similarity 1 Real-Time Semantic Segmentation 1 Record linking 1 Region Proposal 1 Relation Linking 1 Retrieval 1 Road Damage Detection 1 Robust Object Detection 1 SENTS 1 Scene Flow Estimation 1 Scene Graph Generation 1 Scene Recognition 1 Scene Understanding 1 Segmentation 1 Self-Supervised Image Classification 1 Self-Supervised Learning 1 Semantic Frame Parsing 1 Semantic Role Labeling 1 Semantic Textual Similarity 1 Semi Supervised Learning for Image Captioning 1 Semi-Supervised Image Classification 1 Semi-Supervised Semantic Segmentation 1 Sentence Classification 1 Sentence Embeddings 1 Short-Text Conversation 1 Sign Language Recognition 1 Sign Language Retrieval 1 Sign Language Translation 1 Single-object discovery 1 Sound Prompted Semantic Segmentation 1 Span-Extraction MRC 1 Sparse Learning 1 Spatio-Temporal Forecasting 1 Speaker Verification 1 Speech Emotion Recognition 1 Speech Prompted Semantic Segmentation 1 Speech Synthesis 1 Speech-to-Speech Translation 1 Stereo Depth Estimation 1 Stereo Disparity Estimation 1 Stereo Image Super-Resolution 1 Stock Market Prediction 1 Stock Prediction 1 Stock Price Prediction 1 Stock Trend Prediction 1 Story Completion 1 Super-Resolution 1 TAG 1 Term Extraction 1 Test-time Adaptation 1 Text Effects Transfer 1 Text Retrieval 1 Text Simplification 1 Text Style Transfer 1 Text-Based Stock Prediction 1 Text-To-SQL 1 Text-to-Image Generation 1 Text-to-video search 1 Time Series 1 Traffic Sign Detection 1 Training-free 3D Point Cloud Classification 1 Trajectory Prediction 1 Transductive Zero-Shot Classification 1 Transfer Learning 1 Tumor Segmentation 1 Vocal Bursts Intensity Prediction 1 Vocal Bursts Valence Prediction 1 de-en 1 es-en 1 fr-en 1 mage-to-Text Retrieval 1 multi-word expression embedding 1 multi-word expression sememe prediction 1 text annotation 1 text-to-Cypher 1 text2text-generation 1
Filter by Language (clear)
Chinese English 3200 German 177 French 167 Spanish 136 Russian 121 Japanese 96 Arabic 90 Italian 88 Portuguese 84 Hindi 74 Vietnamese 65 Korean 61 Turkish 54 Bengali 50 Persian 50 Dutch 46 Tamil 44 Polish 41 Czech 39 Indonesian 38 Danish 35 Finnish 34 Romanian 34 Telugu 31 Multilingual 29 Swedish 29 Urdu 29 Hungarian 27 Thai 27 Marathi 26 Greek 25 Estonian 24 Gujarati 23 Hebrew 23 Mandarin Chinese 23 Bulgarian 22 Malayalam 22 Basque 20 Catalan 18 Kannada 18 Slovak 18 Swahili 18 Latvian 17 Punjabi 17 Slovenian 17 Ukrainian 17 Croatian 16 Lithuanian 16 Kazakh 15 Norwegian 15 Serbian 15 Amharic 13 Albanian 12 Assamese 12 Iranian Persian 12 Kurdish 12 Armenian 10 Irish 10 Macedonian 10 Maltese 10 Welsh 10 Yoruba 10 Burmese 9 Hausa 9 Igbo 9 Mongolian 9 Oriya (macrolanguage) 9 Sanskrit 9 Tagalog 9 American Sign Language 8 Azerbaijani 8 Breton 8 Georgian 8 Odia 8 Sinhala 8 Bambara 7 Esperanto 7 Filipino 7 Galician 7 Guarani 7 Icelandic 7 Malagasy 7 Nepali (macrolanguage) 7 Oromo 7 Serbo-Croatian 7 Somali 7 Uzbek 7 Wolof 7 Afrikaans 6 Central Khmer 6 Central Kurdish 6 Ganda 6 Haitian 6 Nigerian Pidgin 6 Sindhi 6 Tibetan 6 Tigrinya 6 Western Panjabi 6 Belarusian 5 Bosnian 5 Egyptian Arabic 5 Fon 5 Javanese 5 Latin 5 Lingala 5 Malay (individual language) 5 Norwegian Bokmål 5 Norwegian Nynorsk 5 Quechua 5 Scottish Gaelic 5 Standard Arabic 5 Sundanese 5 Tswana 5 Aymara 4 Bangala 4 Cebuano 4 Chechen 4 Dhivehi 4 Ewe 4 Fulah 4 Iloko 4 Kabyle 4 Kinyarwanda 4 Kirghiz 4 Lao 4 Luo (Kenya and Tanzania) 4 Nyanja 4 South Azerbaijani 4 Tatar 4 Tetum 4 Twi 4 Upper Sorbian 4 Xhosa 4 Zulu 4 Aragonese 3 Bashkir 3 Bavarian 3 Bishnupriya 3 Chuvash 3 Erzya 3 Faroese 3 Goan Konkani 3 Interlingue 3 Maithili 3 Malay (macrolanguage) 3 Occitan (post 1500) 3 Romansh 3 Rundi 3 Russia Buriat 3 Shona 3 Swati 3 Swiss German 3 Tajik 3 Tsonga 3 Turkmen 3 Uighur 3 Waray (Philippines) 3 Yiddish 3 Argentine Sign Language 2 Asturian 2 Avaric 2 Bangladeshi Sign Language 2 Bhojpuri 2 Central Bikol 2 Cherokee 2 Church Slavic 2 Cornish 2 Corsican 2 Dimli (individual language) 2 Eastern Mari 2 German Sign Language 2 Gothic 2 Gulf Arabic 2 Ido 2 Inuktitut 2 Jejueo 2 Kalaallisut 2 Kalmyk 2 Karachay-Balkar 2 Komi 2 Komi-Permyak 2 Lezghian 2 Limburgan 2 Livvi 2 Lojban 2 Lombard 2 Low German 2 Lower Sorbian 2 Luxembourgish 2 Manipuri 2 Manx 2 Maori 2 Mazanderani 2 Minangkabau 2 Mingrelian 2 Mirandese 2 Modern Greek 2 Moksha 2 Moroccan Arabic 2 Mossi 2 Naxi 2 Neapolitan 2 Nepali (individual language) 2 Newari 2 Northern Frisian 2 Northern Kurdish 2 Northern Luri 2 Northern Sami 2 Old Spanish 2 Ossetian 2 Pampanga 2 Pedi 2 Piemontese 2 Pushto 2 Sardinian 2 Sichuan Yi 2 Sicilian 2 Southern Sotho 2 Swiss-German Sign Language 2 Tai 2 Tosk Albanian 2 Turkish Sign Language 2 Tuvinian 2 Udmurt 2 Venetian 2 Volapük 2 Walloon 2 Western Frisian 2 Western Mari 2 Wu Chinese 2 Yakut 2 Yue Chinese 2 Abkhazian 1 Achinese 1 Adyghe 1 Afar 1 Akan 1 Akkadian 1 Akuntsu 1 Ambonese Malay 1 Ancient Greek 1 Ancient Hebrew 1 Apurinã 1 Arpitan 1 Assyrian Neo-Aramaic 1 Banjar 1 Bemba (Zambia) 1 Bislama 1 Bodo (India) 1 Buginese 1 Central Pashto 1 Chamorro 1 Chavacano 1 Cheyenne 1 Choctaw 1 Chukot 1 Congo Swahili 1 Coptic 1 Cree 1 Creek 1 Crimean Tatar 1 Dogri (macrolanguage) 1 Dzongkha 1 Extremaduran 1 Fiji Hindi 1 Fijian 1 French Sign Language 1 Friulian 1 Gagauz 1 Gan Chinese 1 Geez 1 Gilaki 1 Greek Sign Language 1 Hakha Chin 1 Hakka Chinese 1 Halh Mongolian 1 Hawaiian 1 Herero 1 Hiri Motu 1 Interlingua (International Auxiliary Language Association) 1 Inupiaq 1 Jamaican Creole English 1 Kabardian 1 Kabuverdianu 1 Kachin 1 Kanuri 1 Kara-Kalpak 1 Karelian 1 Kashmiri 1 Kashubian 1 Khunsari 1 Kikuyu 1 Komi-Zyrian 1 Kongo 1 Krio 1 Kuanyama 1 Kupang Malay 1 Kölsch 1 Ladino 1 Lak 1 Latgalian 1 Ligurian 1 Literary Chinese 1 Lozi 1 Lunda 1 Luo (Cameroon) 1 Lushai 1 Makasar 1 Malayic Dayak 1 Marshallese 1 Mbyá Guaraní 1 Mesopotamian Arabic 1 Min Dong Chinese 1 Modern Greek (1453-) 1 Mundurukú 1 Najdi Arabic 1 Narom 1 Nauru 1 Navajo 1 Nayini 1 Ndonga 1 Nigerian Fulfulde 1 North Azerbaijani 1 North Levantine Arabic 1 Northern Uzbek 1 Novial 1 Official Aramaic (700-300 BCE) 1 Old English (ca. 450-1100) 1 Old French 1 Old Russian 1 Old Turkish 1 Pali 1 Pangasinan 1 Papiamento 1 Pennsylvania German 1 Pfaelzisch 1 Picard 1 Pitcairn-Norfolk 1 Plateau Malagasy 1 Pontic 1 Rajasthani 1 Rusyn 1 Samoan 1 Sango 1 Saterfriesisch 1 Scots 1 Shan 1 Silesian 1 Skolt Sami 1 Soi 1 South Levantine Arabic 1 Southern Pashto 1 Sranan Tongo 1 Standard Latvian 1 Swahili (macrolanguage) 1 Swedish Sign Language 1 Tahitian 1 Tok Pisin 1 Tonga (Tonga Islands) 1 Tonga (Zambia) 1 Tulu 1 Tumbuka 1 Tunisian Arabic 1 Tupinambá 1 Uab Meto 1 Venda 1 Veps 1 Vlaams 1 Vlax Romani 1 Votic 1 Warlpiri 1 West Central Oromo 1 Zaza 1 Zeeuws 1 Zhuang 1 Dogri (individual language) 0 Northern Huishui Hmong 0 Portuguse 0 Saidi Arabic 0 Santali 0 Thai Song 0 Tunisian Sign Language 0

356 dataset results for Chinese

ImageNet

The ImageNet dataset contains 14,197,122 annotated images according to the WordNet hierarchy. Since 2010 the dataset is used in the ImageNet Large Scale Visual Recognition Challenge (ILSVRC), a benchmark in image classification and object detection. The publicly released dataset contains a set of manually annotated training images. A set of test images is also released, with the manual annotations withheld. ILSVRC annotations fall into one of two categories: (1) image-level annotation of a binary label for the presence or absence of an object class in the image, e.g., “there are cars in this image” but “there are no tigers,” and (2) object-level annotation of a tight bounding box and class label around an object instance in the image, e.g., “there is a screwdriver centered at position (20,25) with width of 50 pixels and height of 30 pixels”. The ImageNet project does not own the copyright of the images, therefore only thumbnails and URLs of images are provided.

14,074 PAPERS • 43 BENCHMARKS

MS COCO (Microsoft Common Objects in Context)

The MS COCO (Microsoft Common Objects in Context) dataset is a large-scale object detection, segmentation, key-point detection, and captioning dataset. The dataset consists of 328K images.

10,802 PAPERS • 96 BENCHMARKS

KITTI

KITTI (Karlsruhe Institute of Technology and Toyota Technological Institute) is one of the most popular datasets for use in mobile robotics and autonomous driving. It consists of hours of traffic scenarios recorded with a variety of sensor modalities, including high-resolution RGB, grayscale stereo cameras, and a 3D laser scanner. Despite its popularity, the dataset itself does not contain ground truth for semantic segmentation. However, various researchers have manually annotated parts of the dataset to fit their necessities. Álvarez et al. generated ground truth for 323 images from the road detection challenge with three classes: road, vertical, and sky. Zhang et al. annotated 252 (140 for training and 112 for testing) acquisitions – RGB and Velodyne scans – from the tracking challenge for ten object categories: building, sky, road, vegetation, sidewalk, car, pedestrian, cyclist, sign/pole, and fence. Ros et al. labeled 170 training images and 46 testing images (from the visual odome

3,378 PAPERS • 141 BENCHMARKS

NeRF
NeRF (Neural Radiance Fields)

Neural Radiance Fields (NeRF) is a method for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. The dataset contains three parts with the first 2 being synthetic renderings of objects called Diffuse Synthetic 360◦ and Realistic Synthetic 360◦ while the third is real images of complex scenes. Diffuse Synthetic 360◦ consists of four Lambertian objects with simple geometry. Each object is rendered at 512x512 pixels from viewpoints sampled on the upper hemisphere. Realistic Synthetic 360◦ consists of eight objects of complicated geometry and realistic non-Lambertian materials. Six of them are rendered from viewpoints sampled on the upper hemisphere and the two left are from viewpoints sampled on a full sphere with all of them at 800x800 pixels. The real images of complex scenes consist of 8 forward-facing scenes captured with a cellphone at a size of 1008x756 pixels.

3,079 PAPERS • 1 BENCHMARK

ModelNet

The ModelNet40 dataset contains synthetic object point clouds. As the most widely used benchmark for point cloud analysis, ModelNet40 is popular because of its various categories, clean shapes, well-constructed dataset, etc. The original ModelNet40 consists of 12,311 CAD-generated meshes in 40 categories (such as airplane, car, plant, lamp), of which 9,843 are used for training while the rest 2,468 are reserved for testing. The corresponding point cloud data points are uniformly sampled from the mesh surfaces, and then further preprocessed by moving to the origin and scaling into a unit sphere.

1,297 PAPERS • 18 BENCHMARKS

ADE20K

The ADE20K semantic segmentation dataset contains more than 20K scene-centric images exhaustively annotated with pixel-level objects and object parts labels. There are totally 150 semantic categories, which include stuffs like sky, road, grass, and discrete objects like person, car, bed.

1,081 PAPERS • 27 BENCHMARKS

ImageNet-C

ImageNet-C is an open source data set that consists of algorithmically generated corruptions (blur, noise) applied to the ImageNet test-set.

549 PAPERS • 4 BENCHMARKS

Universal Dependencies

The Universal Dependencies (UD) project seeks to develop cross-linguistically consistent treebank annotation of morphology and syntax for multiple languages. The first version of the dataset was released in 2015 and consisted of 10 treebanks over 10 languages. Version 2.7 released in 2020 consists of 183 treebanks over 104 languages. The annotation consists of UPOS (universal part-of-speech tags), XPOS (language-specific part-of-speech tags), Feats (universal morphological features), Lemmas, dependency heads and universal dependency labels.

508 PAPERS • 12 BENCHMARKS

FB15k-237
FB15k-237

FB15k-237 is a link prediction dataset created from FB15k. While FB15k consists of 1,345 relations, 14,951 entities, and 592,213 triples, many triples are inverses that cause leakage from the training to testing and validation splits. FB15k-237 was created by Toutanova and Chen (2015) to ensure that the testing and evaluation datasets do not have inverse relation test leakage. In summary, FB15k-237 dataset contains 310,116 triples with 14,541 entities and 237 relation types.

423 PAPERS • 3 BENCHMARKS

Common Voice

Common Voice is an audio dataset that consists of a unique MP3 and corresponding text file. There are 9,283 recorded hours in the dataset. The dataset also includes demographic metadata like age, sex, and accent. The dataset consists of 7,335 validated hours in 60 languages.

345 PAPERS • 163 BENCHMARKS

XNLI (Cross-lingual Natural Language Inference)

The Cross-lingual Natural Language Inference (XNLI) corpus is the extension of the Multi-Genre NLI (MultiNLI) corpus to 15 languages. The dataset was created by manually translating the validation and test sets of MultiNLI into each of those 15 languages. The English training set was machine translated for all languages. The dataset is composed of 122k train, 2490 validation and 5010 test examples.

339 PAPERS • 10 BENCHMARKS

SICK (Sentences Involving Compositional Knowledge)

The Sentences Involving Compositional Knowledge (SICK) dataset is a dataset for compositional distributional semantics. It includes a large number of sentence pairs that are rich in the lexical, syntactic and semantic phenomena. Each pair of sentences is annotated in two dimensions: relatedness and entailment. The relatedness score ranges from 1 to 5, and Pearson’s r is used for evaluation; the entailment relation is categorical, consisting of entailment, contradiction, and neutral. There are 4439 pairs in the train split, 495 in the trial split used for development and 4906 in the test split. The sentence pairs are generated from image and video caption datasets before being paired up using some algorithm.

327 PAPERS • 4 BENCHMARKS

OntoNotes 5.0
OntoNotes 5.0

OntoNotes 5.0 is a large corpus comprising various genres of text (news, conversational telephone speech, weblogs, usenet newsgroups, broadcast, talk shows) in three languages (English, Chinese, and Arabic) with structural information (syntax and predicate argument structure) and shallow semantics (word sense linked to an ontology and coreference).

247 PAPERS • 11 BENCHMARKS

MELD (Multimodal EmotionLines Dataset)

Multimodal EmotionLines Dataset (MELD) has been created by enhancing and extending EmotionLines dataset. MELD contains the same dialogue instances available in EmotionLines, but it also encompasses audio and visual modality along with text. MELD has more than 1400 dialogues and 13000 utterances from Friends TV series. Multiple speakers participated in the dialogues. Each utterance in a dialogue has been labeled by any of these seven emotions -- Anger, Disgust, Sadness, Joy, Neutral, Surprise and Fear. MELD also has sentiment (positive, negative and neutral) annotation for each utterance.

237 PAPERS • 3 BENCHMARKS

MuST-C

MuST-C currently represents the largest publicly available multilingual corpus (one-to-many) for speech translation. It covers eight language directions, from English to German, Spanish, French, Italian, Dutch, Portuguese, Romanian and Russian. The corpus consists of audio, transcriptions and translations of English TED talks, and it comes with a predefined training, validation and test split.

198 PAPERS • 2 BENCHMARKS

ETT (Electricity Transformer Temperature)

The Electricity Transformer Temperature (ETT) is a crucial indicator in the electric power long-term deployment. This dataset consists of 2 years data from two separated counties in China. To explore the granularity on the Long sequence time-series forecasting (LSTF) problem, different subsets are created, {ETTh1, ETTh2} for 1-hour-level and ETTm1 for 15-minutes-level. Each data point consists of the target value ”oil temperature” and 6 power load features. The train/val/test is 12/4/4 months.

194 PAPERS • 2 BENCHMARKS

XQuAD

XQuAD (Cross-lingual Question Answering Dataset) is a benchmark dataset for evaluating cross-lingual question answering performance. The dataset consists of a subset of 240 paragraphs and 1190 question-answer pairs from the development set of SQuAD v1.1 (Rajpurkar et al., 2016) together with their professional translations into ten languages: Spanish, German, Greek, Russian, Turkish, Arabic, Vietnamese, Thai, Chinese, and Hindi. Consequently, the dataset is entirely parallel across 11 languages.

179 PAPERS • 1 BENCHMARK

Hate Speech
Hate Speech

Dataset of hate speech annotated on Internet forum posts in English at sentence-level. The source forum in Stormfront, a large online community of white nacionalists. A total of 10,568 sentence have been been extracted from Stormfront and classified as conveying hate speech or not.

168 PAPERS • 1 BENCHMARK

PAWS-X

PAWS-X contains 23,659 human translated PAWS evaluation pairs and 296,406 machine translated training pairs in six typologically distinct languages: French, Spanish, German, Chinese, Japanese, and Korean. All translated pairs are sourced from examples in PAWS-Wiki.

164 PAPERS • 2 BENCHMARKS

MLQA (MultiLingual Question Answering)

MLQA (MultiLingual Question Answering) is a benchmark dataset for evaluating cross-lingual question answering performance. MLQA consists of over 5K extractive QA instances (12K in English) in SQuAD format in seven languages - English, Arabic, German, Spanish, Hindi, Vietnamese and Simplified Chinese. MLQA is highly parallel, with QA instances parallel between 4 different languages on average.

158 PAPERS • 1 BENCHMARK

RAF-DB (Real-world Affective Faces)

The Real-world Affective Faces Database (RAF-DB) is a dataset for facial expression. It contains 29672 facial images tagged with basic or compound expressions by 40 independent taggers. Images in this database are of great variability in subjects' age, gender and ethnicity, head poses, lighting conditions, occlusions, (e.g. glasses, facial hair or self-occlusion), post-processing operations (e.g. various filters and special effects), etc.

149 PAPERS • 2 BENCHMARKS

Total-Text

Total-Text is a text detection dataset that consists of 1,555 images with a variety of text types including horizontal, multi-oriented, and curved text instances. The training split and testing split have 1,255 images and 300 images, respectively.

148 PAPERS • 2 BENCHMARKS

MSRA-TD500 (MSRA Text Detection 500 Database)

The MSRA-TD500 dataset is a text detection dataset that contains 300 training images and 200 test images. Text regions are arbitrarily orientated and annotated at sentence level. Different from the other datasets, it contains both English and Chinese text.

122 PAPERS • 1 BENCHMARK

JFT-300M

JFT-300M is an internal Google dataset used for training image classification models. Images are labeled using an algorithm that uses complex mixture of raw web signals, connections between web-pages and user feedback. This results in over one billion labels for the 300M images (a single image can have multiple labels). Of the billion image labels, approximately 375M are selected via an algorithm that aims to maximize label precision of selected images.

121 PAPERS • 1 BENCHMARK

Microsoft Academic Graph
Microsoft Academic Graph

The Microsoft Academic Graph is a heterogeneous graph containing scientific publication records, citation relationships between those publications, as well as authors, institutions, journals, conferences, and fields of study.

119 PAPERS • 1 BENCHMARK

GTEA (Georgia Tech Egocentric Activity)

The Georgia Tech Egocentric Activities (GTEA) dataset contains seven types of daily activities such as making sandwich, tea, or coffee. Each activity is performed by four different people, thus totally 28 videos. For each video, there are about 20 fine-grained action instances such as take bread, pour ketchup, in approximately one minute.

112 PAPERS • 2 BENCHMARKS

VATEX (Video And TEXt)

VATEX is multilingual, large, linguistically complex, and diverse dataset in terms of both video and natural language descriptions. It has two tasks for video-and-language research: (1) Multilingual Video Captioning, aimed at describing a video in various languages with a compact unified captioning model, and (2) Video-guided Machine Translation, to translate a source language description into the target language using the video information as additional spatiotemporal context.

108 PAPERS • 3 BENCHMARKS

CC100
CC100

This corpus comprises of monolingual data for 100+ languages and also includes data for romanized languages. This was constructed using the urls and paragraph indices provided by the CC-Net repository by processing January-December 2018 Commoncrawl snapshots. Each file comprises of documents separated by double-newlines and paragraphs within the same document separated by a newline. The data is generated using the open source CC-Net repository.

102 PAPERS • NO BENCHMARKS YET

Kvasir (The Kvasir Dataset)

The KVASIR Dataset was released as part of the medical multimedia challenge presented by MediaEval. It is based on images obtained from the GI tract via an endoscopy procedure. The dataset is composed of images that are annotated and verified by medical doctors, and captures 8 different classes. The classes are based on three anatomical landmarks (z-line, pylorus, cecum), three pathological findings (esophagitis, polyps, ulcerative colitis) and two other classes (dyed and lifted polyps, dyed resection margins) related to the polyp removal process. Overall, the dataset contains 8,000 endoscopic images, with 1,000 image examples per class.

95 PAPERS • 4 BENCHMARKS

CrowdPose

The CrowdPose dataset contains about 20,000 images and a total of 80,000 human poses with 14 labeled keypoints. The test set includes 8,000 images. The crowded images containing homes are extracted from MSCOCO, MPII and AI Challenger.

91 PAPERS • 2 BENCHMARKS

Math23K
Math23K (Math23K for Math Word Problem Solving)

Math23K is a dataset created for math word problem solving, contains 23, 162 Chinese problems crawled from the Internet. Refer to our paper for more details: The dataset is originally introduced in the paper Deep Neural Solver for Math Word Problems. The original files are originally split into train/test split, while other research efforts (https://github.com/2003pro/Graph2Tree) perform the train/dev/test split.

90 PAPERS • 1 BENCHMARK

LUNA16

The LUNA16 (LUng Nodule Analysis) dataset is a dataset for lung segmentation. It consists of 1,186 lung nodules annotated in 888 CT scans.

88 PAPERS • 1 BENCHMARK

DVS128 Gesture
DVS128 Gesture

Comprises 11 hand gesture categories from 29 subjects under 3 illumination conditions.

86 PAPERS • 5 BENCHMARKS

ASPEC (Asian Scientific Paper Excerpt Corpus)

ASPEC, Asian Scientific Paper Excerpt Corpus, is constructed by the Japan Science and Technology Agency (JST) in collaboration with the National Institute of Information and Communications Technology (NICT). It consists of a Japanese-English paper abstract corpus of 3M parallel sentences (ASPEC-JE) and a Japanese-Chinese paper excerpt corpus of 680K parallel sentences (ASPEC-JC). This corpus is one of the achievements of the Japanese-Chinese machine translation project which was run in Japan from 2006 to 2010.

85 PAPERS • NO BENCHMARKS YET

Douban
Douban (Douban Conversation Corpus)

We release Douban Conversation Corpus, comprising a training data set, a development set and a test set for retrieval based chatbot. The statistics of Douban Conversation Corpus are shown in the following table.

81 PAPERS • 4 BENCHMARKS

MPIIGaze

MPIIGaze is a dataset for appearance-based gaze estimation in the wild. It contains 213,659 images collected from 15 participants during natural everyday laptop use over more than three months. It has a large variability in appearance and illumination.

77 PAPERS • 1 BENCHMARK

CoNLL 2002

The shared task of CoNLL-2002 concerns language-independent named entity recognition. The types of named entities include: persons, locations, organizations and names of miscellaneous entities that do not belong to the previous three groups. The participants of the shared task were offered training and test data for at least two languages. Information sources other than the training data might have been used in this shared task.

70 PAPERS • 3 BENCHMARKS

MuPoTS-3D (Multiperson Pose Test Set in 3DMulti-person Pose estimation Test Set in 3D)

MuPoTs-3D (Multi-person Pose estimation Test Set in 3D) is a dataset for pose estimation composed of more than 8,000 frames from 20 real-world scenes with up to three subjects. The poses are annotated with a 14-point skeleton model.

67 PAPERS • 4 BENCHMARKS

CoNaLa
CoNaLa (CMU CoNaLa, the Code/Natural Language Challenge)

The CMU CoNaLa, the Code/Natural Language Challenge dataset is a joint project from the Carnegie Mellon University NeuLab and Strudel labs. Its purpose is for testing the generation of code snippets from natural language. The data comes from StackOverflow questions. There are 2379 training and 500 test examples that were manually annotated. Every example has a natural language intent and its corresponding python snippet. In addition to the manually annotated dataset, there are also 598,237 mined intent-snippet pairs. These examples are similar to the hand-annotated ones except that they contain a probability if the pair is valid.

66 PAPERS • 1 BENCHMARK

CMRC (Chinese Machine Reading Comprehension)

CMRC is a dataset is annotated by human experts with near 20,000 questions as well as a challenging set which is composed of the questions that need reasoning over multiple clues.

65 PAPERS • 11 BENCHMARKS

10,000 People - Human Pose Recognition Data

Description: 10,000 People - Human Pose Recognition Data. This dataset includes indoor and outdoor scenes.This dataset covers males and females. Age distribution ranges from teenager to the elderly, the middle-aged and young people are the majorities. The data diversity includes different shooting heights, different ages, different light conditions, different collecting environment, clothes in different seasons, multiple human poses. For each subject, the labels of gender, race, age, collecting environment and clothes were annotated. The data can be used for human pose recognition and other tasks.

64 PAPERS • NO BENCHMARKS YET

CN-CELEB
CN-CELEB

CN-Celeb is a large-scale speaker recognition dataset collected `in the wild'. This dataset contains more than 130,000 utterances from 1,000 Chinese celebrities, and covers 11 different genres in real world.

64 PAPERS • 1 BENCHMARK

DBP15K
DBP15K

DBP15k contains four language-specific KGs that are respectively extracted from English (En), Chinese (Zh), French (Fr) and Japanese (Ja) DBpedia, each of which contains around 65k-106k entities. Three sets of 15k alignment labels are constructed to align entities between each of the other three languages and En.

63 PAPERS • 3 BENCHMARKS

DuReader

DuReader is a large-scale open-domain Chinese machine reading comprehension dataset. The dataset consists of 200K questions, 420K answers and 1M documents. The questions and documents are based on Baidu Search and Baidu Zhidao. The answers are manually generated. The dataset additionally provides question type annotations – each question was manually annotated as either Entity, Description or YesNo and one of Fact or Opinion.

62 PAPERS • 4 BENCHMARKS

MathVista (Mathematical Reasoning of in Visual Contexts)

MathVista is a consolidated Mathematical reasoning benchmark within Visual contexts. It consists of three newly created datasets, IQTest, FunctionQA, and PaperQA, which address the missing visual domains and are tailored to evaluate logical reasoning on puzzle test figures, algebraic reasoning over functional plots, and scientific reasoning with academic paper figures, respectively. It also incorporates 9 MathQA datasets and 19 VQA datasets from the literature, which significantly enrich the diversity and complexity of visual perception and mathematical reasoning challenges within our benchmark. In total, MathVista includes 6,141 examples collected from 31 different datasets.

62 PAPERS • NO BENCHMARKS YET

WikiANN
WikiANN (PAN-X)

WikiANN, also known as PAN-X, is a multilingual named entity recognition dataset. It consists of Wikipedia articles that have been annotated with LOC (location), PER (person), and ORG (organization) tags in the IOB2 format¹². This dataset serves as a valuable resource for training and evaluating named entity recognition models across various languages.

62 PAPERS • 3 BENCHMARKS

LIP (Look into Person)

The LIP (Look into Person) dataset is a large-scale dataset focusing on semantic understanding of a person. It contains 50,000 images with elaborated pixel-wise annotations of 19 semantic human part labels and 2D human poses with 16 key points. The images are collected from real-world scenarios and the subjects appear with challenging poses and view, heavy occlusions, various appearances and low resolution.

60 PAPERS • 1 BENCHMARK

OSCAR

OSCAR or Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture. The dataset used for training multilingual models such as BART incorporates 138 GB of text.

59 PAPERS • NO BENCHMARKS YET

Contact us on: hello@paperswithcode.com . Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Data policy Cookies policy