Datasets

9,700 machine learning datasets
Filter by Task
Language Modelling 5 Language Identification 3 Machine Translation 3 Question Answering 3 Cross-Lingual Question Answering 2 Image Retrieval 2 Language Acquisition 2 Multilingual NLP 2 Reading Comprehension 2 Audio Source Separation 1 Automatic Speech Recognition 1 Automatic Speech Recognition (ASR) 1 Chinese Reading Comprehension 1 Chinese Sentence Pair Classification 1 Classification 1 Coreference Resolution 1 Cross-Lingual Document Classification 1 Cross-Lingual NER 1 Cross-Lingual Natural Language Inference 1 Cross-Lingual Sentiment Classification 1 Cross-Lingual Transfer 1 Dependency Parsing 1 FLUE 1 Image Captioning 1 Knowledge Base Question Answering 1 Large Language Model 1 Machine Reading Comprehension 1 Morphological Tagging 1 Multilingual Image-Text Classification 1 Multilingual Machine Comprehension in English Hindi 1 Multilingual text classification 1 Multimodal Deep Learning 1 Multiple-choice 1 Named Entity Recognition 1 Named Entity Recognition (NER) 1 Natural Language Inference 1 Natural Language Understanding 1 Natural Questions 1 Optical Character Recognition (OCR) 1 Paraphrase Generation 1 Part-Of-Speech Tagging 1 Predicate Detection 1 Pretrained Multilingual Language Models 1 Question Generation 1 Reading Comprehension (Few-Shot) 1 Reading Comprehension (One-Shot) 1 Reading Comprehension (Zero-Shot) 1 Semantic Role Labeling 1 Semantic Role Labeling (predicted predicates) 1 Sentence segmentation 1 Sequential sentence segmentation 1 Speaker Verification 1 Speech Recognition 1 Speech Separation 1 Talking Head Generation 1 Text Classification 1 Text Generation 1 Text Segmentation 1 Text-to-Image Generation 1 Token Classification 1 Translation 1 Translation afr-deu 1 Translation afr-eng 1 Translation ara-cat 1 Translation ara-dan 1 Translation ara-eng 1 Translation ara-fra 1 Translation ara-glg 1 Translation ara-ita 1 Translation ara-nob 1 Translation ara-por 1 Translation ara-ron 1 Translation ara-spa 1 Translation ara-swe 1 Translation ast-cat 1 Translation ast-fra 1 Translation ast-glg 1 Translation ast-ita 1 Translation ast-oci 1 Translation ast-por 1 Translation ast-ron 1 Translation ast-spa 1 Translation bel-cat 1 Translation bel-fra 1 Translation bel-glg 1 Translation bel-ita 1 Translation bel-por 1 Translation bel-ron 1 Translation bel-spa 1 Translation bul-deu 1 Translation bul-eng 1 Translation bul-fra 1 Translation bul-ita 1 Translation bul-por 1 Translation bul-ron 1 Translation bul-rus 1 Translation bul-spa 1 Translation bul-ukr 1 Translation cat-ara 1 Translation cat-ast 1 Translation cat-eng 1 Translation cat-fra 1 Translation cat-glg 1 Translation cat-heb 1 Translation cat-ita 1 Translation cat-lav 1 Translation cat-lit 1 Translation cat-oci 1 Translation cat-por 1 Translation cat-ron 1 Translation cat-spa 1 Translation cat-tur 1 Translation ces-eng 1 Translation ces-rus 1 Translation ces-ukr 1 Translation cym-eng 1 Translation dan-ara 1 Translation dan-cat 1 Translation dan-ces 1 Translation dan-eng 1 Translation dan-fra 1 Translation dan-glg 1 Translation dan-heb 1 Translation dan-isl 1 Translation dan-ita 1 Translation dan-nob 1 Translation dan-pol 1 Translation dan-por 1 Translation dan-ron 1 Translation dan-rus 1 Translation dan-spa 1 Translation dan-swe 1 Translation dan-tur 1 Translation dan-ukr 1 Translation deu-afr 1 Translation deu-dan 1 Translation deu-eng 1 Translation deu-isl 1 Translation deu-nob 1 Translation deu-rus 1 Translation deu-spa 1 Translation deu-swe 1 Translation deu-ukr 1 Translation ell-eng 1 Translation eng-afr 1 Translation eng-ara 1 Translation eng-bul 1 Translation eng-cat 1 Translation eng-ces 1 Translation eng-dan 1 Translation eng-deu 1 Translation eng-ell 1 Translation eng-est 1 Translation eng-fin 1 Translation eng-fra 1 Translation eng-hrv 1 Translation eng-hun 1 Translation eng-isl 1 Translation eng-ita 1 Translation eng-kor 1 Translation eng-lav 1 Translation eng-lit 1 Translation eng-nld 1 Translation eng-nob 1 Translation eng-oci 1 Translation eng-por 1 Translation eng-ron 1 Translation eng-rus 1 Translation eng-slk 1 Translation eng-spa 1 Translation eng-srp_Cyrl 1 Translation eng-swe 1 Translation eng-tur 1 Translation eng-ukr 1 Translation est-eng 1 Translation fas-dan 1 Translation fas-fra 1 Translation fas-ita 1 Translation fas-por 1 Translation fas-ron 1 Translation fas-spa 1 Translation fin-bul 1 Translation fin-eng 1 Translation fin-hrv 1 Translation fin-rus 1 Translation fin-slv 1 Translation fin-srp_Cyrl 1 Translation fin-ukr 1 Translation fra-ara 1 Translation fra-ast 1 Translation fra-cat 1 Translation fra-eng 1 Translation fra-glg 1 Translation fra-heb 1 Translation fra-ita 1 Translation fra-lav 1 Translation fra-lit 1 Translation fra-oci 1 Translation fra-por 1 Translation fra-ron 1 Translation fra-rus 1 Translation fra-spa 1 Translation fra-tur 1 Translation fra-ukr 1 Translation gle-eng 1 Translation glg-ara 1 Translation glg-ast 1 Translation glg-cat 1 Translation glg-fra 1 Translation glg-heb 1 Translation glg-ita 1 Translation glg-lav 1 Translation glg-lit 1 Translation glg-oci 1 Translation glg-por 1 Translation glg-ron 1 Translation glg-spa 1 Translation glg-tur 1 Translation heb-cat 1 Translation heb-dan 1 Translation heb-eng 1 Translation heb-fra 1 Translation heb-glg 1 Translation heb-isl 1 Translation heb-ita 1 Translation heb-nob 1 Translation heb-por 1 Translation heb-ron 1 Translation heb-spa 1 Translation heb-swe 1 Translation hrv-deu 1 Translation hrv-eng 1 Translation hrv-fra 1 Translation hrv-ita 1 Translation hrv-por 1 Translation hrv-ron 1 Translation hrv-rus 1 Translation hrv-spa 1 Translation hrv-ukr 1 Translation hun-eng 1 Translation isl-cat 1 Translation isl-ces 1 Translation isl-dan 1 Translation isl-eng 1 Translation isl-fra 1 Translation isl-glg 1 Translation isl-heb 1 Translation isl-ita 1 Translation isl-nob 1 Translation isl-pol 1 Translation isl-por 1 Translation isl-ron 1 Translation isl-spa 1 Translation isl-swe 1 Translation ita-ara 1 Translation ita-ast 1 Translation ita-cat 1 Translation ita-eng 1 Translation ita-fra 1 Translation ita-glg 1 Translation ita-heb 1 Translation ita-lav 1 Translation ita-lit 1 Translation ita-oci 1 Translation ita-por 1 Translation ita-ron 1 Translation ita-rus 1 Translation ita-spa 1 Translation ita-tur 1 Translation kor-eng 1 Translation lav-eng 1 Translation lav-rus 1 Translation lit-eng 1 Translation lit-rus 1 Translation mkd-deu 1 Translation mkd-eng 1 Translation mkd-fra 1 Translation mkd-ita 1 Translation mkd-por 1 Translation mkd-ron 1 Translation mkd-rus 1 Translation mkd-spa 1 Translation mkd-ukr 1 Translation nld-eng 1 Translation nob-ara 1 Translation nob-cat 1 Translation nob-ces 1 Translation nob-dan 1 Translation nob-eng 1 Translation nob-fra 1 Translation nob-glg 1 Translation nob-heb 1 Translation nob-isl 1 Translation nob-ita 1 Translation nob-pol 1 Translation nob-por 1 Translation nob-ron 1 Translation nob-rus 1 Translation nob-spa 1 Translation nob-swe 1 Translation nob-tur 1 Translation nob-ukr 1 Translation oci-ast 1 Translation oci-cat 1 Translation oci-eng 1 Translation oci-fra 1 Translation oci-glg 1 Translation oci-ita 1 Translation oci-por 1 Translation oci-ron 1 Translation oci-spa 1 Translation oci-tur 1 Translation pol-eng 1 Translation pol-rus 1 Translation por-ara 1 Translation por-ast 1 Translation por-cat 1 Translation por-fra 1 Translation por-glg 1 Translation por-heb 1 Translation por-ita 1 Translation por-lav 1 Translation por-lit 1 Translation por-oci 1 Translation por-ron 1 Translation por-rus 1 Translation por-spa 1 Translation por-tur 1 Translation por-ukr 1 Translation ron-ara 1 Translation ron-ast 1 Translation ron-cat 1 Translation ron-fra 1 Translation ron-glg 1 Translation ron-heb 1 Translation ron-ita 1 Translation ron-oci 1 Translation ron-por 1 Translation ron-spa 1 Translation ron-tur 1 Translation ron-ukr 1 Translation rus-ast 1 Translation rus-bul 1 Translation rus-cat 1 Translation rus-ces 1 Translation rus-dan 1 Translation rus-deu 1 Translation rus-eng 1 Translation rus-fin 1 Translation rus-fra 1 Translation rus-glg 1 Translation rus-hrv 1 Translation rus-ita 1 Translation rus-lav 1 Translation rus-lit 1 Translation rus-mkd 1 Translation rus-nob 1 Translation rus-oci 1 Translation rus-por 1 Translation rus-ron 1 Translation rus-slv 1 Translation rus-spa 1 Translation rus-srp_Cyrl 1 Translation rus-swe 1 Translation rus-ukr 1 Translation slk-eng 1 Translation slk-ukr 1 Translation slv-deu 1 Translation slv-eng 1 Translation slv-fra 1 Translation slv-ita 1 Translation slv-por 1 Translation slv-ron 1 Translation slv-rus 1 Translation slv-spa 1 Translation slv-ukr 1 Translation spa-ara 1 Translation spa-ast 1 Translation spa-cat 1 Translation spa-eng 1 Translation spa-fra 1 Translation spa-glg 1 Translation spa-heb 1 Translation spa-ita 1 Translation spa-lav 1 Translation spa-lit 1 Translation spa-oci 1 Translation spa-por 1 Translation spa-ron 1 Translation spa-rus 1 Translation spa-tur 1 Translation srp_Cyrl-deu 1 Translation srp_Cyrl-eng 1 Translation srp_Cyrl-fra 1 Translation srp_Cyrl-ita 1 Translation srp_Cyrl-por 1 Translation srp_Cyrl-ron 1 Translation srp_Cyrl-rus 1 Translation srp_Cyrl-spa 1 Translation srp_Cyrl-ukr 1 Translation swe-ara 1 Translation swe-cat 1 Translation swe-ces 1 Translation swe-dan 1 Translation swe-eng 1 Translation swe-fra 1 Translation swe-glg 1 Translation swe-heb 1 Translation swe-isl 1 Translation swe-ita 1 Translation swe-nob 1 Translation swe-pol 1 Translation swe-por 1 Translation swe-ron 1 Translation swe-rus 1 Translation swe-spa 1 Translation swe-tur 1 Translation swe-ukr 1 Translation tur-eng 1 Translation ukr-ast 1 Translation ukr-bul 1 Translation ukr-cat 1 Translation ukr-ces 1 Translation ukr-dan 1 Translation ukr-deu 1 Translation ukr-eng 1 Translation ukr-fin 1 Translation ukr-fra 1 Translation ukr-glg 1 Translation ukr-hrv 1 Translation ukr-hun 1 Translation ukr-ita 1 Translation ukr-lav 1 Translation ukr-lit 1 Translation ukr-mkd 1 Translation ukr-nob 1 Translation ukr-oci 1 Translation ukr-por 1 Translation ukr-ron 1 Translation ukr-rus 1 Translation ukr-slk 1 Translation ukr-slv 1 Translation ukr-spa 1 Translation ukr-srp_Cyrl 1 Translation ukr-swe 1 Translation ukr-tur 1 Vietnamese Machine Reading Comprehension 1 Visual Question Answering (VQA) 1 Word Embeddings 1 XLM-R 1 Zero-shot Image Retrieval 1 Zero-shot Text Retrieval 1 speech-recognition 1
Filter by Language (clear)
Multilingual English 2858 Chinese 322 German 168 French 145 Spanish 121 Russian 111 Japanese 83 Arabic 82 Italian 79 Portuguese 75 Hindi 68 Korean 54 Vietnamese 54 Turkish 50 Bengali 45 Persian 44 Tamil 41 Dutch 40 Polish 37 Czech 34 Indonesian 34 Danish 31 Finnish 30 Telugu 30 Romanian 29 Urdu 27 Marathi 25 Hungarian 23 Malayalam 22 Mandarin Chinese 22 Swedish 22 Thai 22 Greek 21 Gujarati 20 Basque 19 Estonian 19 Hebrew 19 Bulgarian 18 Kannada 18 Punjabi 17 Slovak 16 Ukrainian 16 Swahili 15 Catalan 14 Croatian 14 Norwegian 14 Slovenian 14 Latvian 13 Assamese 12 Iranian Persian 12 Kazakh 12 Lithuanian 12 Serbian 12 Amharic 11 Kurdish 10 Albanian 9 Armenian 9 Irish 9 Maltese 9 Oriya (macrolanguage) 9 Welsh 9 American Sign Language 8 Georgian 8 Mongolian 8 Sanskrit 8 Sinhala 8 Tagalog 8 Yoruba 8 Azerbaijani 7 Breton 7 Burmese 7 Hausa 7 Icelandic 7 Igbo 7 Macedonian 7 Serbo-Croatian 7 Somali 7 Uzbek 7 Afrikaans 6 Central Kurdish 6 Esperanto 6 Galician 6 Guarani 6 Haitian 6 Odia 6 Oromo 6 Sindhi 6 Bambara 5 Belarusian 5 Egyptian Arabic 5 Filipino 5 Javanese 5 Latin 5 Malagasy 5 Malay (individual language) 5 Nepali (macrolanguage) 5 Norwegian Bokmål 5 Norwegian Nynorsk 5 Quechua 5 Scottish Gaelic 5 Standard Arabic 5 Sundanese 5 Tibetan 5 Tigrinya 5 Wolof 5 Bangala 4 Cebuano 4 Central Khmer 4 Chechen 4 Dhivehi 4 Fulah 4 Ganda 4 Iloko 4 Kabyle 4 Kinyarwanda 4 Kirghiz 4 Lao 4 Lingala 4 Nigerian Pidgin 4 Nyanja 4 South Azerbaijani 4 Tatar 4 Upper Sorbian 4 Western Panjabi 4 Aragonese 3 Bashkir 3 Bavarian 3 Bishnupriya 3 Bosnian 3 Chuvash 3 Erzya 3 Faroese 3 Fon 3 German Sign Language 3 Goan Konkani 3 Maithili 3 Malay (macrolanguage) 3 Romansh 3 Russia Buriat 3 Swati 3 Swiss German 3 Tajik 3 Tsonga 3 Tswana 3 Twi 3 Uighur 3 Waray (Philippines) 3 Xhosa 3 Yiddish 3 Argentine Sign Language 2 Asturian 2 Avaric 2 Aymara 2 Bangladeshi Sign Language 2 Bhojpuri 2 Central Bikol 2 Cherokee 2 Church Slavic 2 Cornish 2 Dimli (individual language) 2 Eastern Mari 2 Ewe 2 Gothic 2 Gulf Arabic 2 Ido 2 Interlingue 2 Inuktitut 2 Jejueo 2 Kalaallisut 2 Kalmyk 2 Karachay-Balkar 2 Komi 2 Komi-Permyak 2 Lezghian 2 Limburgan 2 Livvi 2 Lojban 2 Lombard 2 Low German 2 Lower Sorbian 2 Luo (Kenya and Tanzania) 2 Luxembourgish 2 Manipuri 2 Manx 2 Maori 2 Mazanderani 2 Minangkabau 2 Mingrelian 2 Mirandese 2 Modern Greek 2 Moksha 2 Moroccan Arabic 2 Naxi 2 Neapolitan 2 Nepali (individual language) 2 Newari 2 Northern Frisian 2 Northern Kurdish 2 Northern Luri 2 Northern Sami 2 Occitan (post 1500) 2 Ossetian 2 Pampanga 2 Pedi 2 Piemontese 2 Pushto 2 Rundi 2 Sardinian 2 Shona 2 Sichuan Yi 2 Sicilian 2 Southern Sotho 2 Swiss-German Sign Language 2 Tai 2 Tosk Albanian 2 Turkish Sign Language 2 Turkmen 2 Tuvinian 2 Udmurt 2 Venetian 2 Volapük 2 Walloon 2 Western Frisian 2 Western Mari 2 Wu Chinese 2 Yakut 2 Yue Chinese 2 Zulu 2 Abkhazian 1 Achinese 1 Adyghe 1 Afar 1 Akan 1 Akkadian 1 Akuntsu 1 Ancient Greek 1 Ancient Hebrew 1 Apurinã 1 Arpitan 1 Assyrian Neo-Aramaic 1 Banjar 1 Bemba (Zambia) 1 Bislama 1 Bodo (India) 1 Buginese 1 Central Pashto 1 Chamorro 1 Chavacano 1 Cheyenne 1 Choctaw 1 Chukot 1 Congo Swahili 1 Coptic 1 Corsican 1 Cree 1 Creek 1 Crimean Tatar 1 Dogri (macrolanguage) 1 Dzongkha 1 Extremaduran 1 Fiji Hindi 1 Fijian 1 Friulian 1 Gagauz 1 Gan Chinese 1 Geez 1 Gilaki 1 Greek Sign Language 1 Hakha Chin 1 Hakka Chinese 1 Halh Mongolian 1 Hawaiian 1 Herero 1 Hiri Motu 1 Interlingua (International Auxiliary Language Association) 1 Inupiaq 1 Jamaican Creole English 1 Kabardian 1 Kabuverdianu 1 Kachin 1 Kanuri 1 Kara-Kalpak 1 Karelian 1 Kashmiri 1 Kashubian 1 Khunsari 1 Kikuyu 1 Komi-Zyrian 1 Kongo 1 Krio 1 Kuanyama 1 Kölsch 1 Ladino 1 Lak 1 Latgalian 1 Ligurian 1 Literary Chinese 1 Lozi 1 Lunda 1 Luo (Cameroon) 1 Lushai 1 Marshallese 1 Mbyá Guaraní 1 Mesopotamian Arabic 1 Min Dong Chinese 1 Modern Greek (1453-) 1 Mundurukú 1 Najdi Arabic 1 Narom 1 Nauru 1 Navajo 1 Nayini 1 Ndonga 1 Nigerian Fulfulde 1 North Azerbaijani 1 North Levantine Arabic 1 Northern Uzbek 1 Novial 1 Official Aramaic (700-300 BCE) 1 Old English (ca. 450-1100) 1 Old French 1 Old Russian 1 Old Turkish 1 Pali 1 Pangasinan 1 Papiamento 1 Pennsylvania German 1 Pfaelzisch 1 Picard 1 Pitcairn-Norfolk 1 Plateau Malagasy 1 Pontic 1 Rajasthani 1 Rusyn 1 Samoan 1 Sango 1 Saterfriesisch 1 Scots 1 Shan 1 Silesian 1 Skolt Sami 1 Soi 1 South Levantine Arabic 1 Southern Pashto 1 Sranan Tongo 1 Standard Latvian 1 Swahili (macrolanguage) 1 Swedish Sign Language 1 Tahitian 1 Tetum 1 Tok Pisin 1 Tonga (Tonga Islands) 1 Tonga (Zambia) 1 Tulu 1 Tumbuka 1 Tunisian Arabic 1 Tupinambá 1 Venda 1 Veps 1 Vlaams 1 Vlax Romani 1 Votic 1 Warlpiri 1 West Central Oromo 1 Zaza 1 Zeeuws 1 Zhuang 1 Dogri (individual language) 0 Northern Huishui Hmong 0 Portuguse 0 Saidi Arabic 0 Santali 0

28 dataset results for Multilingual