WikiAnn is a dataset for cross-lingual name tagging and linking based on Wikipedia articles in 295 languages.
Source: Cross-lingual Name Tagging and Linking for 282 LanguagesBenchmarks
| Trend | Task | Dataset Variant | Best Model | Paper | Code |
|---|---|---|---|---|---|
|
Wikiann
|
BERT_swedish-ner
|
|||
|
wikiann sk
|
fernet-sk-ner
|
|||
|
HiNER Collapsed
|
HiNER-collapsed-xlm-roberta-base
|
|||
|
WikiAnn (Maltese)
|
BERTu
|
|||
|
HiNER Original
|
HiNER-original-xlm-roberta-large
|
|||
|
HiNER Original
|
HiNER-original-muril-base-cased
|
|||
|
WikiAnn NER
|
WikiAnn NER
|
Papers
| Paper | Code | Results | Date | Stars |
|---|
Dataset Loaders
Tasks
Similar Datasets
Similar Datasets
Usage
License
-
Unknown
Modalities
Languages
-
English
-
French
-
Spanish
-
German
-
Italian
-
Chinese
-
Bengali
-
Multilingual
-
Japanese
-
Russian
-
Portuguese
-
Afrikaans
-
Albanian
-
Amharic
-
Arabic
-
Armenian
-
Bambara
-
Basque
-
Belarusian
-
Breton
-
Bulgarian
-
Catalan
-
Church Slavic
-
Croatian
-
Czech
-
Danish
-
Dutch
-
Erzya
-
Estonian
-
Faroese
-
Finnish
-
Galician
-
Gothic
-
Hebrew
-
Hindi
-
Hungarian
-
Icelandic
-
Indonesian
-
Irish
-
Kazakh
-
Komi-Permyak
-
Korean
-
Latin
-
Latvian
-
Lithuanian
-
Livvi
-
Maltese
-
Manx
-
Marathi
-
Moksha
-
Northern Sami
-
Norwegian
-
Persian
-
Polish
-
Romanian
-
Russia Buriat
-
Sanskrit
-
Scottish Gaelic
-
Serbian
-
Slovak
-
Slovenian
-
Swedish
-
Tagalog
-
Tamil
-
Telugu
-
Thai
-
Turkish
-
Uighur
-
Ukrainian
-
Upper Sorbian
-
Urdu
-
Vietnamese
-
Welsh
-
Wolof
-
Yoruba
-
Afar
-
Abkhazian
-
Achinese
-
Adyghe
-
Akan
-
Tosk Albanian
-
Old English (ca. 450-1100)
-
Official Aramaic (700-300 BCE)
-
Aragonese
-
Egyptian Arabic
-
Assamese
-
Asturian
-
Avaric
-
Aymara
-
South Azerbaijani
-
Azerbaijani
-
Bashkir
-
Bavarian
-
Central Bikol
-
Bislama
-
Banjar
-
Tibetan
-
Bosnian
-
Bishnupriya
-
Buginese
-
Min Dong Chinese
-
Cebuano
-
Chamorro
-
Chechen
-
Choctaw
-
Cherokee
-
Chuvash
-
Cheyenne
-
Central Kurdish
-
Cornish
-
Corsican
-
Cree
-
Crimean Tatar
-
Kashubian
-
Dimli (individual language)
-
Dhivehi
-
Lower Sorbian
-
Dzongkha
-
Modern Greek (1453-)
-
Esperanto
-
Ewe
-
Extremaduran
-
Fijian
-
Arpitan
-
Northern Frisian
-
Western Frisian
-
Fulah
-
Friulian
-
Gagauz
-
Gan Chinese
-
Gilaki
-
Goan Konkani
-
Guarani
-
Gujarati
-
Hakka Chinese
-
Haitian
-
Hausa
-
Hawaiian
-
Serbo-Croatian
-
Herero
-
Fiji Hindi
-
Hiri Motu
-
Igbo
-
Ido
-
Sichuan Yi
-
Inuktitut
-
Interlingue
-
Iloko
-
Interlingua (International Auxiliary Language Association)
-
Inupiaq
-
Jamaican Creole English
-
Javanese
-
Lojban
-
Kara-Kalpak
-
Kabyle
-
Kalaallisut
-
Kannada
-
Kashmiri
-
Georgian
-
Kanuri
-
Kabardian
-
Central Khmer
-
Kikuyu
-
Kinyarwanda
-
Kirghiz
-
Komi
-
Kongo
-
Karachay-Balkar
-
Kölsch
-
Kuanyama
-
Kurdish
-
Ladino
-
Lao
-
Lak
-
Lezghian
-
Ligurian
-
Limburgan
-
Lingala
-
Lombard
-
Northern Luri
-
Latgalian
-
Luxembourgish
-
Ganda
-
Marshallese
-
Maithili
-
Malayalam
-
Eastern Mari
-
Minangkabau
-
Macedonian
-
Malagasy
-
Mongolian
-
Maori
-
Western Mari
-
Malay (macrolanguage)
-
Creek
-
Mirandese
-
Burmese
-
Mazanderani
-
Neapolitan
-
Nauru
-
Navajo
-
Ndonga
-
Low German
-
Nepali (macrolanguage)
-
Newari
-
Norwegian Nynorsk
-
Novial
-
Narom
-
Pedi
-
Nyanja
-
Occitan (post 1500)
-
Oriya (macrolanguage)
-
Oromo
-
Ossetian
-
Pangasinan
-
Pampanga
-
Papiamento
-
Picard
-
Pennsylvania German
-
Pfaelzisch
-
Pitcairn-Norfolk
-
Pali
-
Piemontese
-
Western Panjabi
-
Pontic
-
Pushto
-
Quechua
-
Vlax Romani
-
Romansh
-
Rusyn
-
Rundi
-
Sango
-
Yakut
-
Sicilian
-
Scots
-
Sinhala
-
Samoan
-
Shona
-
Sindhi
-
Somali
-
Southern Sotho
-
Sardinian
-
Sranan Tongo
-
Swati
-
Saterfriesisch
-
Sundanese
-
Swahili (macrolanguage)
-
Silesian
-
Tahitian
-
Tatar
-
Tulu
-
Tetum
-
Tajik
-
Tigrinya
-
Tonga (Tonga Islands)
-
Tok Pisin
-
Tswana
-
Tsonga
-
Turkmen
-
Tumbuka
-
Twi
-
Tuvinian
-
Udmurt
-
Uzbek
-
Venetian
-
Venda
-
Veps
-
Vlaams
-
Volapük
-
Waray (Philippines)
-
Walloon
-
Wu Chinese
-
Kalmyk
-
Xhosa
-
Mingrelian
-
Yiddish
-
Zeeuws
-
Zhuang
-
Zulu
- Unknown
Modalities
Languages
-
English
-
French
-
Spanish
-
German
-
Italian
-
Chinese
-
Bengali
-
Multilingual
-
Japanese
-
Russian
-
Portuguese
-
Afrikaans
-
Albanian
-
Amharic
-
Arabic
-
Armenian
-
Bambara
-
Basque
-
Belarusian
-
Breton
-
Bulgarian
-
Catalan
-
Church Slavic
-
Croatian
-
Czech
-
Danish
-
Dutch
-
Erzya
-
Estonian
-
Faroese
-
Finnish
-
Galician
-
Gothic
-
Hebrew
-
Hindi
-
Hungarian
-
Icelandic
-
Indonesian
-
Irish
-
Kazakh
-
Komi-Permyak
-
Korean
-
Latin
-
Latvian
-
Lithuanian
-
Livvi
-
Maltese
-
Manx
-
Marathi
-
Moksha
-
Northern Sami
-
Norwegian
-
Persian
-
Polish
-
Romanian
-
Russia Buriat
-
Sanskrit
-
Scottish Gaelic
-
Serbian
-
Slovak
-
Slovenian
-
Swedish
-
Tagalog
-
Tamil
-
Telugu
-
Thai
-
Turkish
-
Uighur
-
Ukrainian
-
Upper Sorbian
-
Urdu
-
Vietnamese
-
Welsh
-
Wolof
-
Yoruba
-
Afar
-
Abkhazian
-
Achinese
-
Adyghe
-
Akan
-
Tosk Albanian
-
Old English (ca. 450-1100)
-
Official Aramaic (700-300 BCE)
-
Aragonese
-
Egyptian Arabic
-
Assamese
-
Asturian
-
Avaric
-
Aymara
-
South Azerbaijani
-
Azerbaijani
-
Bashkir
-
Bavarian
-
Central Bikol
-
Bislama
-
Banjar
-
Tibetan
-
Bosnian
-
Bishnupriya
-
Buginese
-
Min Dong Chinese
-
Cebuano
-
Chamorro
-
Chechen
-
Choctaw
-
Cherokee
-
Chuvash
-
Cheyenne
-
Central Kurdish
-
Cornish
-
Corsican
-
Cree
-
Crimean Tatar
-
Kashubian
-
Dimli (individual language)
-
Dhivehi
-
Lower Sorbian
-
Dzongkha
-
Modern Greek (1453-)
-
Esperanto
-
Ewe
-
Extremaduran
-
Fijian
-
Arpitan
-
Northern Frisian
-
Western Frisian
-
Fulah
-
Friulian
-
Gagauz
-
Gan Chinese
-
Gilaki
-
Goan Konkani
-
Guarani
-
Gujarati
-
Hakka Chinese
-
Haitian
-
Hausa
-
Hawaiian
-
Serbo-Croatian
-
Herero
-
Fiji Hindi
-
Hiri Motu
-
Igbo
-
Ido
-
Sichuan Yi
-
Inuktitut
-
Interlingue
-
Iloko
-
Interlingua (International Auxiliary Language Association)
-
Inupiaq
-
Jamaican Creole English
-
Javanese
-
Lojban
-
Kara-Kalpak
-
Kabyle
-
Kalaallisut
-
Kannada
-
Kashmiri
-
Georgian
-
Kanuri
-
Kabardian
-
Central Khmer
-
Kikuyu
-
Kinyarwanda
-
Kirghiz
-
Komi
-
Kongo
-
Karachay-Balkar
-
Kölsch
-
Kuanyama
-
Kurdish
-
Ladino
-
Lao
-
Lak
-
Lezghian
-
Ligurian
-
Limburgan
-
Lingala
-
Lombard
-
Northern Luri
-
Latgalian
-
Luxembourgish
-
Ganda
-
Marshallese
-
Maithili
-
Malayalam
-
Eastern Mari
-
Minangkabau
-
Macedonian
-
Malagasy
-
Mongolian
-
Maori
-
Western Mari
-
Malay (macrolanguage)
-
Creek
-
Mirandese
-
Burmese
-
Mazanderani
-
Neapolitan
-
Nauru
-
Navajo
-
Ndonga
-
Low German
-
Nepali (macrolanguage)
-
Newari
-
Norwegian Nynorsk
-
Novial
-
Narom
-
Pedi
-
Nyanja
-
Occitan (post 1500)
-
Oriya (macrolanguage)
-
Oromo
-
Ossetian
-
Pangasinan
-
Pampanga
-
Papiamento
-
Picard
-
Pennsylvania German
-
Pfaelzisch
-
Pitcairn-Norfolk
-
Pali
-
Piemontese
-
Western Panjabi
-
Pontic
-
Pushto
-
Quechua
-
Vlax Romani
-
Romansh
-
Rusyn
-
Rundi
-
Sango
-
Yakut
-
Sicilian
-
Scots
-
Sinhala
-
Samoan
-
Shona
-
Sindhi
-
Somali
-
Southern Sotho
-
Sardinian
-
Sranan Tongo
-
Swati
-
Saterfriesisch
-
Sundanese
-
Swahili (macrolanguage)
-
Silesian
-
Tahitian
-
Tatar
-
Tulu
-
Tetum
-
Tajik
-
Tigrinya
-
Tonga (Tonga Islands)
-
Tok Pisin
-
Tswana
-
Tsonga
-
Turkmen
-
Tumbuka
-
Twi
-
Tuvinian
-
Udmurt
-
Uzbek
-
Venetian
-
Venda
-
Veps
-
Vlaams
-
Volapük
-
Waray (Philippines)
-
Walloon
-
Wu Chinese
-
Kalmyk
-
Xhosa
-
Mingrelian
-
Yiddish
-
Zeeuws
-
Zhuang
-
Zulu
Languages
-
English
-
French
-
Spanish
-
German
-
Italian
-
Chinese
-
Bengali
-
Multilingual
-
Japanese
-
Russian
-
Portuguese
-
Afrikaans
-
Albanian
-
Amharic
-
Arabic
-
Armenian
-
Bambara
-
Basque
-
Belarusian
-
Breton
-
Bulgarian
-
Catalan
-
Church Slavic
-
Croatian
-
Czech
-
Danish
-
Dutch
-
Erzya
-
Estonian
-
Faroese
-
Finnish
-
Galician
-
Gothic
-
Hebrew
-
Hindi
-
Hungarian
-
Icelandic
-
Indonesian
-
Irish
-
Kazakh
-
Komi-Permyak
-
Korean
-
Latin
-
Latvian
-
Lithuanian
-
Livvi
-
Maltese
-
Manx
-
Marathi
-
Moksha
-
Northern Sami
-
Norwegian
-
Persian
-
Polish
-
Romanian
-
Russia Buriat
-
Sanskrit
-
Scottish Gaelic
-
Serbian
-
Slovak
-
Slovenian
-
Swedish
-
Tagalog
-
Tamil
-
Telugu
-
Thai
-
Turkish
-
Uighur
-
Ukrainian
-
Upper Sorbian
-
Urdu
-
Vietnamese
-
Welsh
-
Wolof
-
Yoruba
-
Afar
-
Abkhazian
-
Achinese
-
Adyghe
-
Akan
-
Tosk Albanian
-
Old English (ca. 450-1100)
-
Official Aramaic (700-300 BCE)
-
Aragonese
-
Egyptian Arabic
-
Assamese
-
Asturian
-
Avaric
-
Aymara
-
South Azerbaijani
-
Azerbaijani
-
Bashkir
-
Bavarian
-
Central Bikol
-
Bislama
-
Banjar
-
Tibetan
-
Bosnian
-
Bishnupriya
-
Buginese
-
Min Dong Chinese
-
Cebuano
-
Chamorro
-
Chechen
-
Choctaw
-
Cherokee
-
Chuvash
-
Cheyenne
-
Central Kurdish
-
Cornish
-
Corsican
-
Cree
-
Crimean Tatar
-
Kashubian
-
Dimli (individual language)
-
Dhivehi
-
Lower Sorbian
-
Dzongkha
-
Modern Greek (1453-)
-
Esperanto
-
Ewe
-
Extremaduran
-
Fijian
-
Arpitan
-
Northern Frisian
-
Western Frisian
-
Fulah
-
Friulian
-
Gagauz
-
Gan Chinese
-
Gilaki
-
Goan Konkani
-
Guarani
-
Gujarati
-
Hakka Chinese
-
Haitian
-
Hausa
-
Hawaiian
-
Serbo-Croatian
-
Herero
-
Fiji Hindi
-
Hiri Motu
-
Igbo
-
Ido
-
Sichuan Yi
-
Inuktitut
-
Interlingue
-
Iloko
-
Interlingua (International Auxiliary Language Association)
-
Inupiaq
-
Jamaican Creole English
-
Javanese
-
Lojban
-
Kara-Kalpak
-
Kabyle
-
Kalaallisut
-
Kannada
-
Kashmiri
-
Georgian
-
Kanuri
-
Kabardian
-
Central Khmer
-
Kikuyu
-
Kinyarwanda
-
Kirghiz
-
Komi
-
Kongo
-
Karachay-Balkar
-
Kölsch
-
Kuanyama
-
Kurdish
-
Ladino
-
Lao
-
Lak
-
Lezghian
-
Ligurian
-
Limburgan
-
Lingala
-
Lombard
-
Northern Luri
-
Latgalian
-
Luxembourgish
-
Ganda
-
Marshallese
-
Maithili
-
Malayalam
-
Eastern Mari
-
Minangkabau
-
Macedonian
-
Malagasy
-
Mongolian
-
Maori
-
Western Mari
-
Malay (macrolanguage)
-
Creek
-
Mirandese
-
Burmese
-
Mazanderani
-
Neapolitan
-
Nauru
-
Navajo
-
Ndonga
-
Low German
-
Nepali (macrolanguage)
-
Newari
-
Norwegian Nynorsk
-
Novial
-
Narom
-
Pedi
-
Nyanja
-
Occitan (post 1500)
-
Oriya (macrolanguage)
-
Oromo
-
Ossetian
-
Pangasinan
-
Pampanga
-
Papiamento
-
Picard
-
Pennsylvania German
-
Pfaelzisch
-
Pitcairn-Norfolk
-
Pali
-
Piemontese
-
Western Panjabi
-
Pontic
-
Pushto
-
Quechua
-
Vlax Romani
-
Romansh
-
Rusyn
-
Rundi
-
Sango
-
Yakut
-
Sicilian
-
Scots
-
Sinhala
-
Samoan
-
Shona
-
Sindhi
-
Somali
-
Southern Sotho
-
Sardinian
-
Sranan Tongo
-
Swati
-
Saterfriesisch
-
Sundanese
-
Swahili (macrolanguage)
-
Silesian
-
Tahitian
-
Tatar
-
Tulu
-
Tetum
-
Tajik
-
Tigrinya
-
Tonga (Tonga Islands)
-
Tok Pisin
-
Tswana
-
Tsonga
-
Turkmen
-
Tumbuka
-
Twi
-
Tuvinian
-
Udmurt
-
Uzbek
-
Venetian
-
Venda
-
Veps
-
Vlaams
-
Volapük
-
Waray (Philippines)
-
Walloon
-
Wu Chinese
-
Kalmyk
-
Xhosa
-
Mingrelian
-
Yiddish
-
Zeeuws
-
Zhuang
-
Zulu
- English
- French
- Spanish
- German
- Italian
- Chinese
- Bengali
- Multilingual
- Japanese
- Russian
- Portuguese
- Afrikaans
- Albanian
- Amharic
- Arabic
- Armenian
- Bambara
- Basque
- Belarusian
- Breton
- Bulgarian
- Catalan
- Church Slavic
- Croatian
- Czech
- Danish
- Dutch
- Erzya
- Estonian
- Faroese
- Finnish
- Galician
- Gothic
- Hebrew
- Hindi
- Hungarian
- Icelandic
- Indonesian
- Irish
- Kazakh
- Komi-Permyak
- Korean
- Latin
- Latvian
- Lithuanian
- Livvi
- Maltese
- Manx
- Marathi
- Moksha
- Northern Sami
- Norwegian
- Persian
- Polish
- Romanian
- Russia Buriat
- Sanskrit
- Scottish Gaelic
- Serbian
- Slovak
- Slovenian
- Swedish
- Tagalog
- Tamil
- Telugu
- Thai
- Turkish
- Uighur
- Ukrainian
- Upper Sorbian
- Urdu
- Vietnamese
- Welsh
- Wolof
- Yoruba
- Afar
- Abkhazian
- Achinese
- Adyghe
- Akan
- Tosk Albanian
- Old English (ca. 450-1100)
- Official Aramaic (700-300 BCE)
- Aragonese
- Egyptian Arabic
- Assamese
- Asturian
- Avaric
- Aymara
- South Azerbaijani
- Azerbaijani
- Bashkir
- Bavarian
- Central Bikol
- Bislama
- Banjar
- Tibetan
- Bosnian
- Bishnupriya
- Buginese
- Min Dong Chinese
- Cebuano
- Chamorro
- Chechen
- Choctaw
- Cherokee
- Chuvash
- Cheyenne
- Central Kurdish
- Cornish
- Corsican
- Cree
- Crimean Tatar
- Kashubian
- Dimli (individual language)
- Dhivehi
- Lower Sorbian
- Dzongkha
- Modern Greek (1453-)
- Esperanto
- Ewe
- Extremaduran
- Fijian
- Arpitan
- Northern Frisian
- Western Frisian
- Fulah
- Friulian
- Gagauz
- Gan Chinese
- Gilaki
- Goan Konkani
- Guarani
- Gujarati
- Hakka Chinese
- Haitian
- Hausa
- Hawaiian
- Serbo-Croatian
- Herero
- Fiji Hindi
- Hiri Motu
- Igbo
- Ido
- Sichuan Yi
- Inuktitut
- Interlingue
- Iloko
- Interlingua (International Auxiliary Language Association)
- Inupiaq
- Jamaican Creole English
- Javanese
- Lojban
- Kara-Kalpak
- Kabyle
- Kalaallisut
- Kannada
- Kashmiri
- Georgian
- Kanuri
- Kabardian
- Central Khmer
- Kikuyu
- Kinyarwanda
- Kirghiz
- Komi
- Kongo
- Karachay-Balkar
- Kölsch
- Kuanyama
- Kurdish
- Ladino
- Lao
- Lak
- Lezghian
- Ligurian
- Limburgan
- Lingala
- Lombard
- Northern Luri
- Latgalian
- Luxembourgish
- Ganda
- Marshallese
- Maithili
- Malayalam
- Eastern Mari
- Minangkabau
- Macedonian
- Malagasy
- Mongolian
- Maori
- Western Mari
- Malay (macrolanguage)
- Creek
- Mirandese
- Burmese
- Mazanderani
- Neapolitan
- Nauru
- Navajo
- Ndonga
- Low German
- Nepali (macrolanguage)
- Newari
- Norwegian Nynorsk
- Novial
- Narom
- Pedi
- Nyanja
- Occitan (post 1500)
- Oriya (macrolanguage)
- Oromo
- Ossetian
- Pangasinan
- Pampanga
- Papiamento
- Picard
- Pennsylvania German
- Pfaelzisch
- Pitcairn-Norfolk
- Pali
- Piemontese
- Western Panjabi
- Pontic
- Pushto
- Quechua
- Vlax Romani
- Romansh
- Rusyn
- Rundi
- Sango
- Yakut
- Sicilian
- Scots
- Sinhala
- Samoan
- Shona
- Sindhi
- Somali
- Southern Sotho
- Sardinian
- Sranan Tongo
- Swati
- Saterfriesisch
- Sundanese
- Swahili (macrolanguage)
- Silesian
- Tahitian
- Tatar
- Tulu
- Tetum
- Tajik
- Tigrinya
- Tonga (Tonga Islands)
- Tok Pisin
- Tswana
- Tsonga
- Turkmen
- Tumbuka
- Twi
- Tuvinian
- Udmurt
- Uzbek
- Venetian
- Venda
- Veps
- Vlaams
- Volapük
- Waray (Philippines)
- Walloon
- Wu Chinese
- Kalmyk
- Xhosa
- Mingrelian
- Yiddish
- Zeeuws
- Zhuang
- Zulu
