igorsterner/xlmr-multilingual-sentence-segmentation
Token Classification
•
Updated
•
363
•
2
Edit Models filters
Amharic
English
Arabic
French
Chinese
Hindi
Portuguese
Spanish
Hausa
Russian
Somali
Bengali
Ukrainian
Malay
Japanese
Tamil
Vietnamese
Gujarati
Afrikaans
Welsh
Korean
Turkish
German
Thai
Italian
Panjabi
Estonian
Hungarian
Icelandic
Catalan
Dutch
Swedish
Bulgarian
Czech
Danish
Macedonian
Malayalam
Burmese
Polish
Romanian
Slovenian
Greek
Finnish
Georgian
Lithuanian
Serbian
Belarusian
Armenian
Kannada
Galician
Slovak
Kazakh
Khmer
Telugu
Urdu
Sinhala
Lao
Swahili
Marathi
Sundanese
Persian
Basque
Azerbaijani
Nepali
Sindhi
Indonesian
Latvian
Norwegian
Hebrew
Mongolian
Pashto
Malagasy
Uzbek
Albanian
Yoruba
Croatian
Bosnian
Yiddish
Tagalog
Latin
Quechua
Assamese
Haitian
Maltese
Luxembourgish
Shona
Xhosa
Tajik
Irish
Javanese
Māori
Sanskrit
Kyrgyz
Scottish Gaelic
Breton
Esperanto
Lingala
Occitan
Bashkir
Igbo
Tibetan
Western Frisian
Tatar
Zulu
Turkmen
Kurdish
Faroese
multilingual
Hawaiian
Oriya
Cebuano
Norwegian Nynorsk
Chichewa
Uyghur
Oromo
Samoan
Southern Sotho
Wolof
Ganda
Tigrinya
Kinyarwanda
jw
Kirundi
Tswana
Swati
Ewe
Bambara
Guaraní
Akan
Yue Chinese
Corsican
Iloko
Tsonga
Fijian
Sango
Dzongkha
Hmong
Kongo
Fon
Waray (Philippines)
Kikuyu
Kashmiri
Pedi
Fula
Asturian
Chokwe
Dyula
Kimbundu
Kabiyè
Central Kurdish
Minangkabau
Pangasinan
Papiamento
Achinese
Bhojpuri
Crimean Tatar
Filipino
Kachin
Latgalian
Lushai
Maithili
Shan
Venetian
Awadhi
Balinese
Chhattisgarhi
Magahi
Manipuri
Norwegian Bokmål
Ayacucho Quechua
Egyptian Arabic
Twi
Kabuverdianu
Luo (Kenya and Tanzania)
Moroccan Arabic
Mossi
Umbundu
Bemba (Zambia)
Kabyle
Limburgish
Luba-Lulua
Tumbuka
Kamba (Kenya)
Tamasheq
iw
Nuer
Sardinian
Central Atlas Tamazight
Sicilian
Banjar
Tosk Albanian
Chuvash
Friulian
Northern Kurdish
Ligurian
Lombard
Silesian
Tok Pisin
Undetermined
South Azerbaijani
North Azerbaijani
Buginese
Southwestern Dinka
Divehi
West Central Oromo
Odia
Southern Pashto
Plateau Malagasy
Dari
Santali
Mesopotamian Arabic
Ta'izzi-Adeni Arabic
Tunisian Arabic
ajp
Levantine Arabic
Najdi Arabic
Chechen
Aymara
Central Aymara
Nigerian Fulfulde
Halh Mongolian
Central Kanuri
Standard Latvian
Marathi
Nepali (individual language)
Iranian Persian
Swahili (individual language)
Northern Uzbek
Eastern Yiddish
Standard Malay
Avaric
Bislama
Kara-Kalpak
Komi
Marshallese
Ossetian
Afar
Manx
Zhuang
Romansh
Abkhaz
Venda
Chamorro
Kwanyama
Luba-Katanga
Cornish
Interlingua
Kalaallisut
Southern Ndebele
Navajo
sh
Kanuri
Wolaytta
Hiri Motu
Isoko
Tiv
Tetela
Tonga
Walloon
Zande (individual language)
Baoulé
Yakut
Northern Sami
Dinka
Inuktitut
Ojibwe
Nigerian Pidgin
Hakha Chin
ns
Old English (ca. 450-1100)
Kabardian
Erzya
Newari
Sranan Tongo
Acoli
Adyghe
ber
Chavacano
Chuukese
Cherokee
Seselwa Creole French
Arpitan
Gagauz
Gilbertese
Fiji Hindi
Hiligaynon
Jamaican Creole English
Komi-Permyak
Karachay-Balkar
Northern Luri
Moksha
Morisyen
Western Mari
Pampanga
Pijin
Pohnpeian
Saterfriesisch
Tulu
Tetum
Tuvalu
Tuvinian
Tzotzil
Udmurt
Yapese
Yucateco
Ambulas
Saint Lucian Creole French
Adangme
Adhola
Aguaruna
Akha
Batak Angkola
Southern Altai
Alur
Guerrero Amuzgo
Obolo
Bukiyip
Mapudungun
Basa (Cameroon)
Batak Toba
Betawi
Banggai
Bikol
Bimoba
Boko (Benin)
Eastern Bru
Bodo (India)
Batak Simalungun
Batak Karo
Buriat
Bulu (Cameroon)
Bokobaru
Belize Kriol English
Garifuna
Chuj
Kaqchikel
Chopi
Falam Chin
Asháninka
Chol
San Blas Kuna
Zarma
Eastern Maroon Creole
Kadazan Dusun
Dawro
Northern Emberá
Enga
Maasina Fulfulde
Gofa
Goan Konkani
Gorontalo
Ancient Greek (to 1453)
Swiss German
Guajajára
Wayuu
Guahibo
Eastern Bolivian Guaraní
Gulay
Ngäbere
Huli
Huastec
Sabu
Iban
Keley-I Kallahan
Inga
Iu Mien
Izii
Popti'
Shuar
Caribbean Javanese
Kekchí
Khasi
Khakas
Western Kanjobal
Kosraean
Krio
Kinaray-A
Kuanua
S'gaw Karen
Kituba (Democratic Republic of Congo)
Kumyk
Awa-Cuaiquer
Lango (Uganda)
Lahu
Madurese
Makasar
Mam
Masai
Central Mazahua
Matigsalug Manobo
Motu
Makhuwa-Meetto
Mískito
Kupang Malay
Mon
Dadibi
Manggarai
Maranao
Masbatenyo
Agusan Manobo
Guerrero Nahuatl
Eastern Huasteca Nahuatl
Nias
Ngaju
Nandi
Nande
Woun Meu
Nogai
Nyungwe
Nzima
Querétaro Otomi
Palauan
Paite Chin
Uma
Parauk
Huallaga Huánuco Quechua
K'iche'
Lambayeque Quechua
South Bolivian Quechua
Southern Pastaza Quechua
Cajamarca Quechua
Imbabura Highland Quichua
Northern Pastaza Quichua
Cañar Highland Quichua
Réunion Creole French
Carpathian Romani
Romany
Rawa
Toraja-Sa'dan
Sena
Shipibo-Conibo
Epena
Saraiki
Simte
Supyire Senoufo
Saramaccan
Serer
Susu
Sunwar
Sangir
Sylheti
Tabassaran
Eastern Tamang
Ditammari
Ticuna
Tandroy-Mahafaly Malagasy
Teso
Klingon
Tojolabal
Kok Borok
Tswa
Tausug
Mutu
Termanu
Tzeltal
Tz'utujil
Umbu-Ungu
Kalmyk
Manado Malay
No linguistic content
Zaza
Aragonese
Eastern Balochi
Kanauji
Mari (Russia)
Dombe
Fipa
Garhwali
Guyanese Creole English
Ibibio
Khmu
Southern Luri
Central Melanau
Kedah Malay
Hassaniyya
Sabah Malay
Mewari
Nimadi
Nung (Viet Nam)
Rajasthani
Rakhine
Surjapuri
Syriac
Takestani
Tày
Zapotec
Avestan
Ido
Rundi
Scots
Bihari
Cree
Old Church Slavonic
Interlingue
Efik
Ga
Gun
Herero
Nuosu
Kaonde
San Salvador Kongo
lm
Lozi
Luvale
Lunda
Nauru
Nyaneka
Ruund
Tonga (Zambia)
Inupiaq
Northern Ndebele
Ndonga
Tahitian
Volapük
Geez
Upper Sorbian
Bavarian
Low German
N'Ko
ud
Votic
afa
Central Bikol
kb
Literary Chinese
Eastern Mari
Pāli
Western Panjabi
roa
sem
tp
Wu Chinese
Algerian Arabic
Azerbaijani
Bishnupriya
Russia Buriat
Kashubian
Dimli (individual language)
Lower Sorbian
Dotyali
Emilian
Extremaduran
Western Frisian
Gilaki
Hakka Chinese
in
Lojban
Kölsch
Kwangali
Ladino
Lezghian
Multiple languages
Mirandese
Mazanderani
Min Nan Chinese
Neapolitan
Niuean
Narom
Livvi
Picard
Pennsylvania German
Pfaelzisch
Piemontese
Rusyn
Macedo-Romanian
Samogitian
Northern Sami
Congo Swahili
Tetun Dili
Veps
Vlaams
Võro
Wallisian
Mingrelian
Isthmus Zapotec
Zeeuws
Abu' Arapesh
Arifama-Miniafia
Ankave
Abau
Amarasi
Abé
Abidji
Abkhazian
Abua
Abaza
Ambonese Malay
Inabaknon
Aneme Wake
Abui
Achagua
Gikyode
Achang
Achi
Achuar-Shiwiar
Adele
Adi
Adioukrou
Galo
Amdo Tibetan
Adzera
Argentine Sign Language
Eastern Arrernte
Akeu
Amele
Gulf Arabic
Afrihili
Afrikaans
Agarabi
Angor
Angaataha
Agutaynen
Central Cagayan Agta
Aguacateco
Kahua
Aghul
Ahanta
Arosi
Assyrian Neo-Aramaic
Aimol
Ainu (Japan)
Aja (Benin)
Ajië
Amri Karbi
Akan
Akawaio
Angal Heneng
Aklanon
Siwu
Alladian
Alangan
Gheg Albanian
Alune
Algonquin
Alyawarr
Yanesha'
Hamer-Banna
Amharic
Amis
Ambai
Ama (Papua New Guinea)
Amanab
Alamblak
Amarakaeri
Anmatyerre
Anal
Angika
Denya
Anyin
Pemon
Anindilyakwa
Mufian
Ömie
Bumbita Arapesh
Uab Meto
Sa'a
Apinayé
Arop-Lokep
Apatani
Apurinã
Western Apache
Apalaí
Safeyoka
Akuntsu
Arabic
Standard Arabic
Western Arrarnta
Aragonese
Arhuaco
Arabela
Arapaho
Karo (Brazil)
American Sign Language
Cishingini
Assamese
Dano
Pele-Ata
Zaiwa
Ata Manobo
Ivbie North-Okpela-Arhe
Attié
Atikamekw
Aralle-Tabulahan
Pamplona Atta
Waorani
Anuki
Awiyaana
Avaric
Kotava
Avatime
Au
Avokaya
Awa (Papua New Guinea)
Aekyom
Awara
Aymara
Ayoreo
North Mesopotamian Arabic
San Pedro Amuzgos Amuzgo
Highland Puebla Nahuatl
Bashkir
Baluchi
Bambara
Waimaha
Vengo
Baatonum
Barai
Ghomálá'
Babanki
Northern Bobo Madaré
Girawa
Southern Balochi
Bariai
Kaluli
Bana
Bunama
Baka (South Sudan)
Bahnar
Beaver
Benabena
Belarusian
Bengali
Beembe
Jur Modo
Bafut
Malba Birifor
Mahasu Pahari
Bawm Chin
Tagabawa
Bughotu
Binandere
Bimin
Bima
Biak
Bada (Indonesia)
Bissa
Biangai
bih
Bini
Bislama
Biete
Southern Birifor
Fanamaket
Binumarien
Bedjond
Binukid
Berik
Bakairí
Buhid
Bekwarra
Siksika
Kuwaa
Pa'o Karen
Tai Dam
Balangao
Balantak
Bembe
Kein
Ghayavi
Bomu
Muinane
Somba-Siawari
Bum
Eastern Tawbuid
Bantoanon
Bola
Bora
Tibetan
Anjam
Berom
Bine
Borôro
Bosnian
Tuwuli
Buamu
Koronadal Blaan
Sarangani Blaan
Bandial
Busa
Breton
Brahui
Bassari
Barasana-Eduria
Baga Sitemu
Bassa
Akoose
Batak Dairi
Gagnoa Bété
Biatah Bidayuh
Bete-Bendi
Ntcham
Bugawac
Bulgarian
Baelelea
Baeggu
Burarra
Baybayanon
Bauzi
Bwaidoka
Baniwa
Southern Bobo Madaré
Buli (Ghana)
Buhutu
Baruya
Medumba
Qaqet
Bribri
Mapos Buang
Bisu
Brazilian Sign Language
Brithenig
Chortí
Southern Carrier
Nivaclé
Chácobo
Chipaya
Car Nicobarese
Galibi Carib
Tsimané
Catalan
Cavineña
Chiquitano
Carapana
Chachi
Cashibo-Cacataibo
Cashinahua
Chayahuita
Candoshi-Shapra
Cacua
Comaltepec Chinantec
Chakma
Chiru
Min Dong Chinese
Chamacoco
Eastern Khumi Chin
cel
Czech
Kagayanen
Chiga
Chamorro
Highland Oaxaca Chontal
Chechen
Tabasco Chontal
Ojitlán Chinantec
Chinook jargon
Choctaw
Quiotepec Chinantec
Church Slavic
Chuvash
Chuwabu
Ozumacín Chinantec
Ashéninka Pajonal
Cabécar
Shor
Chuave
Chakavian
Anufo
Chukot
Lealao Chinantec
Caluyanun
Eastern Highland Chatino
Cerma
Emberá-Chamí
Mandarin Chinese
Central Mnong
Mro-Khimi Chin
Khumi Chin
Lalana Chinantec
Montenegrin
Tepetotutla Chinantec
Ngawn Chin
Koreguaje
Colorado
Santa Teresa Cora
Cofán
Coptic
Cornish
Corsican
Caquinte
Wamey
Palantla Chinantec
Ucayali-Yurúa Ashéninka
Ajyíninka Apurucayali
Pichis Ashéninka
South Ucayali Ashéninka
Sãotomense
Southern East Cree
Plains Cree
Northern East Cree
Moose Cree
El Nayar Cora
Iyo'wujwa Chorote
Iyojwa'ja Chorote
Carrier
Chilean Sign Language
Jola-Kasa
Colombian Sign Language
Sochiapam Chinantec
Swampy Cree
Siyin Chin
Tataltepec Chatino
Tedim Chin
Emberá-Catío
Western Highland Chatino
Cubeo
Usila Chinantec
Cuiba
Culina
Teutila Cuicatec
Tepeuxila Cuicatec
Woods Cree
Kwere
Kuwaataay
Nopala Chatino
Welsh
Zotung Chin
Dangaléat
Marik
daf
Dagbani
Gwahatike
Dakota
Danish
Dargwa
Daba
Fataluku
Dendi (Benin)
Dedua
Desano
German
Southern Dagaare
Casiguran Dumagat Agta
Northern Dagara
Dogrib
Daga
Dhangu-Djangu
Zemba
Dehu
Didinga
Digo
Northeastern Dinka
Dimasa
Diriku
Dhivehi
Djambarrpuyngu
Southeastern Dinka
Darlong
Dungan
Dan
Western Dani
Dobu
Dogri (macrolanguage)
Lukpa
Dogosé
Doyayo
Rungus
Drents
Rukai
Daasanach
Labuk-Kinabatangan Kadazan
Toro So Dogon
Duala
Umiray Dumaget Agta
Duruma
Dupaninan Agta
Dii
Dutton World Speedwords
Dawawa
Djimini Senoufo
Jola-Fonyi
Dzongkha
Eastern Bontok
Ekajuk
Standard Estonian
Koti
Modern Greek (1453-)
Emerillon
Mussau-Emira
eml
Markweeta
English
Enlhet
Middle English (1100-1500)
Enxet
Esperanto
Ogea
Ese Ejja
North Alaskan Inupiatun
Northwest Alaska Inupiatun
Central Siberian Yupik
Estonian
Central Yupik
Eton (Cameroon)
Edolo
Ejagham
Basque
Even
Evenki
Ewe
Ewondo
Ezaa
Fasu
Wagi
Faiwol
South Fali
Fang (Equatorial Guinea)
Faroese
Fataleka
Persian
Fanti
Fijian
Finnish
Tornedalen Finnish
Kven Finnish
Fe'fe'
Far Western Muria
Fore
French
Fordata
Middle French (ca. 1400-1600)
Old French (842-ca. 1400)
Northern Frisian
Finnish Sign Language
Adamawa Fulfulde
East Futuna
Borgu Fulfulde
Pular
Western Niger Fulfulde
Central-Eastern Niger Fulfulde
Alekano
Borei
Kandawo
Gan Chinese
Nobonob
Gbaya (Central African Republic)
Galela
Northern Grebo
Gbagyi
Guadeloupean Creole French
Guianese Creole French
Gude
Ga'dang
Umanakaina
Wipi
Kire
Gen
Patpatar
Southern Ghale
Guhu-Samane
Gidar
South Giziga
Gonja
Gokana
Guinea Kpelle
Scottish Gaelic
Irish
Galician
Manx
Middle High German (ca. 1050-1500)
Gamo
Kaansa
Gangte
Zulgo-Gemzek
Ngangam
Gumatj
Western Bolivian Guaraní
Guro
Gogo
Old High German (ca. 750-1050)
Gronings
Gothic
Gor
Guarani
Garo
Southwest Gbaya
Yocoboué Dida
Paraguayan Guaraní
Gujarati
Gumuz
Sea Island Creole English
Guambiano
Mbyá Guaraní
Guayabero
Aché
Farefare
Yanomamö
Gourmanchéma
Gusii
Guanano
Golin
Kuku-Yalanji
Gwichʼin
Gwere
Wè Southern
Northwest Gbaya
Guarayu
Gurani
Eastern Oromo
Hanga
Haitian
Hausa
Havu
Haya
Ancient Hebrew
Serbo-Croatian
Huichol
Hebrew
Helong
Hehe
Herero
Kamwe
Hindi
Hixkaryána
Halia
Matu Chin
Hiri Motu
Hmar
Hmong Njua
Hanunoo
Caribbean Hindustani
Ho
Hopi
Hote
Hrangkhol
Croatian
Hunsrik
Minica Huitoto
Huambisa
Hungarian
Murui Huitoto
San Mateo Del Mar Huave
Hawai'i Creole English
Armenian
Western Armenian
Iatmul
Ibanag
Igbo
Islander Creole English
Ido
Idoma
Amganad Ifugao
Batad Ifugao
Ifè
Tuwali Ifugao
Mayoyao Ifugao
Igede
Ignaciano
Interglossa
Sichuan Yi
Izon
Eastern Canadian Inuktitut
Ika
Inuinnaqtun
Ikwere
Ila
Interlingue
Imbongu
Interlingua (International Auxiliary Language Association)
inc
Indonesian
Ingush
Inoke-Yate
Tuma-Irumu
Ipili
Ikwo
Rigwe
Iraqw
Iraya
Isnag
Esan
Icelandic
Italian
Itelmen
Isekiri
Itawit
Ibatan
Ivatan
Sepik Iwam
Ixil
Ingrian
Izere
Jamamadí
Yabem
Javanese
Jukun Takum
Judeo-Tat
Tol
Machame
Western Juxtlahuaca Mixtec
Jewish Palestinian Aramaic
Japanese
Jarai
Juang
Kalanguya
Kalaallisut
Kannada
Xaasongaxango
Bezhta
Capanahua
Kashmiri
Georgian
Kazakh
Kadiwéu
Camsá
Iwal
Keliko
Kamano
Kafa
Manga Kanuri
Khanty
Tyap
Kalanga
Kutu
Makonde
Tem
Kumam
Karamojong
Tsikimba
Kaningdon-Nindem
Karaim
Kei
Kenyang
Kakwa
Kera
West Kewa
Kukna
Kukele
Koya
Kube
Kaiwá
Kaingang
Abun
Khams Tibetan
Khmer
Koyra Chiini Songhay
Kasua
Kele (Democratic Republic of Congo)
Keapara
Kim
Kilivila
Kikuyu
Kinyarwanda
Kirghiz
Kirmanjki (individual language)
Khiamniungan Naga
Q'anjob'al
Kisar
East Kewa
Odoodee
Kagulu
Kako
Kosarek Yale
Kulung (Nepal)
Kalenjin
Nukna
Maskelynes
Konni
Majukayang Kalinga
Kâte
Kalam
Limos Kalinga
Kom (India)
Kwoma
Kamasau
Kanite
Koma
Kankanaey
Mankanya
Koongo
Kuranko
Kono (Sierra Leone)
Tabo
Kendayan
Kanyok
Cogui
Konkani (macrolanguage)
Komi
Kongo
Konzo
Korean
Kpelle
Komba
Kapingamarangi
Karajá
Korupun-Sela
Korafe-Yegha
Komi-Zyrian
Kobon
Mountain Koiali
Kupsabiny
Mum
Doromu-Koki
Kalagan
Kakabai
Kyenele
Eastern Krahn
Kimré
Northern Kissi
Kandas
Koorete
Karelian
Kurukh
Karon
Shambala
Southern Kalinga
Bafia
Uare
Kaba
Borong
Southern Kisi
Kambaata
Plapo Krumen
Kurti
Kuot
Juǀʼhoan
Kuanyama
Kutep
'Auhelawa
Kuman (Papua New Guinea)
Kuria
Kunimaipa
Kusaal
Kuni-Boazi
Psikye
Border Kuna
Kwaio
Kwara'ae
Kwanga
Konso
Northern Khmer
Konai
Kyaka
Kouya
Keyagana
Kenga
Western Kayah
Kayabí
Kosena
Da'a Kaili
kzj
Kokola
Lacandon
Lambya
Lamba
Lao
Laka (Chad)
Lama (Togo)
Latin
Latvian
Lauje
Label
Lak
Ladakhi
Central Bontok
Luchazi
Tungag
Western Lawa
Laari
Láadan
Lega-Shabunda
Lendu
Lyélé
Lelemi
Lenje
Nomaande
Kara (Papua New Guinea)
Ledo Kaili
Luang
Lingua Franca Nova
Lugbara
Wala
Lega-Mwenga
Lahu Shi
Lhomi
West-Central Limba
Nyindrou
Limbu
Limburgan
Lingala
Sekpele
Liberian English
Lisu
Lithuanian
Liv
Lampung Api
Laki
Lolo
Ladin
Lole
Lele (Chad)
Lamkang
Limbum
Lundayeh
Lobi
Saluan
Logo
Loko
Mongo
Loma (Liberia)
Lobala
Lashi
Saamia
Luxembourgish
Luba-Katanga
Aringa
Ludian
Ganda
Lushootseed
Wanga
Luwo
Lewo
Laz
San Jerónimo Tecóatl Mazatec
Mafa
Marshallese
Jalapa De Díaz Mazatec
Malayalam
map
Chiquihuitlán Mazatec
Huautla Mazatec
Sateré-Mawé
Mampruli
North Moluccan Malay
Western Bukidnon Manobo
Macushi
Dibabawon Manobo
Baba Malay
Mangseng
Ilianen Manobo
Nadëb
Maxakalí
Sarangani Manobo
Maca
Machiguenga
Sharanahua
Matsés
Mbunda
Masana
Coatlán Mixe
Makaa
Ese
Cameroon Mambila
Mada (Nigeria)
Male (Ethiopia)
Melpa
Mengen
Southwestern Tlaxiaco Mixtec
Meyah
Mekeo
Mende (Sierra Leone)
Merey
Meru
Mato
Mano
Pattani Malay
Mogofin
Matal
Wandala
North Mofu
Moba
Mexican Sign Language
Mayo
Mabaan
Morokodo
Mambae
Meta'
Mambwe-Lungu
Matengo
Ma'di
Mauwake
Mbukushu
Maru
Ma'anyan
Atatláhuca Mixtec
Mi'kmaq
Ocotepec Mixtec
Mofu-Gudur
San Miguel El Grande Mixtec
Chayuco Mixtec
Mikasuki
Peñoles Mixtec
Alacatlatzala Mixtec
Pinotepa Nacional Mixtec
Apasco-Apoala Mixtec
Isthmus Mixe
Southern Puebla Mixtec
Ayutla Mixtec
Coatzospan Mixtec
San Juan Colorado Mixtec
Karbi
Macedonian
Mokole
Silacayoapan Mixtec
Makasae
Malagasy
Mape
Bargam
Maltese
To'abaita
Mamanwa
Mangga Buang
Madak
Mbula
Muna
Mundani
Mandinka
Mansi
Manikion
Manyawa
Mwan
Mocoví
Mongondow
Mohawk
Mongolian
Mopán Maya
Moro
Molima
Marba
Maung
Yosondúa Mixtec
Migabac
Mian
Misima-Panaeati
Mbuko
Mamasa
Mising
Maori
North Marquesan
Mangareva
Malay (macrolanguage)
Sankaran Maninka
Musey
Mansaka
Aruamu
Cotabato Manobo
Una
Maiwa (Papua New Guinea)
Moskona
Totontepec Mixe
Wichí Lhamtés Nocten
Mundang
Musgu
Mündü
Musi
Malvi
Murle
Creek
Bo-Ung
Muyang
Manam
Minaveha
Duri
Are
Murrinh-Patha
Sar
Nyamwanga
Kala Lagaw Ya
Mün Chin
Mentawai
Hmong Daw
Tezoatlán Mixtec
Tlahuitoltepec Mixe
Juquila Mixe
Jamiltepec Mixtec
Metlatónoc Mixtec
Burmese
Mbay
Mamara Senoufo
Mundurukú
Muyuw
Masaaba
Macuna
Santa María Zacatepec Mixtec
Wichí Lhamtés Güisnay
Nigeria Mambila
Mazatlán Mixe
Mumuye
Deg
Maiadomu
Southern Nambikuára
Nabak
nah
Nakanai
Khoekhoe
Naasioi
Navajo
Nawuri
Nyemba
Chang Naga
Konyak Naga
South Ndebele
Nggem
Rongmei Naga
Iyo
Central Huasteca Nahuatl
Classical Nahuatl
Northern Puebla Nahuatl
Michoacán Nahuatl
Northern Katang
Chothe Naga
Chumburung
Central Puebla Nahuatl
Ndau
North Ndebele
Ndali
Samba Leko
Ndamba
Ndonga
Ndo
Lutos
Ndogo
Toura (Côte d'Ivoire)
Nepali (macrolanguage)
Dhao
Nafaanra
Northern Ngbandi
Ngombe (Democratic Republic of Congo)
Lomwe
Ngulu
Chiripá
Tetelcingo Nahuatl
Zacatlán-Ahuacatlán-Tepetzintla Nahuatl
Isthmus-Cosoleacaque Nahuatl
Takuu
Naro
Noone
Western Huasteca Nahuatl
Isthmus-Mecayapan Nahuatl
Northern Oaxaca Nahuatl
Nek
Nii
Nilamba
Ninzo
Nganasan
Ngiti
Nocte Naga
Angami Naga
Liangmai Naga
Ao Naga
Nyishi
Nkoya
Inpui Naga
Thangal Naga
Nkonya
Ngombale
Nalca
Dutch
Gela
Maram Naga
Tangkhul Naga (India)
Monsang Naga
Moyon Naga
Nimoa
Nawdm
Maring Naga
Ngiemboon
Northern Rengma Naga
Norwegian Nynorsk
Wancho Naga
Ngindo
Southern Nuni
Norwegian Bokmål
Northern Thai
Old Norse
Numanggang
Norwegian
Nomatsiguenga
Ewage-Notu
Novial
Phom Naga
Southeastern Puebla Nahuatl
Pochuri Naga
Napu
Southern Rengma Naga
Jèrriais
Chokri Naga
Sangtam Naga
Nsenga
Sumi Naga
Nehan
Nali
Tase Naga
Sierra Negra Nahuatl
Northern Tepehuan
Delo
Natügu
Nyole
Nunggubuyu
Tlamacazapa Nahuatl
Namiae
Nyabwa
Southwest Tanna
Middle Newar
Ngando (Democratic Republic of Congo)
Nyanja
Giryama
Nyankole
Nyoro
Nyakyusa-Ngonde
Tigon Mbembe
Njebi
Zeme Naga
obj
Obo Manobo
Occitan (post 1500)
Khana
Northwestern Ojibwa
Ojibwa
Severn Ojibwa
Okpe (Southwestern Edo)
Oku
Orokaiva
Mochi
East Ambae
South Tairora
Olo
Ono
Tohono O'odham
Oksapmin
Oriya (macrolanguage)
Oromo
Old Russian
Ossetian
Ottoman Turkish (1500-1928)
Ot Danum
Mezquital Otomi
Eastern Highland Otomi
Tenango Otomi
oto
Estado de México Otomi
Ottawa
Wayampi
Koonzime
Parecís
Paumarí
Tenharim
Panjabi
Northern Paiute
Páez
Patamona
Parkwa
Mak (Nigeria)
Plautdietsch
Phende
Eastern Penan
Pere
Phimbi
Yine
Piaroa
Pitcairn-Norfolk
Piapoco
Piratapuyo
Pitjantjatjara
Pokomo
Pilagá
San Marcos Tlacoyalco Popoloca
Palikúr
Brooke's Point Palawano
Paama
Pamona
Northern Pame
Poumei Naga
Western Penan
Pontic
Pinyin
San Juan Atzingo Popoloca
Poqomchi'
Highland Popoluca
Polish
Portuguese
Sayula Popoluca
Potawatomi
Upper Guinea Crioulo
Pogolo
Pipil
Folopa
San Luís Temalacayuca Popoloca
Paranan
Prussian
Paicî
Peruvian Sign Language
Ashéninka Perené
Central Malay
Kaulong
Patep
Bambam
Western Highland Purepecha
Puinave
Pushto
Gapapaiwa
Paiwan
Pwo Northern Karen
Quetzaltepec Mixe
Quechua
Chimborazo Highland Quichua
North Bolivian Quechua
Santiago del Estero Quichua
Tena Lowland Quichua
Cusco Quechua
Ambo-Pasco Quechua
Eastern Apurímac Quechua
Huamalíes-Dos de Mayo Huánuco Quechua
Margos-Yarowilca-Lauricocha Quechua
North Junín Quechua
Napo Lowland Quechua
San Martín Quechua
Huaylla Wanca Quechua
Huaylas Ancash Quechua
Panao Huánuco Quechua
Salasaca Highland Quichua
Northern Conchucos Ancash Quechua
Southern Conchucos Ancash Quechua
Quenya
Rade
Ramoaaina
Rapanui
Rarotongan
Sampang
Rawang
Rejang
Rendille
Ringgou
Rohingya
Riang (India)
Tarifit
Nyaturu
Rajbanshi
Rikbaktsa
Angloromani
Baltic Romani
Balkan Romani
Sinte Romani
Caló
Vlax Romani
Ronga
Ranglong
Romansh
Romanian
Rotokas
Kriol
Dela-Oenale
Waima
Rotuman
Gungu
Luguru
Roviana
Russian
Buglere
Sango
Sahu
Sanskrit
Sasak
Saya
Ngambay
Southern Samo
Saliba
Botolan Sambal
Subiya
Soli
Sadri
Sassarese Sardinian
Southern Kurdish
Bukar-Sadung Bidayuh
Semandang
Selkup
Koyraboro Senni Songhai
Secoya
Sehwi
Mag-antsi Ayta
Kipsigis
Shughni
Sebat Bet Gurage
Sursurunga
Tachelhit
Shilluk
Shi
Shuswap
Chadian Arabic
Tachawit
Sidamo
Paasaal
Tumulung Sisaala
Mende (Papua New Guinea)
Sinhala
Sindarin
Xibe
Ume Sami
Sakalava Malagasy
Sissala
Slovak
Salt-Yui
Slovenian
Southern Sami
Lule Sami
Bolinao
Central Sama
Inari Sami
Samoan
Skolt Sami
Shona
Sinaugoro
Sindhi
Noon
Siona
Siane
Selee
Saniyo-Hiyewe
Songomeno
Somali
Songe
Kanasi
Southern Sotho
Miyobe
Spanish
Selepet
Akukem
Saposa
Sabaot
Albanian
Sardinian
Siriano
Serbian
Sirionó
Siroi
Seimat
Spanish Sign Language
Swati
Samberigi
Owa
Southeastern Tepehuan
Sulka
Western Subanon
Suena
Sukuma
Sundanese
Mwaghavul
Sumerian
Swahili (macrolanguage)
Maore Comorian
Swedish
Swabian
Malawi Sena
Suau
Suba
Central Subanen
Classical Syriac
Ngalum
Sakizaya
Lowland Tarahumara
Tahitian
Tamil
Taabwa
Central Tarahumara
Tatar
Tatuyo
Tai
Atayal
Takia
North Tairora
Calamian Tagbanwa
Tboli
Tawala
Tagbanwa
Tabaru
Datooga
Malinaltepec Me'phaa
Torres Strait Creole
Thado Chin
Tepo Krumen
Huehuetla Tepehua
Telugu
Timne
Tereno
Tewa (USA)
Teribe
Tajik
Tagalog
Sudest
Tangoa
Thai
Tharaka
Dangaura Tharu
Tahaggart Tamahaq
Tifal
Tigre
Timugon Murut
Tikar
Timbe
Tigrinya
Tiruray
Takwane
Tokelau
Tsakhur
Upper Necaxa Totonac
Tobelo
Telefol
Talinga-Bwisi
Talysh
Tumak
Haruai
Jewish Babylonian Aramaic (ca. 200-1200 CE)
Tacana
Tanimuca-Retuarã
Kwamera
North Tanna
Whitesands
Ménik
Toba
Coyutla Totonac
Toma
Tonga (Nyasa)
Gitonga
Toki Pona
Tonga (Tonga Islands)
Xicotepec De Juárez Totonac
Papantla Totonac
Highland Totonac
Taupota
Tampulma
Tupinambá
Pisaflores Tepehua
Tlachichilco Tepehua
tpw
Tinputz
Tembé
Toaripi
Copala Triqui
Trinitario
Tarao Naga
San Martín Itunyoso Triqui
Chicahuaxtla Triqui
Sediq
Tswana
Tsonga
Tsishingini
Purepecha
Tektiteko
Bwanabwana
Tooro
Tawallammat Tamajaq
Northeastern Thai
Tuyuca
Central Tunebo
Tupuri
Turkmen
Tula
Tucano
Turkish
Turkana
Southeast Ambrym
Western Tawbuid
Twi
Tewe
Tii
Kayapó
Talossan
Ubir
Uduk
Uighur
Ukrainian
Uripiv-Wala-Rano-Atchin
Urarina
Urubú-Kaapor
Urdu
Urhobo
Urim
Urak Lawoi'
Urat
Sop
Orya
Usarufa
Uspanteco
ut-Hun
Uri
Lote
Uzbek
Southern Uzbek
Vagla
Vaiphei
Huarijio
Venda
Vlaamse Gebarentaal
Vidunda
Vietnamese
Iduna
Makhuwa-Shirima
Makhuwa
Ayautla Mazatec
Volapük
Venezuelan Sign Language
Vunjo
Vute
Waffa
Wapishana
Kaninuwa
Wayana
Warao
Wa
Warlpiri
Yanomámi
Wedau
Weri
Cameroon Pidgin
Wejewa
North Wahgi
Wahau Kenyah
Southern Toussian
Wik-Mungkan
Wiru
Walloon
Wichí Lhamtés Vejoz
Wali (Ghana)
Walmajarri
Mwani
Wantoat
Usan
Wè Northern
Wolof
Hanga Hundi
Garrwa
Waris
Adilabad Gondi
Waskia
Wuvulu-Aua
Waama
Xavánte
Kombio
Kambera
Hdi
Xhosa
Kamula
Antankarana Malagasy
Northern Kankanay
Soga
Konkomba
Liberia Kpelle
Eastern Karaboro
Sambal
Sio
Kasem
Sherpa
Sanumá
Diuxi-Tilantongo Mixtec
Magdalena Peñasco Mixtec
Northern Tlaxiaco Mixtec
Umbrian
Kuo
Yaminahua
Yagua
Yalunka
Yamba
Mayangna
Yao
Yaqui
Nugunu (Cameroon)
Yambeta
Lokaa
Yemba
Yaweyuha
Yucuna
Yiddish
Yimchungru Naga
Yakan
Yele
Angguruk Yali
Iamalele
Yombe
Yongkom
Yoruba
Yareba
Yaouré
Nenets
Nhengatu
Yessan-Mayo
Karkar-Yuri
Yukpa
Yopno
Yau (Morobe Province)
Yuracare
Yawa
Sierra de Juárez Zapotec
Western Tlacolula Valley Zapotec
Ocotlán Zapotec
Cajonos Zapotec
Yareni Zapotec
Miahuatlán Zapotec
Ozolotepec Zapotec
Rincón Zapotec
Santo Domingo Albarradas Zapotec
Tabaa Zapotec
Yatzachi Zapotec
Mitla Zapotec
Coatecas Altas Zapotec
Ngazidja Comorian
Standard Moroccan Tamazight
Chinese
Zia
Zigula
Malay (individual language)
Copainalá Zoque
Zou
Francisco León Zoque
Lachiguiri Zapotec
Choapan Zapotec
Southeastern Ixtlán Zapotec
San Pedro Quiatoni Zapotec
Guevea De Humboldt Zapotec
Santa María Quiegolani Zapotec
Quiavicuzas Zapotec
Lachixío Zapotec
Mixtepec Zapotec
Amatlán Zapotec
Zoogocho Zapotec
San Vicente Coatlán Zapotec
Yalálag Zapotec
Chichicapan Zapotec
Texmelucan Zapotec
Southern Rincon Zapotec
Quioquitani-Quierí Zapotec
Yatee Zapotec
Zulu
Yongbei Zhuang
Zyphe Chin
Languages with no match
Enawené-Nawé
code
zhs
zht
jp
zle
dk
cn
Hre
vn
ma
tc
cz
gmq
zlw
gr
Allar
Nasal
zls
tu
po
bu
sql
esc
chi
py
Kurdish
ge
ger
bat
fiu
gmw
sp
Sa
pe
cpp
gem
iir
ine
itc
sla
urj
du
Tunzu
Fulah
West Ambae
np
aav
alv
bnt
cpf
cus
dra
euq
grk
jap
mkh
nic
phi
pqe
sal
trk
kz
al
Sri Lankan Creole Malay
hn
hk
Malasar
Pe
scandinavia
art
cau
ccs
poz
pqw
sit
tut
sami
Etchemin
qtd
Swedish Sign Language
ly
Tiéyaxo Bozo
Huba
Soninke
Sos Kundi
Arammba
me
ot
esp
ai
pyt
Chambri
foc
ph
ua
zhc
Logudorese Sardinian
Central Tagbanwa
mo
gli
qaf
qpm
Kela (Democratic Republic of Congo)
qm
Classical Armenian
Basa-Gumna
ac
Atemble
Chitwania Tharu
eg
Jiarong
Narua
Akkadian
Beja
hf
Hittite
Khunsari
Makuráp
Nayini
Old Turkish
Southeastern Pomo
Soi
Kangri
ypk
Active filters:
am
beademiguelperez/sentence-transformers-multilingual-e5-small
Sentence Similarity
•
Updated
•
469
rasyosef/bert-mini-amharic-16k
Fill-Mask
•
Updated
•
28
vskchandra/languagetranslator
Updated
Tomlim/myt5-large
Text2Text Generation
•
Updated
•
5
NeuralNovel/whisper-small-hi
Automatic Speech Recognition
•
Updated
•
10
•
2
sivan22/faster-whisper-ivrit-ai-whisper-large-v2-tuned
Automatic Speech Recognition
•
Updated
•
63
•
2
biruh/apple_disease_model
Image Feature Extraction
•
Updated
vicky4s4s/voice_recognition_technology
Automatic Speech Recognition
•
Updated
•
17
•
1
Conner/docuvet-large-whisper
Automatic Speech Recognition
•
Updated
•
3
ikeno-ada/madlad400-3b-mt-bitsandbytes-4bit
Translation
•
Updated
•
51
ikeno-ada/m2m100_418-mt-bitsandbytes-4bit
Translation
•
Updated
•
116
Tomlim/myt5-base
Text2Text Generation
•
Updated
•
1
Tomlim/myt5-small
Text2Text Generation
•
Updated
•
13
ChristianAzinn/labse-gguf
Sentence Similarity
•
Updated
•
837
•
1
ildodeltaRule/multilingual-e5-large
Feature Extraction
•
Updated
•
183
srivatsavdamaraju/api
Automatic Speech Recognition
•
Updated
•
1
aTrain-core/faster-distil-whisper-large-v2
Automatic Speech Recognition
•
Updated
•
17
aTrain-core/faster-whisper-large-v3
Automatic Speech Recognition
•
Updated
•
17
Heng666/madlad400-3b-mt-ct2
Translation
•
Updated
•
3
Heng666/madlad400-3b-mt-ct2-int8
Translation
•
Updated
•
20
Heng666/madlad400-7b-mt-ct2-int8
Translation
•
Updated
•
25
•
1
masakhane/zephyr-7b-gemma-sft-african-alpaca
Text Generation
•
Updated
•
213
•
1
sartifyllc/AviLaBSE
Sentence Similarity
•
Updated
•
374
•
1
rasyosef/bert-amharic-tokenizer-24k
Updated
simonbutt/am_llama3_alpaca
Updated
•
103
simonbutt/am_llama3_dpo
Updated
textdetox/mt5-xl-detox-baseline
Text2Text Generation
•
Updated
•
184
vutuka/llama-3-8b-african-aya-gguf-8bit
Updated
•
44
•
2
botdevringring/lang-id-voxlingua107-ecapa
Audio Classification
•
Updated
•
6