Helsinki-NLP/opus-mt-en-mul
Translation
•
Updated
•
315Tasks
Datasets
wikipedia
common_voice
squad
bookcorpus
c4
CLUECorpusSmall
dcep europarl jrc-acquis
parsinlu
oscar
squad_v2
cnn_dailymail
imagenet
conll2003
librispeech_asr
PropBank.Br
jrc-acquis
xsum
OSIAN
1.5B Arabic Corpus
gigaword
natural_questions
ontonotes
imagenet-21k
multi_nli
OSCAR Arabic Unshuffled
brWaC
wikisql
mustc
openslr
CoNLL-2012
lince
Indo4B
snli
code_search_net
OPUS
wmt19
sep_clean
xnli
mnli
blended_skill_talk
OpenLegalData
wtq
tab_fact
msr_sqa
twitter
librispeech
enh_single
ai-soco
mc4
common_crawl
xtreme
fever
trivia_qa
race
imdb
arabic_billion_words
open_subtitles
samsum
Libri1Mix
sep_noisy
openwebtext
DAGW
flaubert
piaf
emotion
ag_news
cc100
OpenSLR
SAIL 2017
squad2
quoref
docred
gap
winograd_wsc
winogender
glue
biomedical literature from Scielo and Pubmed
openbookqa
Libri2Mix
Libri3Mix
web_questions
w11wo/imdb-javanese
wiki_dpr
FQuAD
SQuAD-FR
PubMed
cc_news
id_liputan6
reddit singapore, malaysia
hardwarezone
array of dataset identifiers
ms_marco
interspeech_2021_asr
opus100
jsut
wmt16
qqp
ComVE
voxceleb
dihard
wham
Universal Dependencies
commonsenseqa
arc
the Pile
STSbenchmark
BFD
dindebat.dk
hestenettet.dk
danish OpenSubtitles
id_newspapers_2018
anli
mlqa
MIMIC-III
Wikipedia
go_emotions
pubmed
tydiqa
mulit_nli
scientific_papers
NQ
Trivia
SQuAD
MLQA
DRCD
Indonesian Wikipedia
arabic_speech_corpus
arcd
fquad
germeval_14
MS MARCO document ranking
wikipedia-turkish
common_gen
timit_asr
wmt14
MNLI
wer
TQUAD
indosum
EMBO/sd-panels
CSS10
muchocine
NST Swedish ASR Database
sts
AI4Bharat IndicNLP Corpora
scancode-rules
trec
Twitter
IndianPolitics
conll2000
ljspeech
break_data
https://arabicspeech.org/
sst-2
Shuffled Dutch section of the OSCAR corpus (https://oscar-corpus.com/)
msmarco
yahoo-answers
SciDocs
Uniref100
220M words (IndoWiki, IndoWC, News)
squad_v1
nadi
eli5
parlament_parla
multi_nli_mismatch
CommonCrawl
triviaqa
coqa
mlsum
Wikihow
Jean-Baptiste/wikiner_fr
UniRef50
Arabic poetry from several eras
xquad
tweets_hate_speech_detection
webqa
dureader
discofuse
Interspeech 2021
emo
xsum_nl
sail
bioASQ
Marefa-NER
Squad
XQuad
Tydiqa
yelp_polarity
cord19
arxiv_dataset
Yves/fhnw_swiss_parliament
movies
squad_v1_pt
quora
custom-book-corpus
quartz
Spotify Podcasts Dataset
vivos
wiki-mk
time-mk-news-2010-2015
masakhaner
sms_spam
shemo
Indic TTS Malayalam Speech Corpus
Openslr Malayalam Speech Corpus
SMC Malayalam Speech Corpus
IIIT-H Indic Speech Databases
Wikipedia (Hindi, Sanskrit, Gujarati)
marefa-mt
MLSUM
created a new dataset based on https://www.openslr.org/92/
common_voice, infore_25h
Arabic Wikipedia
CC-aligned
RuSentiment
ai2_arc
quotes-500K
legal entity recognition
Oscar Corpus, News, Stories
EMBO/sd-nlp
bible_para
L3CubeMahaSent
codexglue
EMBO/biolang
ALFFA,Gamayun & IWSLT
event2Mind
BembaSpeech
susumu2357/squad_v2_sv
XSUM
Gigaword
google
Icelandic portion of the OSCAR corpus from INRIA
socian
bangla-sentiment-benchmark
common_voice mn
sqa
Finnish parliament session 2
JW300 + [Menyo-20k](https://huggingface.co/datasets/menyo20k_mt)
augmented_codesearchnet
pytorrent
JW300
100GB Chinese corpus
CC100
kazakh_speech_corpus
custom danish dataset
https://github.com/wangcunxiang/SemEval2020-Task4-Commonsense-Validation-and-Explanation
coco
RuTweetCorp
RuReviews
fon_dataset
https://github.com/staeiou/arxiv_archive/tree/v1.0.1
Tesserae
Phi5
Thomas Aquinas
algebra_linear_1d
algebra_linear_1d_composed
measurement_time
numbers_gcd
kowiki
news
OpenSLR 77
DaNE
legal
DAMP-VSEP
tatoeba
setimes
csmsc
SUC 3.0
libri1mix
qasc
quarel
cifar10
LJSpeech
LibriTTS
mgb5
TACDataset
ami
voxconverse
Farasa
openslr_hindi
urdu-text-news
Voicebank
DEMAND
WHAM!
WHAMR!
WSJ0-2Mix
WSJ0-3Mix
Timers and Such
wikimovies
imagenet_21k
mlsum - es
HARD-Arabic-Dataset
google_wellformed_query
Languages
en
es
fr
sv
de
fi
multilingual
zh
ru
ar
fa
it
id
pt
tr
nl
uk
eo
ja
pl
da
Chinese
bg
ro
he
el
hi
no
cs
lt
ca
af
et
vi
hu
sl
is
ms
ko
ht
hr
mr
tl
bn
mt
lv
gl
gu
mk
eu
ig
rw
ur
lg
ny
or
sn
xh
ee
ts
ln
yo
as
si
mn
rn
ga
be
sm
ta
ty
to
nso
fy
ha
jv
lb
sq
te
yi
nb
fj
nn
gaa
bcl
guw
crs
tn
niu
co
wa
ceb
cy
ka
st
br
mh
fo
ilo
bzs
efi
iso
pap
gil
pon
pis
lua
pag
rm
oc
an
am
hy
sk
th
zu
ti
tw
bem
kg
lus
loz
swc
tll
tvl
ml
english
gv
bi
war
ase
lu
lue
hil
gd
km
kn
so
os
ps
se
kqn
srn
toi
mg
tt
wo
kw
ho
tiv
zne
wls
tpi
run
ne
az
cv
tum
mfe
ber
chk
kwy
sc
yap
rnd
ve
c++
mi
sw
tk
dv
yue
mos
sh
roa
code
my
protein
ky
lo
su
sa
na
ba
pa-IN
English
fy-NL
kk
bo
bs
pa
sr
sla
kl
io
ce
ab
ISO 639-1 code for your language, or `multilingual`
luo
gem
gmq
cel
itc
umb
zls
iir
fiu
gmw
afa
cpp
sem
sv-SE
urj
zle
inc
zlw
ine
French
sah
hsb
la
eng
jap
ch
gn
nv
mul
zh-tw
py
grk
ga-IE
kj
bat
trk
om
ss
lzh
euq
ng
aav
dra
alv
kwn
nyk
phi
lun
bnt
cpf
sal
fse
mkh
aed
cus
csg
csn
nic
pqe
mfs
prl
tzo
zai
Cszech
Deustch
Swedish
ia
rm-sursilv
cnr
hbs
haw
hmn
ku
tg
ug
uz
italian
scientific english
ks
sd
dutch
hi-en
???
[en]
amh
hau
ibo
kin
lug
pcm
swa
wol
yor
zh-HK
nah specifically ncj
cau
tut
taw
Guj
ssp
scn
nap
art
Deustch English
scandinavia
kab
ccs
map
sami
poz
pqw
sit
tdt
yua
vsl
wal
vn
ach
Cszech Deustch
Cszech English
Cszech Spanish
Cszech French
Cszech Italian
Cszech Swedish
Deustch Cszech
Deustch Spanish
Deustch French
Deustch Italian
Deustch Swedish
English Cszech
English Deustch
English Italian
French Cszech
French Deustch
French English
French Spanish
French Italian
French Swedish
Italian Cszech
Italian Deustch
Italian English
Italian Spanish
Italian French
Italian Swedish
Swedish Cszech
Swedish Deustch
Swedish English
Swedish Spanish
Swedish French
Swedish Italian
rm-vallader
fon
Go
Java
javascript
php
python
en de nl es
cnh
nr
sot
ven
xho
zul
arz
ary
esperanto
xal
Models
12
Helsinki-NLP/opus-mt-mul-en
Translation
•
Updated
•
239
Helsinki-NLP/opus-mt-en-gem
Translation
•
Updated
•
58
Helsinki-NLP/opus-mt-gem-en
Translation
•
Updated
•
51
Helsinki-NLP/opus-mt-en-gmq
Translation
•
Updated
•
39
Helsinki-NLP/opus-mt-gmq-en
Translation
•
Updated
•
32
Helsinki-NLP/opus-mt-gem-gem
Translation
•
Updated
•
29
Helsinki-NLP/opus-mt-fi_nb_no_nn_ru_sv_en-SAMI
Translation
•
Updated
•
23
Helsinki-NLP/opus-mt-gmq-gmq
Translation
•
Updated
•
23
Helsinki-NLP/opus-mt-en-ine
Translation
•
Updated
Helsinki-NLP/opus-mt-ine-en
Translation
•
Updated
Helsinki-NLP/opus-mt-ine-ine
Translation
•
Updated