Helsinki-NLP/opus-mt-en-chk
Translation
•
Updated
•
43Tasks
Fill-Mask
Question Answering
Summarization
Table Question Answering
Text Classification
Text Generation
Text2Text Generation
Token Classification
Translation
Zero-Shot Classification
Sentence Similarity
Conversational
Feature Extraction
Text-to-Speech
Automatic Speech Recognition
Audio Source Separation
Audio-to-Audio
Voice Activity Detection
Image Classification
Object Detection
Image Segmentation
Libraries
Datasets
common_voice
wikipedia
conll2003
dcep europarl jrc-acquis
squad
oscar
bookcorpus
CLUECorpusSmall
c4
jsut
parsinlu
cnn_dailymail
squad_v2
librispeech_asr
vctk
mc4
xsum
imagenet
gigaword
ljspeech
librispeech
jrc-acquis
Commonlit-Readibility
natural_questions
PropBank.Br
SemClinBr
multi_nli
OSIAN
1.5B Arabic Corpus
mnli
glue
csmsc
ontonotes
imagenet-21k
samsum
OSCAR Arabic Unshuffled
brWaC
xnli
openslr
code_search_net
wikisql
blended_skill_talk
mustc
arabic_billion_words
CoNLL-2012
twitter
openwebtext
qqp
sep_clean
xtreme
wmt19
coco
snli
libritts
covost2
Indo4B
open_subtitles
lince
enh_single
imdb
emotion
OPUS
common_crawl
oscar (NL)
dbrd
lassy-ud
europarl-mono
conll2002
sep_noisy
race
ai-soco
cc100
OpenLegalData
mlsum
msr_sqa
tab_fact
wtq
ms_marco
Libri1Mix
opus100
OpenSLR
squad2
arabic_speech_corpus
apps
WebNLG
Dart
trivia_qa
fever
the Pile
piaf
Libri2Mix
Libri3Mix
NST Swedish ASR Database
openbookqa
DAGW
scientific_papers
msmarco
PubMed
wsj0_2mix
aishell
div2k
libri-light
flaubert
web_questions
ag_news
quoref
docred
gap
winograd_wsc
winogender
biomedical literature from Scielo and Pubmed
Farasa
SAIL 2017
commonvoice
sst-2
klue
lener_br
dindebat.dk
hestenettet.dk
danish OpenSubtitles
indonlu
ComVE
wmt16
id_liputan6
commonsense_qa
kowiki
news
mls
FQuAD
SQuAD-FR
go_emotions
wiki_dpr
cc_news
wiki_split
common_gen
interspeech_2021_asr
dihard
array of dataset identifiers
wham
Universal Dependencies
MLSUM
aesdd
shemo
Wikipedia
tydiqa
DRCD
LJSpeech
commonsenseqa
arc
voxceleb
dialogue
pib
ic3
igc
cola
ax
mrpc
qnli
rte
sst2
stsb
wnli
reddit singapore, malaysia
hardwarezone
masakhaner
hatexplain
fquad
ccnews-titles-es
mlsum - es
MS MARCO document ranking
tweets_hate_speech_detection
opusbook
CSS10
NSC2018
BFD
mlqa
sts
STSbenchmark
yelp_polarity
IndicNLP
AI4Bharat IndicNLP Corpora
wsj_markets
scancode-rules
trec
Twitter
IndianPolitics
MIMIC-III
pubmed
id_newspapers_2018
Indonesian Wikipedia
parlament_parla
wit
mscoco-it
germeval_14
Wikihow
stsb_multi_mt
timit_asr
spgispeech
librimix
reverb
wsj
conll2000
persian_qa
wmt14
wikipedia-turkish
tapaco
quora
MNLI
cetuc
lapsbm
voxforge
wili_2018
wiki-mk
time-mk-news-2010-2015
wiki-sr
wer
LibriMix
large_spanish_corpus
muchocine
break_data
fairface
TQUAD
indosum
wikiann-conll2003
wikiann
arcd
mulit_nli
Urbansound8k
Voicebank
DEMAND
WHAMR!
Baker
KSS
Thorsten
anli
NQ
Trivia
SQuAD
MLQA
sick
arxiv_dataset
common_voice, infore_25h
Oscar Corpus, News, Stories
augmented_codesearchnet
pytorrent
DKHate - OffensEval2020
Wsj0MixVar
BanglaLM dataset
ai2_arc
cc-news-es
CoNLL-2002
XSUM
Gigaword
HARD-Arabic-Dataset
tweet_qa
JW300
iapp-wiki-qa-dataset
XQuAD
Uniref100
UniRef50
legal entity recognition
VoxLingua107
cnndm
Finnish parliament session 2
100GB Chinese corpus
covid_qa_deepset
kazakh_speech_corpus
Arabic poetry from several eras
Arabic Wikipedia
custom danish dataset
SciDocs
ALFFA,Gamayun & IWSLT
BC5CDR-chemicals
BC4CHEMD
BC5CDR-diseases
ncbi_disease
JNLPBA
BC2GM
tweets
nadi
common_voice mn
RuTweetCorp
RuReviews
RuSentiment
COCA
fon_dataset
kgr10
Tesserae
Phi5
Thomas Aquinas
BembaSpeech
algebra_linear_1d
algebra_linear_1d_composed
measurement_time
numbers_gcd
triviaqa
wiki_lingua
swiss_text_2019
OpenSLR 77
Arabic Poetry Dataset (6th - 21st century)
zeroth_korean
laborotv
gigaspeech
mini-an4
chime4
dirha_wsj
hkust
mini_an4
timit
csj
dns_ins20
libri_light
switchboard
fisher
DaNE
legal
mC4
Dutch_news
sail
big_patent
discofuse
custom-book-corpus
movies
DAMP-VSEP
Indic TTS Malayalam Speech Corpus
Openslr Malayalam Speech Corpus
SMC Malayalam Speech Corpus
IIIT-H Indic Speech Databases
jigsaw
220M words (IndoWiki, IndoWC, News)
google
cord19
renet
yahoo-answers
larazonpublico
es
tatoeba
setimes
AI4D Baamtu Datamation - Automatic Speech Recognition in WOLOF
coqa
L3CubeMahaSent
tedx
SUC 3.0
emo
scitldr
sqa
parsinlu_reading_comprehension
malromur
wiki-sh
wiki-bs
wiki-gr
wiki-hr
wiki-sl
marefa-mt
Marefa-NER
CORD-19
4Dialects
MADAR
CSCS
AQMAR
ANERcorp
libri1mix
squad_v1_pt
sms_spam
codexglue
bible_para
event2Mind
qasc
quarel
quartz
squad_es
Squad
XQuad
Tydiqa
CC-aligned
quotes-500K
food101
image_folder
cifar10
Icelandic portion of the OSCAR corpus from INRIA
IndicGlue
Oscar
funsd
drop
vivos
LibriTTS
mgb5
bioASQ
Spotify Podcasts Dataset
TACDataset
hellaswag
ami
voxconverse
google_wellformed_query
xquad
rick_and_morty
CommonCrawl
openslr_hindi
urdu-text-news
indic tts
iiith
arxiv
google speech commands
WHAM!
WSJ0-2Mix
WSJ0-3Mix
Fluent Speech Commands
Timers and Such
Wikipedia (Hindi, Sanskrit, Gujarati)
Quora
MSR
Google-PAWS
baker
kss
cornell_movie_dialogue
squad-v1
wikimovies
Interspeech 2021
imagenet_21k
squad_v1
NST Estonian ASR Database
Japanese accent dataset
webqa
dureader
xsum_nl
eli5
multi_nli_mismatch
Languages
en
es
fr
de
sv
fi
zh
ru
ar
ja
pt
it
fa
id
nl
tr
da
uk
eo
pl
ro
he
el
no
bg
ca
ko
cs
lt
hi
et
is
vi
bn
af
hu
sl
ms
hr
tl
mr
rw
ht
mk
mt
ig
lg
yo
si
lv
gl
sg
eu
gu
ur
sn
ee
ts
ln
ny
xh
or
ha
as
mn
jv
ta
rn
nb
th
fy
ti
be
ga
ty
to
sm
am
sw
fj
te
nn
lb
yi
sq
tn
ka
br
cy
fo
co
wa
mh
sk
st
wo
zu
kg
hy
an
rm
oc
tw
bi
gv
ml
se
lu
su
dv
km
so
gd
kn
ps
os
sr
kw
ho
mg
tt
az
sc
cv
ve
ne
tk
mi
ba
sh
ch
lo
na
my
ky
bs
sa
io
ab
ce
kl
bo
pa
vn
kk
kj
gn
nv
ng
om
ss
ia
la
py
Go
kr
nr
al
gr
ks
sd
ku
tg
ug
uz
Licenses
apache-2.0
mit
cc-by-4.0
cc-by-nc-4.0
cc-by-sa-3.0
cc-by-sa-4.0
apache 2.0
gpl-3.0
cc by-nc-sa 4.0
cc-by 4.0
cc0-1.0 license
gnu-gpl-3.0
cc-by-nc-sa-3.0
public domain notice
lgpl-lr
cc-by-nc-sa 4.0
apache-2.0-license
any valid license identifier
apache license 2.0
attribution-sharealike 4.0 international
apache
apache-2
cc0
mit license
gnu
cc-by
https://creativecommons.org/licenses/by-nc/4.0/
gnu gplv3
public domain