flaubert/flaubert_base_uncased
Fill-Mask
•
Updated
•
21kTasks
Datasets
common_voice
wikipedia
dcep europarl jrc-acquis
squad
bookcorpus
c4
CLUECorpusSmall
parsinlu
oscar
german-nlp-group/german_common_crawl
squad_v2
cnn_dailymail
imagenet
conll2003
librispeech_asr
xsum
PropBank.Br
jrc-acquis
gigaword
OSIAN
1.5B Arabic Corpus
natural_questions
imagenet-21k
ontonotes
multi_nli
OSCAR Arabic Unshuffled
brWaC
wikisql
twitter
mustc
openslr
CoNLL-2012
Indo4B
wmt19
lince
arabic_billion_words
open_subtitles
covost2
mnli
snli
xnli
OPUS
code_search_net
enh_single
sep_clean
openwebtext
blended_skill_talk
OpenLegalData
wtq
tab_fact
msr_sqa
imdb
race
glue
librispeech
sep_noisy
ai-soco
mc4
common_crawl
fever
trivia_qa
xtreme
samsum
Libri1Mix
flaubert
cc100
piaf
DAGW
emotion
PubMed
arabic_speech_corpus
scientific_papers
openbookqa
quoref
docred
gap
winograd_wsc
winogender
ms_marco
ag_news
SAIL 2017
biomedical literature from Scielo and Pubmed
OpenSLR
squad2
w11wo/imdb-javanese
Libri2Mix
Libri3Mix
web_questions
Farasa
wiki_dpr
FQuAD
SQuAD-FR
ComVE
id_liputan6
MLSUM
DRCD
reddit singapore, malaysia
hardwarezone
opus100
interspeech_2021_asr
jsut
array of dataset identifiers
wmt16
voxceleb
dihard
wham
Universal Dependencies
commonsenseqa
arc
qqp
the Pile
id_newspapers_2018
BFD
cc_news
STSbenchmark
anli
dindebat.dk
hestenettet.dk
danish OpenSubtitles
AI4Bharat IndicNLP Corpora
pubmed
mlqa
fquad
go_emotions
Wikipedia
MIMIC-III
common_gen
tydiqa
arcd
NST Swedish ASR Database
germeval_14
mlsum - es
NQ
Trivia
SQuAD
MLQA
Indonesian Wikipedia
NSC2018
MS MARCO document ranking
wikipedia-turkish
wmt14
muchocine
TQUAD
MNLI
mulit_nli
wer
timit_asr
abhishek/autonlp-data-japanese-sentiment
JW300 + [Menyo-20k](https://huggingface.co/datasets/menyo20k_mt)
EMBO/sd-panels
https://arabicspeech.org/
CSS10
sts
scancode-rules
trec
Twitter
IndianPolitics
conll2000
ljspeech
break_data
indosum
Voicebank
DEMAND
LibriMix
sst-2
oscar (NL)
dbrd
lassy-ud
europarl-mono
conll2002
msmarco
SciDocs
squad_v1
yahoo-answers
Marefa-NER
Uniref100
multi_nli_mismatch
webqa
dureader
nadi
coqa
220M words (IndoWiki, IndoWC, News)
Jean-Baptiste/wikiner_fr
eli5
Wikihow
CommonCrawl
Arabic poetry from several eras
triviaqa
xquad
discofuse
mlsum
Yves/fhnw_swiss_parliament
ai2_arc
xsum_nl
susumu2357/squad_v2_sv
tweets_hate_speech_detection
quora
bioASQ
UniRef50
iapp-wiki-qa-dataset
XQuAD
Interspeech 2021
HARD-Arabic-Dataset
100GB Chinese corpus
cifar10
yelp_polarity
parlament_parla
vivos
sms_spam
sail
cord19
google_wellformed_query
RuSentiment
legal entity recognition
Arabic Wikipedia
Arabic Poetry Dataset (6th - 21st century)
indic tts
iiith
wiki-mk
time-mk-news-2010-2015
arxiv_dataset
openslr_hindi
emo
Squad
XQuad
Tydiqa
quartz
socian
bangla-sentiment-benchmark
squad_v1_pt
quotes-500K
mgb5
masakhaner
Spotify Podcasts Dataset
common_voice mn
LJSpeech
LibriTTS
https://github.com/staeiou/arxiv_archive/tree/v1.0.1
created a new dataset based on https://www.openslr.org/92/
abhishek/autonlp-data-imdb_eval
Wikipedia (Hindi, Sanskrit, Gujarati)
EMBO/sd-nlp
malromur
CC-aligned
squad-v1
common_voice, infore_25h
XSUM
Gigaword
custom-book-corpus
movies
https://github.com/wangcunxiang/SemEval2020-Task4-Commonsense-Validation-and-Explanation
anukaver/EstQA
ALFFA,Gamayun & IWSLT
Oscar Corpus, News, Stories
EMBO/biolang
augmented_codesearchnet
pytorrent
JW300
VoxLingua107
Finnish parliament session 2
kazakh_speech_corpus
custom danish dataset
coco
RuTweetCorp
RuReviews
fon_dataset
Tesserae
Phi5
Thomas Aquinas
BembaSpeech
algebra_linear_1d
algebra_linear_1d_composed
measurement_time
numbers_gcd
kowiki
news
OpenSLR 77
DaNE
legal
big_patent
DAMP-VSEP
Indic TTS Malayalam Speech Corpus
Openslr Malayalam Speech Corpus
SMC Malayalam Speech Corpus
IIIT-H Indic Speech Databases
google
tatoeba
setimes
csmsc
L3CubeMahaSent
SUC 3.0
sqa
shemo
marefa-mt
CORD-19
libri1mix
codexglue
bible_para
event2Mind
qasc
quarel
Icelandic portion of the OSCAR corpus from INRIA
TACDataset
ami
voxconverse
urdu-text-news
aishell
commonvoice
WHAM!
WHAMR!
WSJ0-2Mix
WSJ0-3Mix
Timers and Such
cornell_movie_dialogue
wikimovies
imagenet_21k
trtd56/autonlp-data-wrime_joy_only
NST Estonian ASR Database
Languages
en
es
fr
de
sv
fi
multilingual
zh
ru
ar
it
fa
tr
id
pt
nl
uk
ja
eo
pl
da
he
Chinese
ro
bg
el
hi
et
lt
no
ca
cs
af
vi
hu
is
sl
ms
ko
hr
ht
mr
tl
bn
mt
lv
gl
gu
mk
rw
sg
eu
ig
ur
lg
ny
or
sn
xh
yo
ee
ts
ln
as
si
mn
rn
be
ga
sm
ta
th
ty
to
nso
fy
ha
jv
lb
sq
te
yi
nn
nb
fj
gaa
crs
bcl
niu
guw
tn
co
wa
ceb
cy
ka
sk
st
fo
br
mh
bzs
efi
iso
ilo
gil
lua
pag
pap
pon
pis
rm
oc
an
am
hy
zu
english
ti
tw
bem
loz
swc
lus
kg
tll
tvl
ml
gv
bi
lu
hil
lue
war
ase
gd
km
kn
so
os
ps
se
English
kqn
toi
srn
mg
tt
wo
kw
wls
ho
tiv
tpi
run
zne
ne
az
cv
chk
sc
kwy
ber
mfe
tum
rnd
yap
ve
c++
mi
sw
tk
yue
dv
mos
sh
roa
my
protein
code
ky
lo
su
sv-SE
na
ba
sa
fy-NL
pa-IN
kk
bo
bs
pa
sr
gem
kl
io
ce
ab
sla
zh-tw
zls
luo
ine
fiu
zle
itc
ISO 639-1 code for your language, or `multilingual`
cpp
gmq
afa
cel
gmw
iir
inc
sem
umb
urj
zlw
Cszech Deustch
Cszech English
Cszech Spanish
Cszech French
Cszech Italian
Cszech Swedish
Deustch English
Deustch Spanish
Deustch French
Deustch Italian
Deustch Swedish
English Cszech
English Deustch
English Italian
French Cszech
French English
French Spanish
French Italian
French Swedish
Italian Cszech
Italian Deustch
Italian English
Italian Spanish
Italian French
Italian Swedish
Swedish Cszech
Swedish Deustch
Swedish English
Swedish Spanish
Swedish French
Swedish Italian
sah
hsb
eng
la
lzh
thai
ch
gn
nv
mul
jap
cnr
hbs
trk
bat
grk
kwn
ng
kj
om
csn
lun
csg
fse
phi
alv
aed
bnt
dra
zai
nyk
py
ss
mfs
aav
cpf
cus
euq
mkh
nic
pqe
sal
prl
tzo
Cszech
Deustch
Swedish
English Spanish
English French
English Swedish
Spanish Cszech
Spanish Deustch
Spanish English
Spanish French
Spanish Italian
Spanish Swedish
Deustch Cszech
French Deustch
ga-IE
ia
rm-sursilv
haw
hmn
ku
tg
ug
uz
italian
dutch
???
vn
scientific english
zh-HK
hi-en
python
ary
amh
hau
ibo
kin
lug
pcm
swa
wol
yor
[en]
ks
sd
nah specifically ncj
kab
scn
nap
scandinavia
arz
yua
art
cau
ccs
map
poz
pqw
sit
tdt
tut
sami
ssp
taw
vsl
wal
ach
rm-vallader
fon
Go
Java
javascript
php
en de nl es
cnh
Guj
nr
sot
ven
xho
zul
zh-CN
esperanto
xal