sibt-rj/albert-large-urdu
Fill-Mask
•
Updated
Tasks
Fill-Mask
Question Answering
Summarization
Table Question Answering
Text Classification
Text Generation
Text2Text Generation
Token Classification
Translation
Zero-Shot Classification
Conversational
Text-to-Speech
Automatic Speech Recognition
Audio Source Separation
Voice Activity Detection
Image Classification
Object Detection
Image Segmentation
Libraries
Datasets
common_voice
wikipedia
dcep europarl jrc-acquis
squad
bookcorpus
c4
CLUECorpusSmall
parsinlu
oscar
german-nlp-group/german_common_crawl
squad_v2
cnn_dailymail
imagenet
conll2003
librispeech_asr
xsum
PropBank.Br
jrc-acquis
natural_questions
gigaword
OSIAN
1.5B Arabic Corpus
imagenet-21k
ontonotes
multi_nli
OSCAR Arabic Unshuffled
brWaC
wikisql
twitter
mustc
openslr
CoNLL-2012
wmt19
Indo4B
lince
arabic_billion_words
open_subtitles
covost2
w11wo/imdb-javanese
OPUS
mnli
snli
xnli
code_search_net
glue
enh_single
sep_clean
openwebtext
OpenLegalData
blended_skill_talk
wtq
msr_sqa
tab_fact
imdb
race
librispeech
sep_noisy
ai-soco
mc4
common_crawl
fever
xtreme
samsum
trivia_qa
arabic_speech_corpus
Libri1Mix
flaubert
cc100
piaf
emotion
PubMed
DAGW
ag_news
scientific_papers
NST Swedish ASR Database
openbookqa
SAIL 2017
squad2
ms_marco
biomedical literature from Scielo and Pubmed
quoref
docred
gap
winograd_wsc
winogender
OpenSLR
Libri2Mix
Libri3Mix
web_questions
Farasa
wiki_dpr
FQuAD
SQuAD-FR
ComVE
WebNLG
Dart
MLSUM
DRCD
mlsum
id_liputan6
reddit singapore, malaysia
hardwarezone
opus100
interspeech_2021_asr
wmt16
jsut
pib
voxceleb
dihard
array of dataset identifiers
wham
Universal Dependencies
commonsenseqa
arc
qqp
the Pile
BFD
anli
id_newspapers_2018
STSbenchmark
cc_news
AI4Bharat IndicNLP Corpora
dindebat.dk
hestenettet.dk
danish OpenSubtitles
pubmed
MIMIC-III
fquad
arcd
mlqa
germeval_14
Wikipedia
go_emotions
tydiqa
mlsum - es
NQ
Trivia
SQuAD
MLQA
common_gen
wmt14
NSC2018
MNLI
MS MARCO document ranking
muchocine
Indonesian Wikipedia
wikipedia-turkish
JW300 + [Menyo-20k](https://huggingface.co/datasets/menyo20k_mt)
mulit_nli
abhishek/autonlp-data-japanese-sentiment
TQUAD
wer
timit_asr
indosum
EMBO/sd-panels
ccnews-titles-es
CSS10
sts
scancode-rules
trec
Twitter
IndianPolitics
conll2000
ljspeech
LibriMix
break_data
https://arabicspeech.org/
Voicebank
DEMAND
sst-2
oscar (NL)
dbrd
lassy-ud
europarl-mono
conll2002
stsb
SciDocs
msmarco
webqa
dureader
squad_v1_pt
squad_v1
yahoo-answers
Uniref100
Jean-Baptiste/wikiner_fr
Arabic Wikipedia
ALFFA,Gamayun & IWSLT
multi_nli_mismatch
220M words (IndoWiki, IndoWC, News)
discofuse
xquad
Wikihow
CommonCrawl
Arabic poetry from several eras
coqa
eli5
Marefa-NER
triviaqa
nadi
google_wellformed_query
UniRef50
ai2_arc
yelp_polarity
tweets_hate_speech_detection
iapp-wiki-qa-dataset
XQuAD
xsum_nl
quora
bioASQ
arxiv_dataset
emo
sail
susumu2357/squad_v2_sv
cord19
100GB Chinese corpus
big_patent
cifar10
RuReviews
parlament_parla
RuSentiment
indic tts
iiith
Yves/fhnw_swiss_parliament
Interspeech 2021
legal entity recognition
covid_qa_deepset
wiki-mk
time-mk-news-2010-2015
sms_spam
quartz
fon_dataset
vivos
Wikipedia (Hindi, Sanskrit, Gujarati)
Squad
XQuad
Tydiqa
https://github.com/staeiou/arxiv_archive/tree/v1.0.1
masakhaner
cc-news-es
quotes-500K
abhishek/autonlp-data-imdb_eval
RuTweetCorp
socian
bangla-sentiment-benchmark
idjotherwise/autonlp-data-reading_prediction
CC-aligned
custom-book-corpus
wiki-hr
COCA
Spotify Podcasts Dataset
HARD-Arabic-Dataset
marefa-mt
CORD-19
event2Mind
squad-v1
openslr_hindi
trtd56/autonlp-data-wrime_joy_only
malromur
anukaver/EstQA
common_voice, infore_25h
Arabic Poetry Dataset (6th - 21st century)
Oscar Corpus, News, Stories
EMBO/biolang
EMBO/sd-nlp
augmented_codesearchnet
pytorrent
XSUM
Gigaword
JW300
Shuvam/autonlp-data-college_classification
VoxLingua107
Finnish parliament session 2
kazakh_speech_corpus
custom danish dataset
https://github.com/wangcunxiang/SemEval2020-Task4-Commonsense-Validation-and-Explanation
coco
common_voice mn
Tesserae
Phi5
Thomas Aquinas
BembaSpeech
algebra_linear_1d
algebra_linear_1d_composed
measurement_time
numbers_gcd
kowiki
news
OpenSLR 77
DaNE
legal
movies
DAMP-VSEP
Indic TTS Malayalam Speech Corpus
Openslr Malayalam Speech Corpus
SMC Malayalam Speech Corpus
IIIT-H Indic Speech Databases
google
tatoeba
setimes
csmsc
L3CubeMahaSent
SUC 3.0
sqa
shemo
libri1mix
codexglue
bible_para
qasc
quarel
Icelandic portion of the OSCAR corpus from INRIA
LJSpeech
LibriTTS
mgb5
TACDataset
ami
voxconverse
urdu-text-news
aishell
commonvoice
WHAM!
WHAMR!
WSJ0-2Mix
WSJ0-3Mix
Timers and Such
cornell_movie_dialogue
wikimovies
imagenet_21k
created a new dataset based on https://www.openslr.org/92/
NST Estonian ASR Database
Languages
en
es
fr
de
sv
fi
multilingual
zh
ru
ar
it
fa
tr
pt
id
nl
uk
ja
eo
pl
he
da
ro
bg
el
hi
et
lt
no
ca
cs
Chinese
af
vi
hu
is
sl
ms
ko
hr
tl
ht
mr
bn
mt
lv
gl
gu
mk
rw
sg
eu
ur
ig
yo
lg
ny
or
sn
xh
ee
ts
ln
as
jv
si
mn
rn
fy
be
ga
ha
sm
ta
th
ty
to
nso
lb
sq
te
yi
nn
nb
fj
gaa
bcl
crs
guw
niu
tn
ceb
sk
co
wa
cy
ka
st
english
fo
br
mh
ilo
bzs
efi
iso
pag
gil
pap
pon
lua
pis
hy
rm
oc
an
am
zu
ti
tw
bem
kg
lus
loz
swc
tvl
tll
war
ml
gv
hil
bi
lu
lue
ase
gd
km
kn
so
os
ps
se
English
kqn
srn
toi
mg
tt
wo
kw
ho
tiv
zne
wls
run
tpi
ne
az
sv-SE
cv
chk
ber
kwy
mfe
rnd
tum
sc
yap
ve
c++
sw
mi
tk
yue
dv
mos
sh
roa
my
protein
code
ky
lo
su
na
ba
sa
fy-NL
pa-IN
kk
bo
bs
pa
sr
sla
gem
kl
io
ce
ab
zls
zh-tw
luo
French English
cpp
gmw
fiu
inc
afa
cel
ine
zlw
iir
itc
urj
gmq
sem
umb
zle
Cszech Deustch
Cszech English
Cszech Spanish
Cszech French
Cszech Italian
Cszech Swedish
Deustch English
Deustch Spanish
Deustch French
Deustch Italian
Deustch Swedish
English Cszech
English Deustch
English Italian
French Cszech
French Spanish
French Italian
French Swedish
Italian Cszech
Italian Deustch
Italian English
Italian Spanish
Italian French
Italian Swedish
Swedish Cszech
Swedish Deustch
Swedish English
Swedish Spanish
Swedish French
Swedish Italian
sah
hsb
ISO 639-1 code for your language, or `multilingual`
eng
la
thai
ch
gn
nv
mul
jap
cnr
hbs
lzh
grk
bat
trk
kwn
ss
om
lun
ng
zai
kj
nyk
alv
dra
phi
gos
aav
aed
bnt
cpf
csg
csn
cus
euq
mkh
nic
pqe
sal
mfs
prl
tzo
fse
Cszech
Deustch
Swedish
English Spanish
English French
English Swedish
Spanish Cszech
Spanish Deustch
Spanish English
Spanish French
Spanish Italian
Spanish Swedish
Deustch Cszech
French Deustch
ga-IE
ia
rm-sursilv
py
italian
haw
hmn
ku
tg
ug
uz
???
vn
dutch
hi-en
python
zh-HK
fon
scientific english
amh
hau
ibo
kin
lug
pcm
swa
wol
yor
zh-CN
[en]
Java
ks
sd
scn
nap
kab
ssp
yua
scandinavia
art
cau
ccs
map
poz
pqw
sit
tdt
tut
sami
taw
vsl
wal
ach
rm-vallader
Go
php
en de nl es
cnh
Guj
nr
sot
ven
xho
zul
arz
ary
esperanto
xal
nah specifically ncj
Models
1