File size: 367 Bytes
040dc35
f529b7b
040dc35
 
eaf2d97
1
2
3
4
5
6
fleurs: https://huggingface.co/datasets/google/fleurs via eval.py
floresp-v2.0-rc.3: https://huggingface.co/datasets/openlanguagedata/flores_plus
glottolog_languoid.csv: https://glottolog.org/meta/downloads
ScriptCodes.csv: https://www.unicode.org/iso15924/iso15924-codes.html
spbleu: https://github.com/facebookresearch/flores/tree/main/flores200#spm-and-dictionary