romance-sentencepiece / oscar /es-fr-it-pt-ro_64000_unigram.sp.vocab

Commit History

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish
20ab046

versae commited on