romance-sentencepiece / oscar

1 contributor

History: 1 commit

versae

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish

20ab046 over 1 year ago

es-fr-it-pt-ro_16000_bpe.sp.model

457 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es-fr-it-pt-ro_16000_bpe.sp.vocab

192 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es-fr-it-pt-ro_16000_unigram.sp.model

465 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es-fr-it-pt-ro_16000_unigram.sp.vocab

242 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es-fr-it-pt-ro_32000_bpe.sp.model

732 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es-fr-it-pt-ro_32000_bpe.sp.vocab

451 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es-fr-it-pt-ro_32000_unigram.sp.model

756 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es-fr-it-pt-ro_32000_unigram.sp.vocab

547 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es-fr-it-pt-ro_64000_bpe.sp.model

1.31 MB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es-fr-it-pt-ro_64000_bpe.sp.vocab

997 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es-fr-it-pt-ro_64000_unigram.sp.model

1.36 MB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es-fr-it-pt-ro_64000_unigram.sp.vocab

1.17 MB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_16000_bpe.100extra.sp.model

470 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_16000_bpe.100extra.sp.vocab

202 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_16000_bpe.sp.model

467 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_16000_bpe.sp.vocab

202 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_16000_unigram.100extra.sp.model

478 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_16000_unigram.100extra.sp.vocab

253 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_16000_unigram.sp.model

476 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_16000_unigram.sp.vocab

253 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_32000_bpe.100extra.sp.model

753 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_32000_bpe.100extra.sp.vocab

470 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_32000_bpe.sp.model

751 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_32000_bpe.sp.vocab

470 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_32000_unigram.100extra.sp.model

774 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_32000_unigram.100extra.sp.vocab

562 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_32000_unigram.sp.model

772 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_32000_unigram.sp.vocab

562 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_64000_bpe.100extra.sp.model

1.33 MB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_64000_bpe.100extra.sp.vocab

1.02 MB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_64000_bpe.sp.model

1.33 MB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_64000_bpe.sp.vocab

1.02 MB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_64000_unigram.100extra.sp.model

1.37 MB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_64000_unigram.100extra.sp.vocab

1.19 MB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_64000_unigram.sp.model

1.37 MB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
es_64000_unigram.sp.vocab

1.19 MB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_16000_bpe.100extra.sp.model

464 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_16000_bpe.100extra.sp.vocab

196 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_16000_bpe.sp.model

461 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_16000_bpe.sp.vocab

196 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_16000_unigram.100extra.sp.model

470 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_16000_unigram.100extra.sp.vocab

244 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_16000_unigram.sp.model

468 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_16000_unigram.sp.vocab

244 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_32000_bpe.100extra.sp.model

743 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_32000_bpe.100extra.sp.vocab

460 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_32000_bpe.sp.model

740 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_32000_bpe.sp.vocab

460 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_32000_unigram.100extra.sp.model

759 kB
LFS

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago
fr_32000_unigram.100extra.sp.vocab

547 kB

BPE and Unigram SentencePiece tokenizers for French, Italian, Portuguese, Romanian, and Spanish over 1 year ago