syntez
/

parva-tokenizer

Model card Files Files and versions Community

Edit model card

This is a tokenizer for the Parva models, based off of the GPT-Neox tokenizers

Downloads last month: 0

Unable to determine this model's library. Check the docs .

Dataset used to train syntez/parva-tokenizer