custom-tokenizer / merges.txt
ocolegro's picture
Upload tokenizer
753d073
raw
history blame
52 Bytes
#version: 0.2 - Trained by `huggingface/tokenizers`