llama2-70b-oasst-sft-v10 / tokenizer_config.json

Commit History

pad embeddings to multiple of 128
0319e91

Andreas Koepf commited on

activate legacy tokenization mode
d9f2927

andreaskoepf commited on