llama2-13b-megacode2-oasst / tokenizer_config.json

Commit History

Update tokenizer_config.json
304b668

andreaskoepf commited on

use <|im_start> as bos and <|im_end|> as eos tokens
f498ce7

andreaskoepf commited on

add model
4f577cf

Andreas Koepf commited on