Commit History

Update tokenizer_config.json
304b668

andreaskoepf commited on

Update special_tokens_map.json
2a7f3b4

andreaskoepf commited on

use <|im_start|> as bos and <|im_end|> as eos tokens
2c45ecf

andreaskoepf commited on

use <|im_start> as bos and <|im_end|> as eos tokens
f498ce7

andreaskoepf commited on

add model
4f577cf

Andreas Koepf commited on