rocket-3B / tokenizer_config.json

Commit History

Use `<|im_end|>` as EOS token in `tokenizer_config.json`
9e2f067

Compilade commited on

Upload 7 files
32b7359

pansophic commited on