proofGPT-v0.1 / tokenizer_config.json

Commit History

Modified tokenizer_config.json, now includes <|endoftext|> token
9695b51

zhangirazerbayev commited on