test-flex-gpt / tokenizer_config.json

Commit History

tokenizer
08d8d00

oweller2 commited on

switch to gpt2
6a03105

oweller2 commited on

add eos token
3512ae1

oweller2 commited on

init
c46937d

oweller2 commited on