icelandic-gpt-sw3-6.7b-gec / tokenizer_config.json

Commit History

move bos+pad token def to tokenizer_config.json
1d51c7b

gardarjuto commited on

Create tokenizer_config.json
8d0d34d
verified

gardari commited on