mideind
/

icelandic-gpt-sw3-6.7b-gec

icelandic-gpt-sw3-6.7b-gec / tokenizer_config.json

move bos+pad token def to tokenizer_config.json

1d51c7b 8 months ago

110 Bytes

	{
	"name_or_path": "AI-Sweden-Models/gpt-sw3-6.7b",
	"bos_token": "<\|endoftext\|>",
	"pad_token": "<unk>"
	}