gpt2-medium-dutch-embeddings / tokenizer_config.json
wietsedv's picture
add model files
b173545
{
"unk_token": "<unk>",
"bos_token": "<s>",
"eos_token": "</s>",
"add_prefix_space": false
}