gpt2-small-dutch-embeddings / tokenizer_config.json
wietsedv's picture
add model files
5f87768
raw
history blame
108 Bytes
{
"unk_token": "<unk>",
"bos_token": "<s>",
"eos_token": "</s>",
"add_prefix_space": false
}