robbert-v2-dutch-base / tokenizer.json

Commit History

Adding also prefixed emojis
f7bccf7

jirmauritz commited on

Adding emojis to the tokenizer
e9c206c

jirmauritz commited on

Added tokenizer.json config
def0614

Pieter Delobelle commited on