Spaces:

yhavinga
/

dutch-tokenizer-arena

Running

add more tokenizer

c75633b 9 months ago

103 Bytes

	from transformers import AutoTokenizer

	tokenizer = AutoTokenizer.from_pretrained('google/byt5-small')