Spaces:

yhavinga
/

dutch-tokenizer-arena

Running

add aya

44c3329 8 months ago

106 Bytes



	from transformers import AutoTokenizer

	tokenizer = AutoTokenizer.from_pretrained("CohereForAI/aya-101")