The tokenizer is not custom

#1
by sgugger - opened

This removes the trust_remote_code=True argument from the AutoTokenizer.from_pretrained call which shouldn't be necessary since the tokenizer is not a custom one (there is no custom code for it in the repo).

Matthijs changed pull request status to merged

Sign up or log in to comment