Error in loading tokenizer

#11
by yling1105 - opened

When I run the following command,

model_id = "mistralai/Mistral-7B-v0.3"
tokenizer = AutoTokenizer.from_pretrained(model_id)

I keep getting the error:

Exception: data did not match any variant of untagged enum PyPreTokenizerTypeWrapper at line 6952 column 3
Any idea?

Sign up or log in to comment