error from updated tokenizer

#17
by BrentBaccala - opened

I'm having a problem loading this model, it seems to be the same issue described here:

https://github.com/huggingface/transformers/issues/22762

In short, it looks like the tokenizer code was updated, and this model's tokenizer no longer works with the most recent code.

Sign up or log in to comment