The tokenizer loads too slow.

#1
by DicoTiar - opened

At every moment, when I load this model and tokenizer, as the tokenizer is not implemented in fast_tokenizer, it keeps converting to the fast version.
Can anybody from fireact authors, upload or update this issue?
Thank you in advance.

Sign up or log in to comment