Error for tokenizer when using use_fast=False
#1
by
Gidz
- opened
This doesn't apply to the other parameter size versions of this model, only the 77M version
Using tokenizer with use_fast=False in this 77M version of the model results in "not a string" error
Could you try load the tokenizer for google/flan-t5-base
? Transformers.js models are only tested with the fast tokenizers, and in this case, does not have the spiece.model file, which is present in the other repo. They seem to use the same tokenizer though.