Missing tokenizer
#1
by
zuhashaik
- opened
There is a missing tokenizer in this repo try to update it, it'll be usefull
Our tokenizers are not compatible with the transformers.AutoTokenizer class. We have provided the instructions and custom tokenizers in the github repo.
zuhashaik
changed discussion status to
closed
The custom tokenizer script is missing from the github repo, can you please help even the uri is not working