Error: Tokenizer class GemmaTokenizer does not exist or is not currently imported.
#23
by
letgoofthepizza
- opened
Even with pip install -U transformers, I get the following tokenizer error from GemmaTokenizer What could be the reason?
in from_pretrained
raise ValueError(
ValueError: Tokenizer class GemmaTokenizer does not exist or is not currently imported.
letgoofthepizza
changed discussion title from
Tokenizer class GemmaTokenizer does not exist or is not currently imported.
to Error: Tokenizer class GemmaTokenizer does not exist or is not currently imported.
Use "! pip install git+https://github.com/huggingface/transformers" in order to get the latest version of transformers library that supports Gemma.
Reinstalling/updating transformers helped in my case:
pip install -U transformers
osanseviero
changed discussion status to
closed