ValueError: Tokenizer class GemmaTokenizer does not exist or is not currently imported.
#14
by
xahilmalik
- opened
Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("google/gemma-2b")
model = AutoModelForCausalLM.from_pretrained("google/gemma-2b")
Wired getting this error while loading the model "ValueError: Tokenizer class GemmaTokenizer does not exist or is not currently imported."
xahilmalik
changed discussion status to
closed