Unable to load Llama-3.2-1B Tokenizer?
#25
by
hawkiyc
- opened
Hi everyone,
I am trying to finetune llama-3.2-1B model. Everything is fine while loading pretrained model with AutoModelForCausalLM.
But I get error message as screenshot while loading llama tokenizer.
And I looked into the "files and versions" page, this model indeed have tokenizer.json file. Why I got above error?
hawkiyc
changed discussion status to
closed
hawkiyc
changed discussion status to
open
I found the reason for this error, I didn't set os.environ["HF_TOKEN"] correctly.
hawkiyc
changed discussion status to
closed