error when running tokenizer for inference sample code

#3
by DiggingLace - opened

OSError: FinGPT/fingpt-forecaster_dow30_llama2-7b_lora does not appear to have a file named config.json. Checkout 'https://huggingface.co/FinGPT/fingpt-forecaster_dow30_llama2-7b_lora/main' for available files.

at tokenizer = AutoTokenizer.from_pretrained('FinGPT/fingpt-forecaster_dow30_llama2-7b_lora')

Why?

I have a same problem.
Did you solve it?
Please, can you share the solution?
Many thanks!

FinGPT org
edited Feb 13

It seems like the tokenizer wasn't uploaded to the model.
But you can use the Tokenizer from the Base Llama model, as the tokenizer hasn't been modified.

You'll just need to do:
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-2-7b-chat-hf")

amayuelas changed discussion status to closed

Sign up or log in to comment