Throws Warning: tokenizer_config.json is different from the original LlamaTokenizer file. It is either customized or outdated. Should I need to worry about this warning...?

#6
by swaroopv91 - opened

Screenshot 2023-09-17 033753.png

I tried using this model today. I am getting this warning as shown. Should i just ignore it or is it something that i need to worry about ? Please clarify. Thanks in advance.

No it's fine. The tokenizer_config.json is correct , as provided with the Meta Llama CodeLlama 13B Instruct model. You can ignore that message.

swaroopv91 changed discussion status to closed

Sign up or log in to comment