Tokenizer is missing

#1
by TheBloke - opened

Hi

Thanks for the interesting new model! I'm going to quantize it and help more people find out about it.

You're missing all the tokenizer files from your repo - tokenizer.json, tokenizer.model, tokenizer_config.json.

For my quantisations I have grabbed the files from huggyllama/llama-13b. I could PR them here, but I thought it'd be better if you added them, just in case you've customised them in any way?

Thanks!

PS. Any plans to train this on Llama 2?

Thank you for notifying us of the bug.
We have immediately added the necessary tokenizer-related files.
We are currently considering to update with LLaMA-2, but we don't have a schedule for it yet.

Thank you!

starmpcc changed discussion status to closed

Sign up or log in to comment