Is the tokenizer.model the same for 8B/70B/405B?

#30
by kyle-amd-dev - opened

Is the tokenizer.model the same file for 8B/70B/405B on Llama 3.1?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment