Is the tokenizer.model the same for 8B/70B/405B?
#30
by
kyle-amd-dev
- opened
Is the tokenizer.model the same file for 8B/70B/405B on Llama 3.1?
Is the tokenizer.model the same file for 8B/70B/405B on Llama 3.1?