Tokenizer is missing!
#6
by
asifahmed
- opened
Hi! The tokenizer file is missing.
Hi, were you unable to load the tokenizer using the directions in the usage section?
tokenizer = AutoTokenizer.from_pretrained("cerebras/btlm-3b-8k-base")
Should be a GPT2TokenizerFast object<class 'transformers.models.gpt2.tokenization_gpt2_fast.GPT2TokenizerFast'>
rskuzma
changed discussion status to
closed