malhajar

/

Platypus2-70B-instruct-4bit-gptq

like 0

Hi

Thanks for the version of the llama70b. I am trying to load it in textgen web ui, but it keeps failing.
How can I load it properly?

Thanks in advance,
Ilan

Traceback (most recent call last):

File “D:\oobabooga_windows\text-generation-webui\modules\ui_model_menu.py”, line 196, in load_model_wrapper

shared.model, shared.tokenizer = load_model(shared.model_name, loader)
File “D:\oobabooga_windows\text-generation-webui\modules\models.py”, line 87, in load_model

tokenizer = load_tokenizer(model_name, model)
File “D:\oobabooga_windows\text-generation-webui\modules\models.py”, line 104, in load_tokenizer

tokenizer = AutoTokenizer.from_pretrained(
File “D:\oobabooga_windows\installer_files\env\lib\site-packages\transformers\models\auto\tokenization_auto.py”, line 727, in from_pretrained

return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
File “D:\oobabooga_windows\installer_files\env\lib\site-packages\transformers\tokenization_utils_base.py”, line 1854, in from_pretrained

return cls._from_pretrained(
File “D:\oobabooga_windows\installer_files\env\lib\site-packages\transformers\tokenization_utils_base.py”, line 2017, in _from_pretrained

tokenizer = cls(*init_inputs, **init_kwargs)
File “D:\oobabooga_windows\installer_files\env\lib\site-packages\transformers\models\llama\tokenization_llama.py”, line 156, in init

self.sp_model = self.get_spm_processor()
File “D:\oobabooga_windows\installer_files\env\lib\site-packages\transformers\models\llama\tokenization_llama.py”, line 162, in get_spm_processor

with open(self.vocab_file, "rb") as f:
TypeError: expected str, bytes or os.PathLike object, not NoneType