Error while running the code.
I downloaded the oobabaga and downloaded the model and attempted to run it in the software.
But, I get the following error.
tokenizer = LlamaTokenizer.from_pretrained(Path(f"{shared.args.model_dir}/{shared.model_name}/"), clean_up_tokenization_spaces=True)
TypeError: ‘NoneType’ object is not callable
Can anyone help me with this error.
Did you merge the deltas first? You can't run the files in this repo directly. They need to be merged first. Also this repo is v1.0 and has been superseded by v1.1
I have an already merged repo for v1.1 available here: https://huggingface.co/TheBloke/vicuna-13B-1.1-HF
Thanks a lot TheBloke. I implemented your code and it seems to works out
hello, i have the same error with "https://huggingface.co/TheBloke/vicuna-13B-1.1-GPTQ-4bit-128g"
Traceback (most recent call last): File “/home/ryzen/Téléchargements/LLM/oobabooga_linux/text-generation-webui/server.py”, line 68, in load_model_wrapper shared.model, shared.tokenizer = load_model(shared.model_name) File “/home/ryzen/Téléchargements/LLM/oobabooga_linux/text-generation-webui/modules/models.py”, line 103, in load_model tokenizer = load_tokenizer(model_name, model) File “/home/ryzen/Téléchargements/LLM/oobabooga_linux/text-generation-webui/modules/models.py”, line 128, in load_tokenizer tokenizer = LlamaTokenizer.from_pretrained(Path(f"{shared.args.model_dir}/{model_name}/"), clean_up_tokenization_spaces=True) TypeError: ‘NoneType’ object is not callable