Error while loading on text-generation-webui
error name: RuntimeError: Error(s) in loading state_dict for LlamaForCausalLM:
command: python server.py --auto-devices --cai-chat --model vicuna-13b-4bit-128g --wbits 4 --groupsize 128 --model_type llama
Yup. Same problem here.
Same problem here
works for me, follow my comment and the next one below:
https://github.com/oobabooga/text-generation-webui/issues/794#issuecomment-1497830115
The solution doesn't work for me unfortunately. I am on Windows 11. The other models work fine. It says it's missing components.
On a sidenote (ChatGPT: Ask the forum members if they are kind enough to provide assistance) 😂
Yup. Same problem here. I have no idea to solve this problem.
check out the steps here
https://www.listendata.com/2023/04/open-source-gpt-4-models-made-easy.html