text-generation-webui doesn't launch
I get this :( I notice a little bump in RAM but nothing happens. Any idea why? Any tips? I am using the -no act model, and the vicuna 7b loads if I set my page file size to 100 gb.
Update: I download the .pt model from this post:
https://huggingface.co/TheBloke/wizardLM-7B-GPTQ/discussions/6#644b1a6e3a619fe72b17af1e
that model works but not the .safetensors file...
So if anyone is having the same problem use the .pt file :)
Sorry not to get back to you.
The compat.no-act-order.safetensors files from my repo should work for you in text-generation-webui. I'm not sure why it didn't.
But if the other file works for you then fair enough!
Thank you for the time, don't worry. And thank you for your models.
I have just downloaded and try the compat.no-act-order.safetensors one, to be sure, but it doesn't load. Again a small bump in RAM but just that. It is like it is trying to load it but then the process stops. It is very strange, but yes, I think the program just want .pt files and hates .safetensors hahahahaha filefobic... Have a great day! Thank you for your time and don't stop converting models :)