ModuleNotFoundError: No module named 'llama_inference_offload'
1
#6 opened over 1 year ago
by
KongfuAi
gpt4-alpaca-lora-30B-GPTQ-4bit-128g only generate same Russian words
4
#5 opened over 1 year ago
by
Tonight223
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637f083e2438d7485b8eb942/gO1NL5pquqQS-uGVQ4Sjc.png)
Weights do not work (non-128g weights do work!)
#2 opened over 1 year ago
by
ryanlarimer