TheBloke
/

WizardCoder-Guanaco-15B-V1.1-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (1)

text-generation-webui error with auto_gptq?

#4 opened about 1 year ago by

Running with ExLlama and GPTQ-for-LLaMa in text-generation-webui gives errors

#3 opened over 1 year ago by

GPTQ-for-LLAMA error, RuntimeError: Error(s) in loading state_dict for LlamaForCausalLM: Missing key(s) in state_dict: "model.embed_tokens.weight",

#1 opened over 1 year ago by