TheBloke
/

zephyr-7B-beta-GPTQ

Text Generation

Generated from Trainer

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

RuntimeError: qweight and qzeros have incompatible shapes.

#6 opened 10 months ago by

[AUTOMATED] Model Memory Requirements

#5 opened about 1 year ago by

model-sizer-bot

Which dataset did you use to quantise this model?

#4 opened about 1 year ago by

KoboldAI - The model entered does not exist

#3 opened about 1 year ago by

Running Zyphyr-7B-beta locally for QnA Chat

#2 opened about 1 year ago by

riyazmuthyalapati

Context Length and Max New Tokens

#1 opened about 1 year ago by