MetaIX
/

GPT4-X-Alpaca-30B-4bit

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (4)

Issue of sha256sum of file gpt4-x-alpaca-30b-128g-4bit.safetensors

#16 opened about 1 year ago by

Size mismatch error no matter whan .json or .config files or startup parameters I use

#13 opened over 1 year ago by

Best model I tested, but seems to have an issue on some tokens

#12 opened over 1 year ago by

llama.cpp breaks quantized ggml file format

#11 opened over 1 year ago by

What model_type to set between "None" and "llama"? And what prompt style to use? There are plenty of the latter in Ooba's TextGenWebUI as of now and I'm pretty much lost (see pics for clarification)

#10 opened over 1 year ago by

sha256sum not matching for one file gpt4-x-alpaca-30b-128g-4bit.safetensors

#9 opened over 1 year ago by

Error: Internal: src/sentencepiece_processor.cc in Ooba and KAI 4bit

#8 opened over 1 year ago by

Please, help :<

#7 opened over 1 year ago by

Loaded the model but it wont respond and is stuck saying "typing" meanwhile gpu usage at 100%

#6 opened over 1 year ago by

Error when launching

#5 opened over 1 year ago by

filenames of shards in pytorch_model.bin.index.json

#4 opened over 1 year ago by

Model size for int4 fine tuning on rtx 3090

#2 opened over 1 year ago by

KnutJaegersberg