Resources

Error running the code:

#29 opened 9 months ago by

Andyrasika

How to run qlora with stable vicuna?

#28 opened 9 months ago by

Andyrasika

Could not find model in TheBloke/stable-vicuna-13B-GPTQ

#27 opened 10 months ago by

AB00k

HF/bitsandbytes load_in_4bit is now apparently live apparently! (in peft)

#24 opened 12 months ago by

2themaxx

Issue starting the webui

#23 opened 12 months ago by

Depsi

Updated special_tokens_map.json

#22 opened 12 months ago by

brandonglockaby

What are the hardware requirements for this? I am running out of memory on my RTX3060 Ti :o

#21 opened 12 months ago by

yramshev

AttributeError: 'Offload_LlamaModel' object has no attribute 'preload'

#17 opened 12 months ago by

yramshev

Attentions are all None

#16 opened 12 months ago by

joshlevy89

OSError: Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory models\TheBlokestable-vicuna-13B-GPTQ.

#14 opened about 1 year ago by

Squeezitgirdle

some errors occured when I use the webui who can tell me why?

#13 opened about 1 year ago by

yogurt111

ask

#12 opened about 1 year ago by

ReD2401

using with transformers

#11 opened about 1 year ago by

thefaheem

Model's VRAM Utilisation

#10 opened about 1 year ago by

thefaheem

Unable to load it using --pre_layer flag

#5 opened about 1 year ago by

boricuapab

the model thinks its chatgpt, lobotomy is advised

#4 opened about 1 year ago by

eucdee

No such file or directory: ‘models\TheBloke_stable-vicuna-13B-GPTQ\pytorch_model-00001-of-00003.bin’

#2 opened about 1 year ago by

Blue-Devil

stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors not compatible with "standard" settings

#1 opened about 1 year ago by

vmajor