Hugging Face's logo

TheBloke
/
guanaco-65B-GPTQ

Text Generation Transformers Safetensors llama text-generation-inference 4-bit precision
Model card Files Community
28
New discussion

FileNotFoundError: Could not find model in TheBloke/guanaco-65B-GPTQ

1
#28 opened 8 months ago by muneerhanif7

Not able to load the model!
#27 opened 9 months ago by akkasi

Not loading after latest config changes?

1
#26 opened 10 months ago by Novelo

runpod lora training problem
#24 opened 10 months ago by evan624

Having Issues Loading in Runpod

3
#23 opened 11 months ago by DominicLambeth

Training in Runpod environment

10
#22 opened 11 months ago by iiitaiii

Out of memory on two 3090

4
#21 opened 11 months ago by gameveloster

Is it possible to split the 34G model into several pieces?
#20 opened 11 months ago by kirp

How do I consume the successfully running pod with your one click UI template through an API

8
#18 opened 11 months ago by gr8ston

why TheBloke/guanaco-65B-GPTQ run slow even on 80GB GPU

12
#17 opened 11 months ago by balajivantari

Not able to load via transformers

5
#16 opened 11 months ago by balu548411

not enough memory

2
#15 opened 11 months ago by nikocraft

RuntimeError

1
#14 opened 11 months ago by xzqxnet

how to fine tune guanaco and run on multi core cpu (>32 cores)?

1
#13 opened 11 months ago by Tarun1986

error when uing the text-generation-webui api with the model

1
#12 opened 11 months ago by carlosbdw

Could provide a demo python file?

2
#11 opened 11 months ago by carlosbdw

Is there a way to finetune the model?

3
#9 opened 11 months ago by Trinad

How to run it ?

1
#7 opened 11 months ago by carlosbdw

Using the text-generation-webui api with the model

11
#6 opened 11 months ago by Hovav

issues on runpod

4
#5 opened 11 months ago by matthewberman

can you load the provided safetensors with AutoModelForCausalLM.from_pretrained?

13
#4 opened 11 months ago by shawei3000

You're blazing fast!

9
#1 opened 11 months ago by Thireus