Some weights of the model checkpoint at Llama-2-7B-Chat-GPTQ were not used when initializing LlamaForCausalLM

#35 opened 8 days ago by

thlw

[AUTOMATED] Model Memory Requirements

#34 opened 2 months ago by

model-sizer-bot

[AUTOMATED] Model Memory Requirements

#33 opened 2 months ago by

model-sizer-bot

[AUTOMATED] Model Memory Requirements

#32 opened 2 months ago by

model-sizer-bot

Fails with transformers==4.38.1

#30 opened 3 months ago by

rohithkrn

Index out of range error: QAchain for pdf chatbot

#29 opened 4 months ago by

Artemis3196

How to overcoming bad output for better results?

#28 opened 6 months ago by

notmax123

Functional example of finetuning of Llama-2-7b-Chat-GPTQ

#26 opened 7 months ago by

echogit

AUTOGPTQ Error in Google Colab

#25 opened 7 months ago by

echogit

Does the model response correctly

#24 opened 8 months ago by

mnwato

Can't Load Model in Kubernetes but can in Docker

#23 opened 8 months ago by

jrsperry

TheBloke/Llama-2-7b-(Chat-)GPTQ repeats request

#22 opened 8 months ago by

hyzhak

Cannot run batch on transformer

#20 opened 9 months ago by

DatenlaborBerlin

The response is not formatted

#18 opened 9 months ago by

Octavian81

how to load the GPTQ model using any pipeline method

#17 opened 9 months ago by

harithushan

Error trying to run on a revision, tensors not conforming?

#16 opened 9 months ago by

JohnSnyderTC

for faster GPU inference

#15 opened 9 months ago by

harithushan

How to set it up in a way that it just returns output without the system message or query, basically the information after [/INST].

#14 opened 9 months ago by

Pavan-growexx

Update for Transformers GPTQ support

#13 opened 9 months ago by

TheBloke

LORA fine tuning error

#12 opened 9 months ago by

tongwuhugging

GPTQ bugging: Wondering if I'm loading the model correctly

#9 opened 10 months ago by

quantuan125

Please make this model quantised GPTQ

#7 opened 10 months ago by

AiModelsMarket

TGI error

#5 opened 10 months ago by

aiamateur101

Cannot use anything but what's in the main branch

#3 opened 10 months ago by

HAvietisov

How to use this GPTQ Model from Python code for continue conversation?

#2 opened 10 months ago by

shifa

"max_length": 4096, "max_position_embeddings": 4096,

#1 opened 10 months ago by

pseudotensor