TheBloke
/

Llama-2-7B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (2)

Adding Evaluation Results

#12 opened about 1 year ago by

An error using fastchat gptq

#11 opened about 1 year ago by

Adding Evaluation Results

#10 opened about 1 year ago by

leaderboard-pr-bot

GPU Requirement

#9 opened over 1 year ago by

CUDA error: no kernel image is available for execution on the device

#7 opened over 1 year ago by

VLLM

#6 opened over 1 year ago by

output Nonsense compared to llama.cpp

#5 opened over 1 year ago by

White spaces at the end of a response

#4 opened over 1 year ago by

Couples of warnings popping out

#3 opened over 1 year ago by

Does not load

#1 opened over 1 year ago by