Hugging Face's logo

TheBloke
/
CodeLlama-13B-Instruct-GPTQ

Text Generation
Transformers
Safetensors
code
llama
llama-2
custom_code
text-generation-inference
4-bit precision
gptq
Model card Files Community
6
New discussion

Can I run this model on two NVIDIA RTX A5000 GPUs with 24 GB each?
#5 opened about 1 year ago by nashid

How to provide multiple rounds of conversation?
#4 opened about 1 year ago by barty

What's the prompt template for this?

3
#3 opened about 1 year ago by lucasjin

GPTQ first

4
#1 opened about 1 year ago by rabidaught