Hugging Face's logo

aisuko
/
Llama-2-7B-Chat-GPTQ-marlin-4bit

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
Llama-2-7B-Chat-GPTQ-marlin-4bit / quantize_config.json

Commit History

Llama-2-7B-Chat-GPTQ-marlin-4bit
487049e
verified

aisuko commited on