Hugging Face's logo

ModelCloud
/
Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation
Transformers
Safetensors
llama
gptq
4bit
int4
gptqmodel
modelcloud
llama-3.1
70b
instruct
conversational
text-generation-inference
Inference Endpoints
4-bit precision
Model card Files Community
5
Meta-Llama-3.1-70B-Instruct-gptq-4bit / quantize_config.json

Commit History

0decbb086ebbb7c49e39a6ae805fbea65d86fa081da9c4368dd7f808f0d1bd52
726f914
verified

lrl-modelcloud commited on

Upload folder using huggingface_hub (#1)
a4ac1ca
verified

lrl-modelcloud commited on