Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ModelCloud
/
Meta-Llama-3.1-70B-Instruct-gptq-4bit
like
4
Text Generation
Transformers
Safetensors
llama
gptq
4bit
int4
gptqmodel
modelcloud
llama-3.1
70b
instruct
conversational
text-generation-inference
Inference Endpoints
4-bit precision
License:
llama3.1
Model card
Files
Files and versions
Community
5
Train
Deploy
Use this model
main
Meta-Llama-3.1-70B-Instruct-gptq-4bit
/
quantize_config.json
Commit History
Upload folder using huggingface_hub (
#2
)
85b33ca
verified
lrl-modelcloud
commited on
Jul 24
Upload folder using huggingface_hub (
#1
)
a4ac1ca
verified
lrl-modelcloud
commited on
Jul 23