Hugging Face's logo

phatvo
/
Llama-3.1-8B-Instruct-RAFT-GPTQ-4bits

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community

Model Card for Model ID

4bit Quantized of phatvo/Meta-Llama3.1-8B-Instruct-RAFT

Downloads last month
84
Safetensors
Model size
1.99B params
Tensor type
BF16
·
I32
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.