Hugging Face's logo

corneille97
/
Llama-3-8B-4bits-turbo

Text Generation
Transformers
Safetensors
llama
Llama3-8B
Llama3
Llama-3
4bits
bnb
conversational
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community

Model : Llama 3 8B 4bits

This is a Llama 3 8B model quantized on 4 bits using BitsandBytes. For fast upload enjoy !.

License : see https://huggingface.co/meta-llama/Meta-Llama-3-8B

Downloads last month
22
Safetensors
Model size
4.65B params
Tensor type
FP16
路
F32
路
U8
路
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.