Llama-3.3-70B-Instruct AWQ 4-Bit Quantized Version

This repository provides the AWQ 4-bit quantized version of meta-llama/Llama-3.3-70B-Instruct, originally developed by Meta AI.

Downloads last month
382,755
Safetensors
Model size
11.3B params
Tensor type
I32
Β·
FP16
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for kosbu/Llama-3.3-70B-Instruct-AWQ

Quantized
(110)
this model

Spaces using kosbu/Llama-3.3-70B-Instruct-AWQ 3