hugging-quants
/

Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-405B-Instruct-AWQ-INT4

7 contributors

History: 4 commits

alvarobartt's picture

alvarobartt HF staff

Add files using large-upload tool

62c162f verified 5 months ago

.gitattributes

1.52 kB

initial commit 5 months ago
model-00012-of-00047.safetensors

4.57 GB
LFS

Add files using large-upload tool 5 months ago
model-00046-of-00047.safetensors

1.5 GB
LFS

Add files using large-upload tool 5 months ago
model-00047-of-00047.safetensors

4.2 GB
LFS

Add files using large-upload tool 5 months ago