Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
hugging-quants
/
Meta-Llama-3.1-405B-Instruct-AWQ-INT4
like
32
Text Generation
Transformers
Safetensors
8 languages
llama
llama-3.1
meta
autoawq
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
License:
llama3.1
Model card
Files
Files and versions
Community
18
Train
Deploy
Use this model
ba12a9a
Meta-Llama-3.1-405B-Instruct-AWQ-INT4
6 contributors
History:
11 commits
alvarobartt
HF staff
Add files using large-upload tool
ba12a9a
verified
about 2 months ago
.gitattributes
1.52 kB
initial commit
about 2 months ago
model-00002-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00006-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00008-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00012-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00014-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00019-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00026-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00030-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00032-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00037-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00042-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00043-of-00047.safetensors
4.57 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00046-of-00047.safetensors
1.5 GB
LFS
Add files using large-upload tool
about 2 months ago
model-00047-of-00047.safetensors
4.2 GB
LFS
Add files using large-upload tool
about 2 months ago