Hugging Face's logo

hugging-quants
/
Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation
Transformers
Safetensors
8 languages
llama
llama-3.1
meta
autoawq
conversational
text-generation-inference
Inference Endpoints
4-bit precision
awq
Model card Files Community
10

Improve code snippet

#3
by Xenova HF staff - opened
base: refs/heads/main
←
from: refs/pr/3
Discussion Files changed
+3
-6
Improve code snippetc4f91327
Xenova
 Hugging Quants org
No description provided.
Update README.mdc15b8100
alvarobartt
 Hugging Quants org

We should remove the torchvision installation before merging cc @Xenova

Xenova
 Hugging Quants org

Sure thing - will do! Let me also try from a clean colab install, since that was required when I tried last.

Update README.mdd9b36fe1
Xenova changed pull request status to merged

Sign up or log in to comment