Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Meta-Llama-3-70B-Instruct-GGUF
like
157
Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
Model card
Files
Files and versions
Community
26
Use this model
48fdc50
Meta-Llama-3-70B-Instruct-GGUF
1 contributor
History:
8 commits
MaziyarPanahi
ed659287a39409ebfffa53e6980d04251a161c9ea5fa07ebb3582f6542a63784
48fdc50
verified
4 months ago
.gitattributes
1.96 kB
ed659287a39409ebfffa53e6980d04251a161c9ea5fa07ebb3582f6542a63784
4 months ago
Meta-Llama-3-70B-Instruct.IQ3_XS.gguf
29.3 GB
LFS
Upload folder using huggingface_hub (#2)
4 months ago
Meta-Llama-3-70B-Instruct.IQ4_XS.gguf
38.3 GB
LFS
2d76773f963201600f1d6ca5a5fbc4cb792fb0da0937505487bd3e5ef61213ee
4 months ago
Meta-Llama-3-70B-Instruct.Q2_K.gguf
26.4 GB
LFS
Upload folder using huggingface_hub (#1)
4 months ago
Meta-Llama-3-70B-Instruct.Q3_K_L.gguf
37.1 GB
LFS
1a9d427b6f4c0bf4be0b68cbd26bc0dfdb0fe4abe284b42ce4222acfc9329aba
4 months ago
Meta-Llama-3-70B-Instruct.Q3_K_M.gguf
34.3 GB
LFS
ed659287a39409ebfffa53e6980d04251a161c9ea5fa07ebb3582f6542a63784
4 months ago
Meta-Llama-3-70B-Instruct.Q3_K_S.gguf
30.9 GB
LFS
Upload folder using huggingface_hub (#2)
4 months ago
README.md
24.9 kB
Update README.md (#3)
4 months ago