Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Meta-Llama-3-70B-Instruct-GGUF
like
169
Text Generation
GGUF
PyTorch
English
facebook
meta
llama
llama-3
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
16-bit
GGUF
conversational
Model card
Files
Files and versions
Community
26
Use this model
refs/pr/4
Meta-Llama-3-70B-Instruct-GGUF
Ctrl+K
Ctrl+K
1 contributor
History:
10 commits
MaziyarPanahi
2d32acc799e7a3ed09bf7bccd73bb3def5a9eb5d0d42ef77b210dcb3d41503ee
04b75a6
verified
about 1 year ago
.gitattributes
Safe
2.04 kB
2d32acc799e7a3ed09bf7bccd73bb3def5a9eb5d0d42ef77b210dcb3d41503ee
about 1 year ago
Meta-Llama-3-70B-Instruct.IQ3_XS.gguf
Safe
29.3 GB
LFS
Upload folder using huggingface_hub (#2)
about 1 year ago
Meta-Llama-3-70B-Instruct.IQ4_XS.gguf
Safe
38.3 GB
LFS
2d76773f963201600f1d6ca5a5fbc4cb792fb0da0937505487bd3e5ef61213ee
about 1 year ago
Meta-Llama-3-70B-Instruct.Q2_K.gguf
Safe
26.4 GB
LFS
Upload folder using huggingface_hub (#1)
about 1 year ago
Meta-Llama-3-70B-Instruct.Q3_K_L.gguf
Safe
37.1 GB
LFS
1a9d427b6f4c0bf4be0b68cbd26bc0dfdb0fe4abe284b42ce4222acfc9329aba
about 1 year ago
Meta-Llama-3-70B-Instruct.Q3_K_M.gguf
Safe
34.3 GB
LFS
ed659287a39409ebfffa53e6980d04251a161c9ea5fa07ebb3582f6542a63784
about 1 year ago
Meta-Llama-3-70B-Instruct.Q3_K_S.gguf
Safe
30.9 GB
LFS
Upload folder using huggingface_hub (#2)
about 1 year ago
Meta-Llama-3-70B-Instruct.Q4_K_S.gguf
40.3 GB
LFS
2d32acc799e7a3ed09bf7bccd73bb3def5a9eb5d0d42ef77b210dcb3d41503ee
about 1 year ago
README.md
24.9 kB
Update README.md (#3)
about 1 year ago
