Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-8B-Instruct-v0.10-GGUF
like
2
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
6294e0b
Llama-3-8B-Instruct-v0.10-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
f86f5bf98250439de02ef0ee4456b732a3310cf9ee32bc1c39d9119f626d9287
6294e0b
verified
about 2 months ago
.gitattributes
2.33 kB
f86f5bf98250439de02ef0ee4456b732a3310cf9ee32bc1c39d9119f626d9287
about 2 months ago
Llama-3-8B-Instruct-v0.10.IQ1_M.gguf
2.16 GB
LFS
d7e227580893228e9c794a304426f00be7df5bb9adadf3148637c62bc19e58f1
about 2 months ago
Llama-3-8B-Instruct-v0.10.IQ2_XS.gguf
2.61 GB
LFS
f0843cabf141523700f59d68b739831fbb7ed0d598e566e856026dc470e8a59a
about 2 months ago
Llama-3-8B-Instruct-v0.10.IQ3_XS.gguf
3.52 GB
LFS
60e5fd8deddef2cd45aab15ee243244fee820ce3730b367eabbf0e68f432a923
about 2 months ago
Llama-3-8B-Instruct-v0.10.IQ4_XS.gguf
4.45 GB
LFS
87c1bf46661416f2fd6d30788198a7efaca1114d22df6e9347a348a56e2ac054
about 2 months ago
Llama-3-8B-Instruct-v0.10.Q2_K.gguf
3.18 GB
LFS
27781cf06056b93c993b771f4f03cf5991a5a03cee981540dfeec08b3862ddde
about 2 months ago
Llama-3-8B-Instruct-v0.10.Q3_K_L.gguf
4.32 GB
LFS
6511749b7c95e7a933d33a6a180a34960202dd8b5c6f91b748927345f3a605f3
about 2 months ago
Llama-3-8B-Instruct-v0.10.Q3_K_M.gguf
4.02 GB
LFS
bfba03c8e82e40bfc5ed76281d0cd5c769a80c33f56a1dc7aef0bebd585a1eeb
about 2 months ago
Llama-3-8B-Instruct-v0.10.Q3_K_S.gguf
3.66 GB
LFS
9d5fdb1fbe3dea2f517e088b4f83cb0843644222c2afa7d32039a1c9bb05864f
about 2 months ago
Llama-3-8B-Instruct-v0.10.Q4_K_M.gguf
4.92 GB
LFS
6b2b5002cccd1d372d96a10aa282d8b86e88b5474297565e8afae8eb0e2c02fa
about 2 months ago
Llama-3-8B-Instruct-v0.10.Q4_K_S.gguf
4.69 GB
LFS
e19eb7811135e946240211c245322704019a32c65dc9d56104c638522ef53393
about 2 months ago
Llama-3-8B-Instruct-v0.10.Q5_K_M.gguf
5.73 GB
LFS
f86f5bf98250439de02ef0ee4456b732a3310cf9ee32bc1c39d9119f626d9287
about 2 months ago
README.md
27 Bytes
initial commit
about 2 months ago
