Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-8B-Instruct-v0.10-GGUF
like
2
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
Llama-3-8B-Instruct-v0.10-GGUF
1 contributor
History:
17 commits
MaziyarPanahi
89258a9dfd6d186f64267433993a9ba9683d07c2af1183f7cef994bfc750ea99
17e418e
verified
5 months ago
.gitattributes
Safe
2.74 kB
89258a9dfd6d186f64267433993a9ba9683d07c2af1183f7cef994bfc750ea99
5 months ago
Llama-3-8B-Instruct-v0.10.IQ1_M.gguf
Safe
2.16 GB
LFS
d7e227580893228e9c794a304426f00be7df5bb9adadf3148637c62bc19e58f1
5 months ago
Llama-3-8B-Instruct-v0.10.IQ1_S.gguf
Safe
2.02 GB
LFS
89258a9dfd6d186f64267433993a9ba9683d07c2af1183f7cef994bfc750ea99
5 months ago
Llama-3-8B-Instruct-v0.10.IQ2_XS.gguf
Safe
2.61 GB
LFS
f0843cabf141523700f59d68b739831fbb7ed0d598e566e856026dc470e8a59a
5 months ago
Llama-3-8B-Instruct-v0.10.IQ3_XS.gguf
Safe
3.52 GB
LFS
60e5fd8deddef2cd45aab15ee243244fee820ce3730b367eabbf0e68f432a923
5 months ago
Llama-3-8B-Instruct-v0.10.IQ4_XS.gguf
Safe
4.45 GB
LFS
87c1bf46661416f2fd6d30788198a7efaca1114d22df6e9347a348a56e2ac054
5 months ago
Llama-3-8B-Instruct-v0.10.Q2_K.gguf
Safe
3.18 GB
LFS
27781cf06056b93c993b771f4f03cf5991a5a03cee981540dfeec08b3862ddde
5 months ago
Llama-3-8B-Instruct-v0.10.Q3_K_L.gguf
Safe
4.32 GB
LFS
6511749b7c95e7a933d33a6a180a34960202dd8b5c6f91b748927345f3a605f3
5 months ago
Llama-3-8B-Instruct-v0.10.Q3_K_M.gguf
Safe
4.02 GB
LFS
bfba03c8e82e40bfc5ed76281d0cd5c769a80c33f56a1dc7aef0bebd585a1eeb
5 months ago
Llama-3-8B-Instruct-v0.10.Q3_K_S.gguf
Safe
3.66 GB
LFS
9d5fdb1fbe3dea2f517e088b4f83cb0843644222c2afa7d32039a1c9bb05864f
5 months ago
Llama-3-8B-Instruct-v0.10.Q4_K_M.gguf
Safe
4.92 GB
LFS
6b2b5002cccd1d372d96a10aa282d8b86e88b5474297565e8afae8eb0e2c02fa
5 months ago
Llama-3-8B-Instruct-v0.10.Q4_K_S.gguf
Safe
4.69 GB
LFS
e19eb7811135e946240211c245322704019a32c65dc9d56104c638522ef53393
5 months ago
Llama-3-8B-Instruct-v0.10.Q5_K_M.gguf
Safe
5.73 GB
LFS
f86f5bf98250439de02ef0ee4456b732a3310cf9ee32bc1c39d9119f626d9287
5 months ago
Llama-3-8B-Instruct-v0.10.Q5_K_S.gguf
Safe
5.6 GB
LFS
36a9c1525eae1b61d0fd36716c4ca5744cf16033949997a2e026fc2911df297c
5 months ago
Llama-3-8B-Instruct-v0.10.Q6_K.gguf
Safe
6.6 GB
LFS
abde6a684a426b65ec3d40930e7dc3084d9e8000951d2fb2d3d7b47a981ea645
5 months ago
Llama-3-8B-Instruct-v0.10.Q8_0.gguf
Safe
8.54 GB
LFS
33dbce47aa839af7cc774d0e2e6db5783c471eaf147c874d85b6b8968628cfbe
5 months ago
Llama-3-8B-Instruct-v0.10.fp16.gguf
Safe
16.1 GB
LFS
69e6ceb13ef37a9abc554dc139db8e0ccaca4486a23cae66cda384fc1399a2ff
5 months ago
README.md
Safe
3.09 kB
89258a9dfd6d186f64267433993a9ba9683d07c2af1183f7cef994bfc750ea99
5 months ago
imatrix.dat
Safe
4.99 MB
LFS
89258a9dfd6d186f64267433993a9ba9683d07c2af1183f7cef994bfc750ea99
5 months ago
