Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama-3-8B-Instruct-v0.8-GGUF
like
4
Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
llama-3
conversational
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
21c8aba
Llama-3-8B-Instruct-v0.8-GGUF
1 contributor
History:
9 commits
MaziyarPanahi
33c9541845a8835154883808555b658cee8cc04d0d89f782a4d575a82d08be33
21c8aba
verified
6 months ago
.gitattributes
2.1 kB
33c9541845a8835154883808555b658cee8cc04d0d89f782a4d575a82d08be33
6 months ago
Llama-3-8B-Instruct-v0.8.Q2_K.gguf
3.18 GB
LFS
483c04ca7fb50b716be228873a407503b86912df6782106e2718ade1ffea94d8
6 months ago
Llama-3-8B-Instruct-v0.8.Q3_K_L.gguf
4.32 GB
LFS
1254116868df57fda850b204893d6894a09a7ef96c4568794a6ce538494690ce
6 months ago
Llama-3-8B-Instruct-v0.8.Q3_K_M.gguf
4.02 GB
LFS
fe3a9bfa65b58314995ac123fa0a4c86dabb29a13db4a711c8546f62ab614011
6 months ago
Llama-3-8B-Instruct-v0.8.Q3_K_S.gguf
3.67 GB
LFS
0d5ab35509fee9cc43b7ada9b157207dc28955ad8359d8362790d834decbf62b
6 months ago
Llama-3-8B-Instruct-v0.8.Q4_K_M.gguf
4.92 GB
LFS
aa2d7d1d9e577026d0abed2d7232c25e811001fa5936528bd7084cdc737961e2
6 months ago
Llama-3-8B-Instruct-v0.8.Q4_K_S.gguf
4.69 GB
LFS
d95ae79e2cc7014bc561095897a7b7eca0e9f7bdaec96e07f85124f34de0c749
6 months ago
Llama-3-8B-Instruct-v0.8.Q5_K_M.gguf
5.73 GB
LFS
b2addd22adb427b8c3e79bf8baabe292b4a17b7ee3a428e73a4f3377678b6bd3
6 months ago
Llama-3-8B-Instruct-v0.8.Q5_K_S.gguf
5.6 GB
LFS
33c9541845a8835154883808555b658cee8cc04d0d89f782a4d575a82d08be33
6 months ago