Hugging Face's logo

MaziyarPanahi
/
Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation
GGUF
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card Files Community
7
MaziyarPanahi commited on
Commit
a99dee2
•
1 Parent(s): e0b2957

4acb9828866fe73469d57cdcb829e3e28dd8f51ad2356145961b5b9e632e466c

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. Meta-Llama-3.1-8B-Instruct.Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -41,3 +41,4 @@ Meta-Llama-3.1-8B-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
  Meta-Llama-3.1-8B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
  Meta-Llama-3.1-8B-Instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
  Meta-Llama-3.1-8B-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 
 
41
  Meta-Llama-3.1-8B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
  Meta-Llama-3.1-8B-Instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
  Meta-Llama-3.1-8B-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Meta-Llama-3.1-8B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3.1-8B-Instruct.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e99511eebf7ab0bf5d2d54b35a0639d1232298a7603d2905b7708d983675eacd
3
+ size 6596006816