Hugging Face's logo

LoneStriker
/
gemma-7b-it-GGUF

Transformers
GGUF
Inference Endpoints
23 papers
Model card Files Community
LoneStriker commited on
Commit
7a59613
•
1 Parent(s): 4e6224a

Upload folder using huggingface_hub

Browse files
Files changed (5) hide show
  1. .gitattributes +4 -0
  2. gemma-7b-it-Q3_K_M.gguf +3 -0
  3. gemma-7b-it-Q3_K_S.gguf +3 -0
  4. gemma-7b-it-Q4_K_S.gguf +3 -0
  5. gemma-7b-it-Q5_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -1,5 +1,9 @@
1
  gemma-7b-it-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
 
 
2
  gemma-7b-it-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 
3
  gemma-7b-it-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 
4
  gemma-7b-it-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
5
  gemma-7b-it-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
1
  gemma-7b-it-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
2
+ gemma-7b-it-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
3
+ gemma-7b-it-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
4
  gemma-7b-it-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
5
+ gemma-7b-it-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
6
  gemma-7b-it-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
7
+ gemma-7b-it-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
8
  gemma-7b-it-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
9
  gemma-7b-it-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-7b-it-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:339f8d1ad6dcea6308310d401cb39b42ce781acd8b31fc65a9d49ee74aae1af1
3
+ size 4062301344
gemma-7b-it-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ccb60c83b6aa7065233dd06f2466461317866de507435c9c4a565607edb8978
3
+ size 3675376800
gemma-7b-it-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2b485d0a4e68fcb01a6265b5d1373bcb08f8cc9f27b177add95134bf05fab87
3
+ size 4843919520
gemma-7b-it-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22d126be2d6a308c9c95dbcc667db20c55ee12cff9eb56529ad680dac94d12bd
3
+ size 5876553888