Hugging Face's logo

second-state
/
Gemma-7b-it-GGUF

Text Generation
Transformers
GGUF
gemma
text-generation-inference
Model card Files Community
2
Xin Liu commited on
Commit
ec52ab7
•
1 Parent(s): 096adc1

Update models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (11) hide show
  1. gemma-7b-it-Q2_K.gguf +3 -0
  2. gemma-7b-it-Q3_K_L.gguf +3 -0
  3. gemma-7b-it-Q3_K_M.gguf +3 -0
  4. gemma-7b-it-Q3_K_S.gguf +3 -0
  5. gemma-7b-it-Q4_0.gguf +3 -0
  6. gemma-7b-it-Q4_K_M.gguf +3 -0
  7. gemma-7b-it-Q4_K_S.gguf +3 -0
  8. gemma-7b-it-Q5_0.gguf +3 -0
  9. gemma-7b-it-Q5_K_S.gguf +3 -0
  10. gemma-7b-it-Q6_K.gguf +3 -0
  11. gemma-7b-it-Q8_0.gguf +3 -0
gemma-7b-it-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6d34a20b5d67a0a97ffee9f46c6c5a8d6066957aa0daedb8615e88e1df22f9e
3
+ size 3094375392
gemma-7b-it-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfeda4268b9cf9c38745dac47522a2f8694cd531d0675acfe488f64c432f6c77
3
+ size 4401867744
gemma-7b-it-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d84e79d6cb0d6dc7a901c1180683da9c1e52f40a0560eddf9f3bcf6ea571cd59
3
+ size 4062129120
gemma-7b-it-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c16ea931cbf2b5e1d80217bf521e819d8300f04460ea1fea7d2316bc88bb6bd0
3
+ size 3675204576
gemma-7b-it-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afa02af4b397d0ba106102156b3d484a870842f3b2bd2486484b886dc6393282
3
+ size 4809092064
gemma-7b-it-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da0b1373f617bafdbc045901db3ce3580ece09fb35a7e966d3b498ba17b650a8
3
+ size 5127007200
gemma-7b-it-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59ca05a29a21876600ec860e40acca95e17834a7dd1c867824fe1995edb48790
3
+ size 4843695072
gemma-7b-it-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98ab44aa116d09a97c31f08019eeca0aba0b2e3fd8941cbe57d4bb2924379e22
3
+ size 5876280288
gemma-7b-it-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:946c917f1399e6ca0574b8ff28fac0bf063465af753db5056948bd4c2c1c715f
3
+ size 5876280288
gemma-7b-it-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:474f3f486f7c4c9b2f68f9980390bab9a4c2779a0ceffc9ee63d789947510c47
3
+ size 7010167776
gemma-7b-it-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91f092aa54e2472e66085030edd77d038df72ceaefae7bbf7de1ff3262eb6625
3
+ size 9077844960