Hugging Face's logo

TheDrummer
/
Gemmasutra-Mini-2B-v1-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
TheDrummer commited on
Commit
8f3aff7
•
1 Parent(s): 49f2a2f

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. Gemmasutra-Mini-2B-v1i-Q2_K.gguf +3 -0
  3. Gemmasutra-Mini-2B-v1i-Q3_K_M.gguf +3 -0
  4. Gemmasutra-Mini-2B-v1i-Q4_K_M.gguf +3 -0
  5. Gemmasutra-Mini-2B-v1i-Q5_K_M.gguf +3 -0
  6. Gemmasutra-Mini-2B-v1i-Q6_K.gguf +3 -0
  7. Gemmasutra-Mini-2B-v1i-f16.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Gemmasutra-Mini-2B-v1i-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  Gemmasutra-Mini-2B-v1i-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Gemmasutra-Mini-2B-v1i-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Gemmasutra-Mini-2B-v1i-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Gemmasutra-Mini-2B-v1i-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Gemmasutra-Mini-2B-v1i-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Gemmasutra-Mini-2B-v1i-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Gemmasutra-Mini-2B-v1i-f16.gguf filter=lfs diff=lfs merge=lfs -text
Gemmasutra-Mini-2B-v1i-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1fe311576032985f3eca62c0233d276f2fa972681bddb893ddfdd1a5132f31ee
3
+ size 1229830016
Gemmasutra-Mini-2B-v1i-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64c414a3a278d8843394b578ecf6326eacd470bd01a4292bdcaf01b9802ff5e5
3
+ size 1461667712
Gemmasutra-Mini-2B-v1i-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29ba3db911fbadef4452ba757ddd9ce58fb892b7a872f19eefd0743c961797fb
3
+ size 1708582784
Gemmasutra-Mini-2B-v1i-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2aee754987cea34673a0b72d9298d0c09ef68f05aa4239bf9dddbb896bc8cf84
3
+ size 1923278720
Gemmasutra-Mini-2B-v1i-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34bdca7d62ae0b15366a6f3d7f457d6d8ef96343e72c5e4555b6475c4a78e839
3
+ size 2151393152
Gemmasutra-Mini-2B-v1i-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9270ba3b358b9689340f2b0b1b79a5666718e516e38b569ad736613de81cc741
3
+ size 5235214208