Hugging Face's logo

second-state
/
StarCoder2-3B-GGUF

Text Generation
Transformers
GGUF
starcoder2
code
text-generation-inference
Model card Files Community
1
Xin Liu commited on
Commit
c3f1976
•
1 Parent(s): dbd36fe

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (13) hide show
  1. .gitattributes +1 -0
  2. starcoder2-3b-Q2_K.gguf +3 -0
  3. starcoder2-3b-Q3_K_L.gguf +3 -0
  4. starcoder2-3b-Q3_K_M.gguf +3 -0
  5. starcoder2-3b-Q3_K_S.gguf +3 -0
  6. starcoder2-3b-Q4_0.gguf +3 -0
  7. starcoder2-3b-Q4_K_M.gguf +3 -0
  8. starcoder2-3b-Q4_K_S.gguf +3 -0
  9. starcoder2-3b-Q5_0.gguf +3 -0
  10. starcoder2-3b-Q5_K_M.gguf +3 -0
  11. starcoder2-3b-Q5_K_S.gguf +3 -0
  12. starcoder2-3b-Q6_K.gguf +3 -0
  13. starcoder2-3b-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
starcoder2-3b-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d913d393f6af594bcae25cdc43b3962c59223adb364561143cf7931b9ce1b5a3
3
+ size 1149187136
starcoder2-3b-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e55a7877f5556a87c989bfc14355b9b3443a740afdafa192529d575fd16df26
3
+ size 1678591040
starcoder2-3b-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:150150764ef7a1a2f95815f5564525d7719445048c833acbc47ce6095d1cc51a
3
+ size 1513047104
starcoder2-3b-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87f8d3932ad25feca48799704e3a41e75da56f690655646dcf3c318a272c0de9
3
+ size 1307554880
starcoder2-3b-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8197026ab1cc481e6788a88ebe8ba7b5568141b7d576436aae3d86dd09586971
3
+ size 1709888576
starcoder2-3b-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8fb39287a463549b80d97473b0a7595c3a5a6da3ae2604ca33906a1a43f7175
3
+ size 1848976448
starcoder2-3b-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4db2dd5f10e16acce70273913eff1e8626208c37e967813fca67b79cb55b76b
3
+ size 1743311936
starcoder2-3b-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18d282b8a1fde791a71ce0f292c981ed1ed986ba7da48363541b03c518a328d3
3
+ size 2088555584
starcoder2-3b-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dcd804dc5888e4eb266ba9f6a03ddd7387dd41afbaae8dd14658660d26b6d6d4
3
+ size 2160206912
starcoder2-3b-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:484dc0d80a228f5de53f23431da52619372654c0d9cb11a9d2c8872fd56100c0
3
+ size 2088555584
starcoder2-3b-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:542dad6925fc4041a63fe039d6dc42582412877dd6b703da19be6e94327f69bb
3
+ size 2490889280
starcoder2-3b-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4cbf961fa378b1a9f86d5930d3fcb0c31bacfd3ad64fcd27aca680b10059ff8
3
+ size 3224556608