Hugging Face's logo

second-state
/
StarCoder2-7B-GGUF

Text Generation
Transformers
GGUF
starcoder2
code
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
495c907
•
1 Parent(s): 6571268

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (13) hide show
  1. .gitattributes +1 -0
  2. starcoder2-7b-Q2_K.gguf +3 -0
  3. starcoder2-7b-Q3_K_L.gguf +3 -0
  4. starcoder2-7b-Q3_K_M.gguf +3 -0
  5. starcoder2-7b-Q3_K_S.gguf +3 -0
  6. starcoder2-7b-Q4_0.gguf +3 -0
  7. starcoder2-7b-Q4_K_M.gguf +3 -0
  8. starcoder2-7b-Q4_K_S.gguf +3 -0
  9. starcoder2-7b-Q5_0.gguf +3 -0
  10. starcoder2-7b-Q5_K_M.gguf +3 -0
  11. starcoder2-7b-Q5_K_S.gguf +3 -0
  12. starcoder2-7b-Q6_K.gguf +3 -0
  13. starcoder2-7b-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
starcoder2-7b-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f067909d93620ce61834426f7a31416a07cf8b5ebc39f19a4fd1e10bff09392e
3
+ size 2724543296
starcoder2-7b-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b7e3c8c09b64f447ec27973a1c77fa03be5ae7661286347e071bcc7f7755ba4
3
+ size 3985587008
starcoder2-7b-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad1b55bff88200c0e6541eca5a5c8dc3b9cc9cadee7a33628acaf4549aac5bae
3
+ size 3594533696
starcoder2-7b-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01905a299e979234f7d39ec8e15b5f2aad9d1afa99983ad10b9415e487ec2272
3
+ size 3090234176
starcoder2-7b-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afc57cb47969f8ff40484a87f4a64bcac76ddb73ca1112dedaf201abe607ec05
3
+ size 4042799936
starcoder2-7b-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6d6e50fa0c240bb5ea13bae6c06e7d3dbb689b0edc55b3610c867c44d9baa7b
3
+ size 4402887488
starcoder2-7b-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:beb8724aa4a6d8ab100819001f4fe192967b7461ab5a14161e5cc5a770935a9f
3
+ size 4128914240
starcoder2-7b-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e5d12f32630a2a2e872e026d3361daee2efb540b9bae79144fd38e4c19ad7f7
3
+ size 4939332416
starcoder2-7b-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d385b900e824be5d24b7fda98b898c2bcac07e008f3cb8ac49a0d0883ae3a747
3
+ size 5124832064
starcoder2-7b-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d8bb772877092498ac7f56d5dd3459659e8f600dafc5255d99144f6ad6d1b2c
3
+ size 4939332416
starcoder2-7b-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73836e765b166d41038c1535174425c1be288310d9ad27fd8180f0f94b846e44
3
+ size 5891898176
starcoder2-7b-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48b4842e14dc891e2abd7165ad36297cb45b702db0f98325f83fb0a94fd68dd8
3
+ size 7628929856