Hugging Face's logo

SanctumAI
/
Codestral-22B-v0.1-GGUF

Transformers
GGUF
code
mistral
text-generation-inference
Inference Endpoints
Model card Files Community
AndreyBest commited on
Commit
142d7f9
•
1 Parent(s): ad8c58f

Uploading quants for the Codestral-22B-v0.1-GGUF model

Browse files
Files changed (19) hide show
  1. .gitattributes +17 -0
  2. codestral-22b-v0.1.Q2_K.gguf +3 -0
  3. codestral-22b-v0.1.Q3_K_L.gguf +3 -0
  4. codestral-22b-v0.1.Q3_K_M.gguf +3 -0
  5. codestral-22b-v0.1.Q3_K_S.gguf +3 -0
  6. codestral-22b-v0.1.Q4_0.gguf +3 -0
  7. codestral-22b-v0.1.Q4_1.gguf +3 -0
  8. codestral-22b-v0.1.Q4_K.gguf +3 -0
  9. codestral-22b-v0.1.Q4_K_M.gguf +3 -0
  10. codestral-22b-v0.1.Q4_K_S.gguf +3 -0
  11. codestral-22b-v0.1.Q5_0.gguf +3 -0
  12. codestral-22b-v0.1.Q5_1.gguf +3 -0
  13. codestral-22b-v0.1.Q5_K.gguf +3 -0
  14. codestral-22b-v0.1.Q5_K_M.gguf +3 -0
  15. codestral-22b-v0.1.Q5_K_S.gguf +3 -0
  16. codestral-22b-v0.1.Q6_K.gguf +3 -0
  17. codestral-22b-v0.1.Q8_0.gguf +3 -0
  18. codestral-22b-v0.1.f16.gguf +3 -0
  19. config.json +3 -0
.gitattributes CHANGED
@@ -33,3 +33,20 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ codestral-22b-v0.1.f16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ codestral-22b-v0.1.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ codestral-22b-v0.1.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ codestral-22b-v0.1.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ codestral-22b-v0.1.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ codestral-22b-v0.1.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
42
+ codestral-22b-v0.1.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
43
+ codestral-22b-v0.1.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
44
+ codestral-22b-v0.1.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ codestral-22b-v0.1.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ codestral-22b-v0.1.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ codestral-22b-v0.1.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
48
+ codestral-22b-v0.1.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
49
+ codestral-22b-v0.1.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
50
+ codestral-22b-v0.1.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ codestral-22b-v0.1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
52
+ codestral-22b-v0.1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
codestral-22b-v0.1.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a645a2a1d407b876edf4731dd223cf8a09fa168efc96b20496a89bcdf702f7b4
3
+ size 8272093280
codestral-22b-v0.1.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e12cecf18621cf0e2893065a1dfa8d2960f061b15840d1ef81544bc375ef0eec
3
+ size 11730428000
codestral-22b-v0.1.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dee0fb768659fdaf82fadcd1e01f21ed81010756a3c6ff9413834a78ae7ea5cd
3
+ size 10756825184
codestral-22b-v0.1.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c1b58cf0fd2a09c86dab340dbba94a5aca46c24fffc5afa842495db9e4fb555
3
+ size 9641271392
codestral-22b-v0.1.Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22a849aafe3ded20e9b6551b02684d8fa911537c35895dd2a1bf9eb70da8f69e
3
+ size 12569157728
codestral-22b-v0.1.Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba5789cba14082138bd2cabae65b6b00f9b232b55c2eba8d64eb0a0798c8b3b5
3
+ size 13946986592
codestral-22b-v0.1.Q4_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bbfda8e64c1991072399f7e7021919463a0cb06f2cf997c940ae247084e40e8
3
+ size 13341237344
codestral-22b-v0.1.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bbfda8e64c1991072399f7e7021919463a0cb06f2cf997c940ae247084e40e8
3
+ size 13341237344
codestral-22b-v0.1.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73d8b6a3770e8a15cbbeb411339a48d090aac052506ee637712c75e19d0c19f9
3
+ size 12660383840
codestral-22b-v0.1.Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:322177a337fba0b14fb09d29ed7a922671532d69408a6507b70c82ebf323ab61
3
+ size 15324815456
codestral-22b-v0.1.Q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88ac837352b715a8d316530adcecc7590c9d5addd72413c35fa1775162b92f3c
3
+ size 16702644320
codestral-22b-v0.1.Q5_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f1f17fa00a1338d01a662e7b74e8abd10e39d96ae4323c7cc5ba7af2a90abf3
3
+ size 15722553440
codestral-22b-v0.1.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f1f17fa00a1338d01a662e7b74e8abd10e39d96ae4323c7cc5ba7af2a90abf3
3
+ size 15722553440
codestral-22b-v0.1.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32ea3525913b548cb473a2db319c2fcdb70fe552dd1f8a52d6cb0e76be12a60d
3
+ size 15324815456
codestral-22b-v0.1.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83d371fdab7d62c12eb780a034bf9b5ea89403e4d69e46d332d9bdaeff765c31
3
+ size 18252701792
codestral-22b-v0.1.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90038122ded15fb535d2f1aee888d33916de5d83c5f66c1b107a3c757a79c326
3
+ size 23640547424
codestral-22b-v0.1.f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c66806b6e513a5aaf19cf772b6a282fb9071d3e4189f2353732aeac1e3cf5144
3
+ size 44496724064
config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "model_type": "mistral"
3
+ }