Hugging Face's logo

MaziyarPanahi
/
Codestral-22B-v0.1-GGUF

Text Generation
Transformers
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama-3
llama
text-generation-inference
Model card Files Community
5
MaziyarPanahi commited on
Commit
1b2d392
•
1 Parent(s): 9532fd1

Upload folder using huggingface_hub (#5)

Browse files

- 6a60b7cea5973c615fe346f6a0f7dadc6dcd3f809954fcebe7b01e1d9f1e41a3 (ed9e7c43e1941aa60f7aaa4053d4a4a96feb54b6)
- 446c5d466da3465ad354ed47571a6b7a472325a85ebef27aeac586da2ec6ba27 (30c15ffd4544ccc0fa1eb18e8df5009b14c29ec8)
- 4911662e1b1e6046439e2e0b7acda07472fa7bf7218c35fb37a5cfe8d5a12295 (9358edc7b397d4ebf57c8cea8ff9e924e81e85e6)
- 7220f8eaafb231865a62e3f3cf2a5cc7d451507227d29014d2cf87d92addda50 (9aac3935551d11d70148d2def9a2d305d72b0c40)
- 469064d5cf1f5ec04f9bd42e48900542687bf489c5a87e7ac06009cfd6ad8f4c (b13725cf08fe495f8c5d2ff5c6e56df2f75be5dc)
- 1d29d45f1f8376efc7b5a75201b37acb8616dd9aaedc3fec8b3c1f5edca89e7a (6781320ee5883c69c96fdc495b0e87fc702ca018)
- a57ba463a6e924b840beb1bfb6c050323e532bcc3275044468491a75d5d895cb (f4546a3e0605844d49ebde8a9203823de0a8d980)
- 62a4a2fbed458936dafe5d1a3e600bde2cd9cd35f5287b29eabee7e4cb6306a7 (0d7cfa0401f50cb7c1a0ce5557723d8bb760e841)
- bdb765f29df2e2955c974bb4daabf51e263263a33194aeb0038c898f788e9fd5 (3a98eaeb49367d07179da40bacd8f7d364ee438b)
- 5e2dc250e1247a12eb0fc7bc0913e012fc2ec03d1f59ac77a0ab9134a92e9b78 (39e43b0d589677b071c8bf717a8f19314218292d)
- 55b8724664a8a480c057c28097e138b798d49de56b852999a0028c0c73a3d53a (d10f2d4f5bfaf9c19941b88cba259af02801f3a6)
- a5fd35718a41c77f1fc8c717de49586158d0d208004cc2b12f605decf4e648c8 (def82a01fb736942c14ea8a8bea3282ff5599057)
- 5803d954024e2e2b9f93a54e0e1bcba5e39c3cff52694143f2b3c268b4cd4227 (26e8d55227f5d9ed6d64c74fa3d459ceb8b5aafe)
- 47c8772fb269f4ada77478fbe0ce5372b5c501cb5ddf5c6a72dc757d389f50e0 (65d25638640ad91b85828e38015354568ea83c45)
- 016d4491a497ffb06c1b61dd63fd9a577f4cdac6cf9e755dfaa025d5a004e7be (0fa3207ab6a49958ee16ed9044504373ddc7a556)
- a40d81f064ebdcf171da793878ca563edfd9936eb9b15ed5f422d21031c92779 (b66f8a79aabe8003a275656d71e96a8502fe9897)
- 4b8aecd51de23505c01244507c0219cc64cf8cd05dfbb8738b5c9d75b8867c94 (7d1bc5e737e7e8a16357f2327f2d6b43bf4aa08f)

Files changed (17) hide show
  1. Codestral-22B-v0.1-hf.IQ1_M.gguf +2 -2
  2. Codestral-22B-v0.1-hf.IQ1_S.gguf +2 -2
  3. Codestral-22B-v0.1-hf.IQ2_XS.gguf +2 -2
  4. Codestral-22B-v0.1-hf.IQ3_XS.gguf +2 -2
  5. Codestral-22B-v0.1-hf.IQ4_XS.gguf +2 -2
  6. Codestral-22B-v0.1-hf.Q2_K.gguf +2 -2
  7. Codestral-22B-v0.1-hf.Q3_K_L.gguf +2 -2
  8. Codestral-22B-v0.1-hf.Q3_K_M.gguf +2 -2
  9. Codestral-22B-v0.1-hf.Q3_K_S.gguf +2 -2
  10. Codestral-22B-v0.1-hf.Q4_K_M.gguf +2 -2
  11. Codestral-22B-v0.1-hf.Q4_K_S.gguf +2 -2
  12. Codestral-22B-v0.1-hf.Q5_K_M.gguf +2 -2
  13. Codestral-22B-v0.1-hf.Q5_K_S.gguf +2 -2
  14. Codestral-22B-v0.1-hf.Q6_K.gguf +2 -2
  15. Codestral-22B-v0.1-hf.Q8_0.gguf +2 -2
  16. Codestral-22B-v0.1-hf.fp16.gguf +2 -2
  17. README.md +5 -11
Codestral-22B-v0.1-hf.IQ1_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6d8e68d6180567322f29858c43b34b70f79e85bb39198146ebbd0a33fd7a1561
3
- size 5267136832
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9fcd5f613dc65f762192c04c8e9207c9b6485b51dda699b39f2283e7671fc6df
3
+ size 5267136896
Codestral-22B-v0.1-hf.IQ1_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4459565ab12eee290d7062be8403b9a68656a774feb4939d190477c4d89af2ee
3
- size 4829487424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad737370fc21c82d55f08f5ecf1ecdea1dbdf800ebe4b97d8afa82be902fec9d
3
+ size 4829487488
Codestral-22B-v0.1-hf.IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1e394326e73122ffbdc8bd985b618206f9b26a2035148819bf8bb54f11f40492
3
- size 6646145344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:337b5053a2fafae1e101920de44410ac20a33657b77734f4ec436e537e0ea39f
3
+ size 6646145408
Codestral-22B-v0.1-hf.IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b6f45bd0f757344240dbfcdaf854250367a6b889f2bee85537cfd356343281bf
3
- size 9176097088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0913dc4f0704f5a6a8f06692bbe7ce9ddb8cb0cc0b2bca90cdac12847e482409
3
+ size 9176097152
Codestral-22B-v0.1-hf.IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d8928bf14217a484134e84ca64ea6287932dc8902885f3d0e42db65305d50860
3
- size 11935293760
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a801900712c3e6cc0e67cea1bc1a9b704b768669dabae4b0b76eb46fb31ab9e9
3
+ size 11935293824
Codestral-22B-v0.1-hf.Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3c785af06144ef6864dbf9a601be4d37e3ea8726412b1516e3928d54d39c3440
3
- size 8272093504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a8d7d167c4a4185068494a066cecf189444599104bc237d797e542418511123
3
+ size 8272093568
Codestral-22B-v0.1-hf.Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:99a6f7216b52dd0802566a94430272480587370dab273df12351a774407fd6ce
3
- size 11730428224
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0dce5486221dd8072f1984b22fe34d3fdb6142caf03b674ae97e92460829e7c8
3
+ size 11730428288
Codestral-22B-v0.1-hf.Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e392dc4637fb81d5860e74337a5b41aa9a0d124882d642e28c7c81250e810014
3
- size 10756825408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5745344684fd26de8c6681e0574a83113098e7c967aa83e8456e1059565714f0
3
+ size 10756825472
Codestral-22B-v0.1-hf.Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:809f3e51d0fa2cc3c4da7283bfa097165baad9446a994ae842f21e64b23d071f
3
- size 9641271616
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b32324f7b5f3cde80e6a3d8d6bf2cc4af57061707f0977e10c9567be14db5ec9
3
+ size 9641271680
Codestral-22B-v0.1-hf.Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:36a91a2b49334969c6c7077fee24ab16238a47f835a30fa918f12c9b5f11586f
3
- size 13341237568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdc9b7d0c755ffd8b3c9cf33024cac10a262dd79708067526643bdfe6f17e9a2
3
+ size 13341237632
Codestral-22B-v0.1-hf.Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:938df66fe9083a816ea5b78898922f00da9a4c985e98cc6b5b711d24cc107d33
3
- size 12660384064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d45712e2b9736cc0bda216520b3163b5afa456a79cf39b0804a21f888cea85e
3
+ size 12660384128
Codestral-22B-v0.1-hf.Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:37010993bf57f6eb81f35adac21439bf539e97a44684860550e14543881d8401
3
- size 15722553664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76fcf29356fa15fb698692592ed4f8be23bf6d9b9acd8a2b85a4bb01b8df43a4
3
+ size 15722553728
Codestral-22B-v0.1-hf.Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fca33c30993c13e1b81eb6c6b8c66d629d3abd9f0e2d50a3ad6df0920785bdd8
3
- size 15324815680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ec82d74fb3ce1b8b2b0c30c1be6a6c867c9fd3e0e37db517e667f32a4120d3d
3
+ size 15324815744
Codestral-22B-v0.1-hf.Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:050d2b5a30630293db6726eb46bf16fd0c2b5570ccf09e5bd93e139921d6a607
3
- size 18252702016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06d97ad0738b6b85d457bc0ccede288220b459873663f90476e45c12f2974304
3
+ size 18252702080
Codestral-22B-v0.1-hf.Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d799d30c9b7e531c8bc4f128b4123d986ab5946b4967d47b9e94c49b056bd7ae
3
- size 23640547648
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:649c88acac6b325abe8e8d4505a4cccd822d2d8c04118d86da526832b60389f0
3
+ size 23640547712
Codestral-22B-v0.1-hf.fp16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c7e52a42c97093b9717921d2e8bc385e21fee04cdf98c861f7ed6b6010112226
3
- size 44496724096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b7ef0879600cf3f8773589573c82821c9e3e2c3f1b95bb88b303be86a3f0cd5b
3
+ size 44496724160
README.md CHANGED
@@ -8,29 +8,23 @@ tags:
8
  - 6-bit
9
  - 8-bit
10
  - GGUF
11
- - transformers
12
- - safetensors
13
- - mistral
14
  - text-generation
15
- - code
16
- - license:other
17
- - autotrain_compatible
18
- - text-generation-inference
19
- - region:us
20
  - text-generation
21
- model_name: Codestral-22B-v0.1-GGUF
22
  base_model: bullerwins/Codestral-22B-v0.1-hf
23
  inference: false
24
  model_creator: bullerwins
25
  pipeline_tag: text-generation
26
  quantized_by: MaziyarPanahi
27
  ---
28
- # [MaziyarPanahi/Codestral-22B-v0.1-GGUF](https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-GGUF)
29
  - Model creator: [bullerwins](https://huggingface.co/bullerwins)
30
  - Original model: [bullerwins/Codestral-22B-v0.1-hf](https://huggingface.co/bullerwins/Codestral-22B-v0.1-hf)
31
 
32
  ## Description
33
- [MaziyarPanahi/Codestral-22B-v0.1-GGUF](https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-GGUF) contains GGUF format model files for [bullerwins/Codestral-22B-v0.1-hf](https://huggingface.co/bullerwins/Codestral-22B-v0.1-hf).
34
 
35
  ### About GGUF
36
 
 
8
  - 6-bit
9
  - 8-bit
10
  - GGUF
 
 
 
11
  - text-generation
12
+ - llama-3
13
+ - llama
 
 
 
14
  - text-generation
15
+ model_name: Codestral-22B-v0.1-hf-GGUF
16
  base_model: bullerwins/Codestral-22B-v0.1-hf
17
  inference: false
18
  model_creator: bullerwins
19
  pipeline_tag: text-generation
20
  quantized_by: MaziyarPanahi
21
  ---
22
+ # [MaziyarPanahi/Codestral-22B-v0.1-hf-GGUF](https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-hf-GGUF)
23
  - Model creator: [bullerwins](https://huggingface.co/bullerwins)
24
  - Original model: [bullerwins/Codestral-22B-v0.1-hf](https://huggingface.co/bullerwins/Codestral-22B-v0.1-hf)
25
 
26
  ## Description
27
+ [MaziyarPanahi/Codestral-22B-v0.1-hf-GGUF](https://huggingface.co/MaziyarPanahi/Codestral-22B-v0.1-hf-GGUF) contains GGUF format model files for [bullerwins/Codestral-22B-v0.1-hf](https://huggingface.co/bullerwins/Codestral-22B-v0.1-hf).
28
 
29
  ### About GGUF
30