Hugging Face's logo

bartowski
/
Gemma-2-9B-It-SPPO-Iter3-GGUF

Text Generation
GGUF
English
Inference Endpoints
conversational
Model card Files Community
1
bartowski commited on
Commit
827bb36
·
verified ·
1 Parent(s): eb1ca6b

Llamacpp quants

Browse files
Files changed (26) hide show
  1. Gemma-2-9B-It-SPPO-Iter3-IQ2_M.gguf +2 -2
  2. Gemma-2-9B-It-SPPO-Iter3-IQ2_S.gguf +2 -2
  3. Gemma-2-9B-It-SPPO-Iter3-IQ2_XS.gguf +2 -2
  4. Gemma-2-9B-It-SPPO-Iter3-IQ3_M.gguf +2 -2
  5. Gemma-2-9B-It-SPPO-Iter3-IQ3_XS.gguf +2 -2
  6. Gemma-2-9B-It-SPPO-Iter3-IQ3_XXS.gguf +2 -2
  7. Gemma-2-9B-It-SPPO-Iter3-IQ4_XS.gguf +2 -2
  8. Gemma-2-9B-It-SPPO-Iter3-Q2_K.gguf +2 -2
  9. Gemma-2-9B-It-SPPO-Iter3-Q2_K_L.gguf +2 -2
  10. Gemma-2-9B-It-SPPO-Iter3-Q3_K_L.gguf +2 -2
  11. Gemma-2-9B-It-SPPO-Iter3-Q3_K_M.gguf +2 -2
  12. Gemma-2-9B-It-SPPO-Iter3-Q3_K_S.gguf +2 -2
  13. Gemma-2-9B-It-SPPO-Iter3-Q3_K_XL.gguf +2 -2
  14. Gemma-2-9B-It-SPPO-Iter3-Q4_K_L.gguf +2 -2
  15. Gemma-2-9B-It-SPPO-Iter3-Q4_K_M.gguf +2 -2
  16. Gemma-2-9B-It-SPPO-Iter3-Q4_K_S.gguf +2 -2
  17. Gemma-2-9B-It-SPPO-Iter3-Q5_K_L.gguf +2 -2
  18. Gemma-2-9B-It-SPPO-Iter3-Q5_K_M.gguf +2 -2
  19. Gemma-2-9B-It-SPPO-Iter3-Q5_K_S.gguf +2 -2
  20. Gemma-2-9B-It-SPPO-Iter3-Q6_K.gguf +2 -2
  21. Gemma-2-9B-It-SPPO-Iter3-Q6_K_L.gguf +2 -2
  22. Gemma-2-9B-It-SPPO-Iter3-Q8_0.gguf +2 -2
  23. Gemma-2-9B-It-SPPO-Iter3-Q8_0_L.gguf +2 -2
  24. Gemma-2-9B-It-SPPO-Iter3-f32.gguf +2 -2
  25. Gemma-2-9B-It-SPPO-Iter3.imatrix +1 -1
  26. README.md +1 -1
Gemma-2-9B-It-SPPO-Iter3-IQ2_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:001cc2569736e4c8db9522ae9680f6a26b85225f447f151ff65a693c7c8a498c
3
- size 3434669952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21655d2b2024d576f5af7a4ba681b3bdae9b48a44c94593ef9475af3d663cc81
3
+ size 3434669984
Gemma-2-9B-It-SPPO-Iter3-IQ2_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:695a0790ad8d987ce4c76b8a3a057b0b32bf60892f37c7ba90d234c385b37567
3
- size 3211487104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c19716ebbceca0835d0371778ab1cb5d3170f44ae0059bc165a2f891de8ed5a
3
+ size 3211487136
Gemma-2-9B-It-SPPO-Iter3-IQ2_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3a6023f97c050fc5b42f5c61b42281065540227809d089479589f051ae5b1e50
3
- size 3067381632
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a070b8fd54127c127ac6496eed2445925dfbd7b506e1b969f2ce824796c18ce
3
+ size 3067381664
Gemma-2-9B-It-SPPO-Iter3-IQ3_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cea9a7e22175056df0afab0962b8227b4dc9e1ea0ad740527e4f03c7d7328817
3
- size 4494616448
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01a5f3773a0f83c88332598ccbf412f084a08ccd7ba5f66e9a446cf7d1d00480
3
+ size 4494616480
Gemma-2-9B-It-SPPO-Iter3-IQ3_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a0fd5abdbd9c8450eb9adde37c9a2f115bdf0f9f8c89fb75d38b196a70fe3ddc
3
- size 4144990080
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9159bbb13116b2b3a26bbdee9013f428852dcae18170e7f95213fbc01505c04a
3
+ size 4144990112
Gemma-2-9B-It-SPPO-Iter3-IQ3_XXS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0c8ca3d55c91d64ad325d2f4a292bc524adf8b915ffa6de41898b3b07088ba0c
3
- size 3796739968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00dff4fe8fd852e2a977f018f15f40b806e2829612230e438547248f50069f3f
3
+ size 3796740000
Gemma-2-9B-It-SPPO-Iter3-IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7a6249756452e8966cb77dd4fd99f98a7d52f7e2aacbb95637542dd4cb54186c
3
- size 5183031168
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afe7d2642d97307773f683d12b2e7584319606b63076b1192f85a53b9d96545c
3
+ size 5183031200
Gemma-2-9B-It-SPPO-Iter3-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ba0a8c0635ac41a0752f29099e9285d04fbdad61e0f3a3af16aa81e38bd55610
3
- size 3805398912
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af1d2421e215a344493f13818878181fa675a50c30c5dc7ddaace356960598ad
3
+ size 3805398944
Gemma-2-9B-It-SPPO-Iter3-Q2_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:923299a2e3c98b1428e903f265465a3110aaeb9e2bdcbd82bddf6e96a977d29e
3
- size 4887766912
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ad57bd4c819f4cf2f0ab37b3d3492d4c5f83e4e3aa05b44cc7c69b69403dd88
3
+ size 4887766944
Gemma-2-9B-It-SPPO-Iter3-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b50638f1f876a54dd7080b16d4b8d3ce8ac7213f022ce8d899baca274a955a9a
3
- size 5132453760
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84c8c390a37005b4307a1d9b99b998a5a963e15a9ded56cb57ac015ff76fafeb
3
+ size 5132453792
Gemma-2-9B-It-SPPO-Iter3-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7fc80cd360b84b31efdeeaf1fc08effb858d26a6a4ea600ea84a3b784bb411e1
3
- size 4761782144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84affd2e209b0cfdc3a67b2402b658538f083b7801f2e7c3a90120590e7452c1
3
+ size 4761782176
Gemma-2-9B-It-SPPO-Iter3-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e678c1edcaaf9dada459d6154c732cc3274d944f3437f36290f2d64e58a154f2
3
- size 4337665920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3ad2a24cad33f6937b7976a53bb74cb95985f7c5b61719adbecda069dba2fe3
3
+ size 4337665952
Gemma-2-9B-It-SPPO-Iter3-Q3_K_XL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:21682d0377097db4fab55266f339ddc292db111a66f9a497dbb8495f128fd011
3
- size 6214821760
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:302d8b02033aea92d34a5d5c3ac718b52c2a6eee33fdde0d4b306a8636c22ede
3
+ size 6214821792
Gemma-2-9B-It-SPPO-Iter3-Q4_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:50557b777e5ced7f7317097c839e927c9b64c9ddd8fc487f0b22c09b0024c67f
3
- size 6843426688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de9df5cd7fe74af1763b18bae0f67ce5b1e03c29fa975ffe5e5d6eec153cd58c
3
+ size 6843426720
Gemma-2-9B-It-SPPO-Iter3-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:003306ee540fb670a0b6bb3eeab71e356957b4f8870ab7e6e007f3a5b0ada51c
3
- size 5761058688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7aac221f548beef8d45106eabbec6b2c4e1669a51ad14e4bf640d463dadf36e7
3
+ size 5761058720
Gemma-2-9B-It-SPPO-Iter3-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:52e8a4078976ac16622864e4a3502bc65795d7873cc633b3707441733c2687a4
3
- size 5478926208
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8815213894bcbe9870a6a9c032a7db90c43fcd8286f9b07c0b03e8bd8bca828b
3
+ size 5478926240
Gemma-2-9B-It-SPPO-Iter3-Q5_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f088df9894dcfcc9e40c79398d15daf1f3c8dea60609d00df3a250fde92faedd
3
- size 7729735552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ef55700ae48aa4cac37ac5ef1f9fd13302677393f7a48e2970070c1b87935af
3
+ size 7729735584
Gemma-2-9B-It-SPPO-Iter3-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4c417b22932e51313061341566b401640d1be0952f6c07ca551d845845233555
3
- size 6647367552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:760f4807fef868e7640b35ae1b86c310a13605f36eddad6854cdfd422bf485c5
3
+ size 6647367584
Gemma-2-9B-It-SPPO-Iter3-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aa013c9de52f951bfb5d839a345b84de91043ce1b619e6fe5bded24884ac0338
3
- size 6483593088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:adf2e0603a6b34582045918261597419cb60ad4bc26e4bd2f684d9149f693866
3
+ size 6483593120
Gemma-2-9B-It-SPPO-Iter3-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4c20d679b7f81b996179f4cbffd5a04dac16a3d1faab5df0efd09794b37c87b0
3
- size 7589070720
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16c4d3a8ce9d4d21a65fbf5168ee9fe2e804343bfa433602d58ef03f4c752bd0
3
+ size 7589070752
Gemma-2-9B-It-SPPO-Iter3-Q6_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f39dc0bb3008d906e44543a7ee066a668eb6bea2e0859060c79b51a80ab1d350
3
- size 8671438720
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f826c28269b92b46ced9d5389fc9930f1d7edf30f885103e6e1edc90e9cba17d
3
+ size 8671438752
Gemma-2-9B-It-SPPO-Iter3-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a77fcf2e789a17a4e727300a6f0d8d4c430cf7ad38d99910f1698365888fda6a
3
- size 9827149696
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c62d6f95aee184d7f206ec419834ecf338dc86155c0b2f6d8949081bc64de32b
3
+ size 9827149728
Gemma-2-9B-It-SPPO-Iter3-Q8_0_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:14f6939cd909505a397b73e7157e034912d583cace13f6d8f5679178bb119ed6
3
- size 10687309696
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5af58b1a543b28ea42e828ebfaac270a415d7c968fb9a899667327ab73e7b586
3
+ size 10687309728
Gemma-2-9B-It-SPPO-Iter3-f32.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:65c7dec66ed5da42d706bae4964a92ecc5cf9aaefd8017e26ee94f63d3885b74
3
- size 36972881504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35ae69bd189ca0bfee01e2cd29a030295d262d59508d51bf4987b9b283e0ead5
3
+ size 36972881568
Gemma-2-9B-It-SPPO-Iter3.imatrix CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:79522b29a7249603f589a2052cc26a5bf462265a43124193a7a1e55e658b0ad0
3
  size 6116901
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fcc0c0226e25c6a014a46ae0b1bb9c3b73f37c02b291a10642b72bc6555d041f
3
  size 6116901
README.md CHANGED
@@ -10,7 +10,7 @@ quantized_by: bartowski
10
 
11
  ## Llamacpp imatrix Quantizations of Gemma-2-9B-It-SPPO-Iter3
12
 
13
- Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b3266">b3266</a> for quantization.
14
 
15
  Original model: https://huggingface.co/UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
16
 
 
10
 
11
  ## Llamacpp imatrix Quantizations of Gemma-2-9B-It-SPPO-Iter3
12
 
13
+ Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b3278">b3278</a> for quantization.
14
 
15
  Original model: https://huggingface.co/UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
16