Hugging Face's logo

mradermacher
/
DistilHermes-2.5-Mistral-7B-i1-GGUF

Transformers
GGUF
English
Inference Endpoints
imatrix
conversational
Model card Files Community
mradermacher commited on
Commit
9311fec
·
verified ·
1 Parent(s): a13007f

uploaded from kaos

Browse files
Files changed (23) hide show
  1. .gitattributes +22 -0
  2. DistilHermes-2.5-Mistral-7B.i1-IQ1_M.gguf +3 -0
  3. DistilHermes-2.5-Mistral-7B.i1-IQ1_S.gguf +3 -0
  4. DistilHermes-2.5-Mistral-7B.i1-IQ2_M.gguf +3 -0
  5. DistilHermes-2.5-Mistral-7B.i1-IQ2_S.gguf +3 -0
  6. DistilHermes-2.5-Mistral-7B.i1-IQ2_XS.gguf +3 -0
  7. DistilHermes-2.5-Mistral-7B.i1-IQ2_XXS.gguf +3 -0
  8. DistilHermes-2.5-Mistral-7B.i1-IQ3_M.gguf +3 -0
  9. DistilHermes-2.5-Mistral-7B.i1-IQ3_S.gguf +3 -0
  10. DistilHermes-2.5-Mistral-7B.i1-IQ3_XS.gguf +3 -0
  11. DistilHermes-2.5-Mistral-7B.i1-IQ3_XXS.gguf +3 -0
  12. DistilHermes-2.5-Mistral-7B.i1-IQ4_XS.gguf +3 -0
  13. DistilHermes-2.5-Mistral-7B.i1-Q2_K.gguf +3 -0
  14. DistilHermes-2.5-Mistral-7B.i1-Q2_K_S.gguf +3 -0
  15. DistilHermes-2.5-Mistral-7B.i1-Q3_K_L.gguf +3 -0
  16. DistilHermes-2.5-Mistral-7B.i1-Q3_K_M.gguf +3 -0
  17. DistilHermes-2.5-Mistral-7B.i1-Q3_K_S.gguf +3 -0
  18. DistilHermes-2.5-Mistral-7B.i1-Q4_0.gguf +3 -0
  19. DistilHermes-2.5-Mistral-7B.i1-Q4_K_M.gguf +3 -0
  20. DistilHermes-2.5-Mistral-7B.i1-Q4_K_S.gguf +3 -0
  21. DistilHermes-2.5-Mistral-7B.i1-Q5_K_M.gguf +3 -0
  22. DistilHermes-2.5-Mistral-7B.i1-Q5_K_S.gguf +3 -0
  23. DistilHermes-2.5-Mistral-7B.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,25 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ DistilHermes-2.5-Mistral-7B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ DistilHermes-2.5-Mistral-7B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ DistilHermes-2.5-Mistral-7B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ DistilHermes-2.5-Mistral-7B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ DistilHermes-2.5-Mistral-7B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ DistilHermes-2.5-Mistral-7B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ DistilHermes-2.5-Mistral-7B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ DistilHermes-2.5-Mistral-7B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ DistilHermes-2.5-Mistral-7B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ DistilHermes-2.5-Mistral-7B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ DistilHermes-2.5-Mistral-7B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
48
+ DistilHermes-2.5-Mistral-7B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
49
+ DistilHermes-2.5-Mistral-7B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
50
+ DistilHermes-2.5-Mistral-7B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
51
+ DistilHermes-2.5-Mistral-7B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
52
+ DistilHermes-2.5-Mistral-7B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ DistilHermes-2.5-Mistral-7B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
54
+ DistilHermes-2.5-Mistral-7B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ DistilHermes-2.5-Mistral-7B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ DistilHermes-2.5-Mistral-7B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ DistilHermes-2.5-Mistral-7B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ DistilHermes-2.5-Mistral-7B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
DistilHermes-2.5-Mistral-7B.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17abcc108450ac5af883455fcaf7f39db91bec60b092ad096f406d9e020b9fff
3
+ size 1754455552
DistilHermes-2.5-Mistral-7B.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:802360d640038c1d82bd63b6f28c3c4433fe17258cb18d959bcfede36bd1f0cc
3
+ size 1612111360
DistilHermes-2.5-Mistral-7B.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb2f7c03ccf9726ec4225bb55d64a1e442a0eb5634150609ea78e85515b18de0
3
+ size 2500723008
DistilHermes-2.5-Mistral-7B.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37c143de4c061dbe12409a016a0bcbee69890925def7c7a65eeba2ec1f73aa32
3
+ size 2310930752
DistilHermes-2.5-Mistral-7B.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d575de27cbb1791db5c6bffc356d9aea12cc726b5a3bb32869003e9fd5362719
3
+ size 2198265344
DistilHermes-2.5-Mistral-7B.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20290796a62e829d2f622403580defe2a9b4d8a74b62fa93e7ec4dbb55542d29
3
+ size 1991695872
DistilHermes-2.5-Mistral-7B.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0cae4b60fb74aaae51a55c12640005486c9a3223691be99aeb32d1d4983cb22
3
+ size 3284903296
DistilHermes-2.5-Mistral-7B.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b35c9b2ee078abac8cebfcb7a8ca15b41d48b57379e66f72d14c99533d791ae
3
+ size 3182404992
DistilHermes-2.5-Mistral-7B.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ade9d6c70c1006d7c2599e73cfbd25c850f25d563e497604159ed99ea33d0840
3
+ size 3018827136
DistilHermes-2.5-Mistral-7B.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f76157c640d8a4a35a4c67391d98001bf174b3b8f3cdbf468ff100262a871a46
3
+ size 2827354432
DistilHermes-2.5-Mistral-7B.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5ec011ea7e06e36ff10aadb36f7717256823bc5ece854e6fffc77dde7d71629
3
+ size 3907700928
DistilHermes-2.5-Mistral-7B.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea7a6de7200826d2397f77485cbced4d4edb8c78e25fe6690d29af8c164319fe
3
+ size 2719253056
DistilHermes-2.5-Mistral-7B.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0825c7b8cda2e7ab85449699448a777f52d4ad8fc7382d2d0082bf282642ad63
3
+ size 2528936512
DistilHermes-2.5-Mistral-7B.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b716676f9756f9621c725785f66a881185c8ea334fb2e24b881a8ec22977fba7
3
+ size 3822036352
DistilHermes-2.5-Mistral-7B.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49c19bcfcfa91cf3cc9f49f9582eaaeea64528485cb173771c94bc9e36bcd566
3
+ size 3518997888
DistilHermes-2.5-Mistral-7B.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44db36146f2403147616fbd247006bb03239dc0dc55331007984f04a83e317b0
3
+ size 3164579200
DistilHermes-2.5-Mistral-7B.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ab5f7c3881058504596706671dee258621f9f18091f97d9d6d8c72dd84a6fcf
3
+ size 4123609536
DistilHermes-2.5-Mistral-7B.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d63307b0414ef5ccaad108f00705820a7d490ce1f7a7d650534e974cad0977f0
3
+ size 4368452032
DistilHermes-2.5-Mistral-7B.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9605e9347d22f573f56ca157ac2b632ad8fa879b24df41f40c2d907dcf3fa52a
3
+ size 4140386752
DistilHermes-2.5-Mistral-7B.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7458623e16d4ed161e91b605afbe144f3803736d66a833ed638930552495722
3
+ size 5131423168
DistilHermes-2.5-Mistral-7B.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1a5b6ce51c6952607d78261b0e36ef521ee2a5d2fc1f7845b7b2198854c2281
3
+ size 4997729728
DistilHermes-2.5-Mistral-7B.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bb4d128ed087abcf4cf482cd3d8d9f4926b60c35822529ed243c92da6718387a
3
+ size 5942080000