Hugging Face's logo

second-state
/
dolphin-2.6-mistral-7B-GGUF

Text Generation
Transformers
GGUF
English
mistral
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
15861bd
•
1 Parent(s): d02b0ef

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. dolphin-2.6-mistral-7b-Q2_K.gguf +3 -0
  2. dolphin-2.6-mistral-7b-Q3_K_L.gguf +3 -0
  3. dolphin-2.6-mistral-7b-Q3_K_M.gguf +3 -0
  4. dolphin-2.6-mistral-7b-Q3_K_S.gguf +3 -0
  5. dolphin-2.6-mistral-7b-Q4_0.gguf +3 -0
  6. dolphin-2.6-mistral-7b-Q4_K_M.gguf +3 -0
  7. dolphin-2.6-mistral-7b-Q4_K_S.gguf +3 -0
  8. dolphin-2.6-mistral-7b-Q5_0.gguf +3 -0
  9. dolphin-2.6-mistral-7b-Q5_K_M.gguf +3 -0
  10. dolphin-2.6-mistral-7b-Q5_K_S.gguf +3 -0
  11. dolphin-2.6-mistral-7b-Q6_K.gguf +3 -0
  12. dolphin-2.6-mistral-7b-Q8_0.gguf +3 -0
dolphin-2.6-mistral-7b-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d19e91096bb723282b58724fd6c5600aa553eb22c886c5d99d5614224fbd1019
3
+ size 3083102592
dolphin-2.6-mistral-7b-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9cc026011084bec115ebc162bbed24fee9a499cbbb4e4628c1757b2bcf8690f
3
+ size 3822029600
dolphin-2.6-mistral-7b-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86706d4eddc0013e8a2d0e9544099f5f0190a4f202984d43146daaecbe0a4416
3
+ size 3518991136
dolphin-2.6-mistral-7b-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd365980c5c3ab523949f466dbbb3374f5aaf06fe58f3098ea6a73eaa88f6894
3
+ size 3164572448
dolphin-2.6-mistral-7b-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:288f598999639318fc737af52081f59ddc376b626f5417edaf253f05e8308ff0
3
+ size 4108922176
dolphin-2.6-mistral-7b-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b97c6d6d0eba2705c063394589f3148e81be3ec92c4b796da55fbc22edd08d96
3
+ size 4368444736
dolphin-2.6-mistral-7b-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7586fa61b9d9d3112ca1330f7070ace00c4fd80a5644d070841819791603133f
3
+ size 4140379456
dolphin-2.6-mistral-7b-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49af1d995d2186d788e3c343c08e124c318c0c21bf346d99baf66a611b0d95df
3
+ size 4997721920
dolphin-2.6-mistral-7b-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec3c988cda2d831542449fcd0e82a039067a8da2c747b05268eee482b0e12bdf
3
+ size 5131415360
dolphin-2.6-mistral-7b-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33845810d65b8ae8af811476257720012c16df8ea23a75730bb319b753a57764
3
+ size 4997721920
dolphin-2.6-mistral-7b-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0449b1300e7ac023f4646a88414973bbdbf0f44bfc68cab642e4fbed16dbd205
3
+ size 5942071648
dolphin-2.6-mistral-7b-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36b2f0af8c7aab95438a1426dc97236743d222d0ae074a5ae7baa4a6fa439578
3
+ size 7695866144