Hugging Face's logo

second-state
/
SOLAR-10.7B-Instruct-v1.0-GGUF

Text Generation
Transformers
GGUF
English
llama
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
f77573f
•
1 Parent(s): 52c11fe

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. SOLAR-10.7B-Instruct-v1.0-Q2_K.gguf +3 -0
  2. SOLAR-10.7B-Instruct-v1.0-Q3_K_L.gguf +3 -0
  3. SOLAR-10.7B-Instruct-v1.0-Q3_K_M.gguf +3 -0
  4. SOLAR-10.7B-Instruct-v1.0-Q3_K_S.gguf +3 -0
  5. SOLAR-10.7B-Instruct-v1.0-Q4_0.gguf +3 -0
  6. SOLAR-10.7B-Instruct-v1.0-Q4_K_M.gguf +3 -0
  7. SOLAR-10.7B-Instruct-v1.0-Q4_K_S.gguf +3 -0
  8. SOLAR-10.7B-Instruct-v1.0-Q5_0.gguf +3 -0
  9. SOLAR-10.7B-Instruct-v1.0-Q5_K_M.gguf +3 -0
  10. SOLAR-10.7B-Instruct-v1.0-Q5_K_S.gguf +3 -0
  11. SOLAR-10.7B-Instruct-v1.0-Q6_K.gguf +3 -0
  12. SOLAR-10.7B-Instruct-v1.0-Q8_0.gguf +3 -0
SOLAR-10.7B-Instruct-v1.0-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecf16aecc958143aa311a743ad2610ee85adbb291be1b631d13179eb41ba6e0e
3
+ size 4549016160
SOLAR-10.7B-Instruct-v1.0-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9635f0e6a0ef66837ef0afc98b138521c7f72f3ea0746c4fc7bc4e808c553d37
3
+ size 5650750048
SOLAR-10.7B-Instruct-v1.0-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fad968520411760198100fb42fe3b6f0060ec3ac8a1aff94ca9f099619b68e9d
3
+ size 5188328032
SOLAR-10.7B-Instruct-v1.0-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a6f35f3712913aa789abc63afc7eea9abd96a746e558849f0eb69b783f34f2c
3
+ size 4664564320
SOLAR-10.7B-Instruct-v1.0-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3829f7cf39847e478b0d5ffb562d8776a5897ef2f3cfe586e52df71c44d2f40
3
+ size 6072384096
SOLAR-10.7B-Instruct-v1.0-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7839e428dfc2e7f6a9489b2206d607626bd71302ee01059577703aedfface34f
3
+ size 6461667936
SOLAR-10.7B-Instruct-v1.0-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aed183d3baaa6974d1988e6cdebe1c8ab8be52a2a4fe274b35139eede9633c76
3
+ size 6103841376
SOLAR-10.7B-Instruct-v1.0-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c819a493ec2dbaa7222545b358c26cbc8998c03442236a430b1c863d80fa8083
3
+ size 7397390944
SOLAR-10.7B-Instruct-v1.0-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:715704d0c565664cf49dc6b4e0e087871724b7cb00ecf36a126df1d3de26b843
3
+ size 7597931104
SOLAR-10.7B-Instruct-v1.0-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69af001a9c39a5cb64a9676111cb5b0444affd0122930e8fd53f32b5dd94c2d4
3
+ size 7397390944
SOLAR-10.7B-Instruct-v1.0-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0690fe4f91f47317b6c52e5c03d59b753ca03acefbd6d558eaf46751f5f14f52
3
+ size 8805210720
SOLAR-10.7B-Instruct-v1.0-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8e3bb1b09ff245aaa11605bde7da976c1dd5847303a93c3993fa7882fe84391
3
+ size 11404155488