Hugging Face's logo

second-state
/
OrionStar-Yi-34B-Chat-Llama-GGUF

Text Generation
Transformers
GGUF
llama
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
1e1d1a8
•
1 Parent(s): 1d93e8f

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (11) hide show
  1. OrionStar-Yi-34B-Chat-Llama-Q2_K.gguf +3 -0
  2. OrionStar-Yi-34B-Chat-Llama-Q3_K_L.gguf +3 -0
  3. OrionStar-Yi-34B-Chat-Llama-Q3_K_M.gguf +3 -0
  4. OrionStar-Yi-34B-Chat-Llama-Q3_K_S.gguf +3 -0
  5. OrionStar-Yi-34B-Chat-Llama-Q4_0.gguf +3 -0
  6. OrionStar-Yi-34B-Chat-Llama-Q4_K_M.gguf +3 -0
  7. OrionStar-Yi-34B-Chat-Llama-Q4_K_S.gguf +3 -0
  8. OrionStar-Yi-34B-Chat-Llama-Q5_0.gguf +3 -0
  9. OrionStar-Yi-34B-Chat-Llama-Q5_K_S.gguf +3 -0
  10. OrionStar-Yi-34B-Chat-Llama-Q6_K.gguf +3 -0
  11. OrionStar-Yi-34B-Chat-Llama-Q8_0.gguf +3 -0
OrionStar-Yi-34B-Chat-Llama-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16e1c63a33fed248c9ba259361aafd355464792cbe68e687f029b5e25a9a4b7d
3
+ size 12825233408
OrionStar-Yi-34B-Chat-Llama-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e39ee260a9b74553cd7976014284be8256336de30ceacf7cbe803a38486526ba
3
+ size 18139445248
OrionStar-Yi-34B-Chat-Llama-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b65d9cd6b0c3ffa97b482d3152b406bb5c0ea59ab10a7df2e22ee702d3588060
3
+ size 16654923776
OrionStar-Yi-34B-Chat-Llama-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4348ff858c96649074de3938c2eef3850b80568c36f609fb4de7e482293c5f3
3
+ size 14960293888
OrionStar-Yi-34B-Chat-Llama-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c83d2a43ddb7b6df93026766d1b8cc1b909f53075e47f958b874150f7675e6a
3
+ size 19466528768
OrionStar-Yi-34B-Chat-Llama-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29b71cbc437a6dd04ae24d39f82be30e47d858eb257416464611c962b795649a
3
+ size 20658710528
OrionStar-Yi-34B-Chat-Llama-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72cc5365165e38e760c2a75b4dd6cb928133d6757a423f2b68fbef6b93894951
3
+ size 19598649344
OrionStar-Yi-34B-Chat-Llama-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23388edcb7a40dc66c419f1dd2415dc213e90d5bc76601f063cec0df750edcdc
3
+ size 23707691008
OrionStar-Yi-34B-Chat-Llama-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b47d5942c23231428fbc5a85d06b9197517c00d28b40236f89adabbb8559c682
3
+ size 23707691008
OrionStar-Yi-34B-Chat-Llama-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f2d0e4abe9455eb216ed4dfb5d3d593c32be5eca379eb308812a74f9260d4de
3
+ size 28213925888
OrionStar-Yi-34B-Chat-Llama-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:870e1b18c18fbfa742057cedb48544f1994ed6b8712764858c235f1292b50447
3
+ size 36542281728