Hugging Face's logo

second-state
/
Yi-34Bx2-MoE-60B-GGUF

Text Generation
Transformers
GGUF
mixtral
Mixture of Experts
Inference Endpoints
conversational
Model card Files Community
1
Xin Liu commited on
Commit
e837a2b
•
1 Parent(s): 145dcde

Add Q3 models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (3) hide show
  1. Yi-34Bx2-MoE-60B-Q3_K_L.gguf +3 -0
  2. Yi-34Bx2-MoE-60B-Q3_K_M.gguf +3 -0
  3. Yi-34Bx2-MoE-60B-Q3_K_S.gguf +3 -0
Yi-34Bx2-MoE-60B-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b07417812bc252f18177acfd35e442bc1e4df1402a98aac360cc5d3cff9cce9
3
+ size 31766116320
Yi-34Bx2-MoE-60B-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad2eca9417b43ec804e69d3c7f143f7da1ae76bf5a1047c1b79dad3a38719486
3
+ size 29235640288
Yi-34Bx2-MoE-60B-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:542d54f133298916c87132a876613ff0c874453e510b745d4483c15845321c80
3
+ size 26316142560