Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
second-state
/
Yi-34Bx2-MoE-60B-GGUF
like
2
Text Generation
Transformers
GGUF
mixtral
Mixture of Experts
Inference Endpoints
text-generation-inference
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
main
Yi-34Bx2-MoE-60B-GGUF
2 contributors
History:
31 commits
apepkuss79
Upload README.md with huggingface_hub
88ff284
verified
25 days ago
.gitattributes
1.56 kB
Add Q2 model
4 months ago
README.md
6.1 kB
Upload README.md with huggingface_hub
25 days ago
Yi-34Bx2-MoE-60B-Q2_K.gguf
22.4 GB
LFS
Upload Yi-34Bx2-MoE-60B-Q2_K.gguf with huggingface_hub
25 days ago
Yi-34Bx2-MoE-60B-Q3_K_L.gguf
31.8 GB
LFS
Upload Yi-34Bx2-MoE-60B-Q3_K_L.gguf with huggingface_hub
25 days ago
Yi-34Bx2-MoE-60B-Q3_K_M.gguf
29.2 GB
LFS
Upload Yi-34Bx2-MoE-60B-Q3_K_M.gguf with huggingface_hub
25 days ago
Yi-34Bx2-MoE-60B-Q3_K_S.gguf
26.3 GB
LFS
Upload Yi-34Bx2-MoE-60B-Q3_K_S.gguf with huggingface_hub
25 days ago
Yi-34Bx2-MoE-60B-Q4_0.gguf
34.3 GB
LFS
Upload Q4 models
25 days ago
Yi-34Bx2-MoE-60B-Q4_K_M.gguf
36.7 GB
LFS
Upload Q4 models
25 days ago
Yi-34Bx2-MoE-60B-Q4_K_S.gguf
34.6 GB
LFS
Upload Q4 models
25 days ago
Yi-34Bx2-MoE-60B-Q5_0.gguf
41.9 GB
LFS
Upload Q5 and Q6 models
25 days ago
Yi-34Bx2-MoE-60B-Q5_K_M.gguf
43.1 GB
LFS
Upload Q5 and Q6 models
25 days ago
Yi-34Bx2-MoE-60B-Q5_K_S.gguf
41.9 GB
LFS
Upload Q5 and Q6 models
25 days ago
Yi-34Bx2-MoE-60B-Q6_K.gguf
49.9 GB
LFS
Upload Q5 and Q6 models
25 days ago
Yi-34Bx2-MoE-60B-Q8_0-00001-of-00003.gguf
32.2 GB
LFS
Add Q8 model
25 days ago
Yi-34Bx2-MoE-60B-Q8_0-00002-of-00003.gguf
32.1 GB
LFS
Add Q8 model
25 days ago
Yi-34Bx2-MoE-60B-Q8_0-00003-of-00003.gguf
312 MB
LFS
Add Q8 model
25 days ago
Yi-34Bx2-MoE-60B-f16-00001-of-00008.gguf
31.9 GB
LFS
Add f16 model
25 days ago
Yi-34Bx2-MoE-60B-f16-00002-of-00008.gguf
31.7 GB
LFS
Add f16 model
25 days ago
Yi-34Bx2-MoE-60B-f16-00003-of-00008.gguf
31.7 GB
LFS
Add f16 model
25 days ago
Yi-34Bx2-MoE-60B-f16-00004-of-00008.gguf
31.7 GB
LFS
Add f16 model
25 days ago
Yi-34Bx2-MoE-60B-f16-00005-of-00008.gguf
31.7 GB
LFS
Add f16 model
25 days ago
Yi-34Bx2-MoE-60B-f16-00006-of-00008.gguf
31.7 GB
LFS
Add f16 model
25 days ago
Yi-34Bx2-MoE-60B-f16-00007-of-00008.gguf
31.7 GB
LFS
Add f16 model
25 days ago
Yi-34Bx2-MoE-60B-f16-00008-of-00008.gguf
21.1 GB
LFS
Add f16 model
25 days ago
config.json
868 Bytes
Upload config.json
2 months ago
