Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen1.5-8x7b-v0.1-GGUF
like
6
Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
axolotl
Generated from Trainer
Mixture of Experts
qwen
text-generation-inference
conversational
dataset:Crystalcareai/MoD-150k
Inference Endpoints
License:
tongyi-qianwen
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
e8df271
Qwen1.5-8x7b-v0.1-GGUF
1 contributor
History:
7 commits
MaziyarPanahi
d4595c8238a9627d6eccdf2dde79b20875a82bff9e28b76898dd35072202062c
e8df271
verified
9 months ago
.gitattributes
1.91 kB
d4595c8238a9627d6eccdf2dde79b20875a82bff9e28b76898dd35072202062c
9 months ago
Qwen1.5-8x7b-v0.1.Q2_K.gguf
14.9 GB
LFS
2a502d29eefcf1d562d5d63cceea41d05914c2c2fd58e6008e6160febfdf2101
9 months ago
Qwen1.5-8x7b-v0.1.Q3_K_L.gguf
20.2 GB
LFS
183ff2a97e31b2ec4cb531a2af793e297fa2560cd4e196e83b7689ea0f478f4a
9 months ago
Qwen1.5-8x7b-v0.1.Q3_K_M.gguf
19 GB
LFS
6153d909ab12183a001bc207cb11c7a27060fa8ef32ceaeb40a170de902d17bc
9 months ago
Qwen1.5-8x7b-v0.1.Q3_K_S.gguf
17.4 GB
LFS
9a0c5ff71eb4270e55342f0942b4f80311c77631ec148dda4086b154b4dd5341
9 months ago
Qwen1.5-8x7b-v0.1.Q4_K_M.gguf
23.6 GB
LFS
f620247a5c19e0ddf170eeb05a076c7fc8eb3513cd67643e95e12281190f8281
9 months ago
Qwen1.5-8x7b-v0.1.Q4_K_S.gguf
22.3 GB
LFS
d4595c8238a9627d6eccdf2dde79b20875a82bff9e28b76898dd35072202062c
9 months ago
