PrunaAI
/

Qwen1.5-MoE-A2.7B-Chat-GGUF-smashed

Model card Files Files and versions Community

Qwen1.5-MoE-A2.7B-Chat-GGUF-smashed

2 contributors

History: 12 commits

johnrachwanpruna's picture

johnrachwanpruna

Upload Qwen1.5-MoE-A2.7B-Chat.Q4_K_M.gguf with huggingface_hub

a50cac9 verified 3 months ago

.gitattributes

2.23 kB

Upload Qwen1.5-MoE-A2.7B-Chat.Q4_K_M.gguf with huggingface_hub 3 months ago
Qwen1.5-MoE-A2.7B-Chat.IQ3_M.gguf
6.93 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.IQ3_M.gguf with huggingface_hub 3 months ago
Qwen1.5-MoE-A2.7B-Chat.IQ3_S.gguf
6.84 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.IQ3_S.gguf with huggingface_hub 3 months ago
Qwen1.5-MoE-A2.7B-Chat.IQ4_NL.gguf
8.25 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.IQ4_NL.gguf with huggingface_hub 3 months ago
Qwen1.5-MoE-A2.7B-Chat.IQ4_XS.gguf
7.94 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.IQ4_XS.gguf with huggingface_hub 3 months ago
Qwen1.5-MoE-A2.7B-Chat.Q3_K_M.gguf
7.43 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.Q3_K_M.gguf with huggingface_hub 3 months ago
Qwen1.5-MoE-A2.7B-Chat.Q3_K_S.gguf
6.84 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.Q3_K_S.gguf with huggingface_hub 3 months ago
Qwen1.5-MoE-A2.7B-Chat.Q4_K_M.gguf
9.49 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.Q4_K_M.gguf with huggingface_hub 3 months ago
Qwen1.5-MoE-A2.7B-Chat.Q4_K_S.gguf
8.7 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.Q4_K_S.gguf with huggingface_hub 3 months ago
Qwen1.5-MoE-A2.7B-Chat.Q5_K_S.gguf
10.2 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.Q5_K_S.gguf with huggingface_hub 3 months ago
Qwen1.5-MoE-A2.7B-Chat.Q8_0.gguf
15.2 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.Q8_0.gguf with huggingface_hub 3 months ago
Qwen1.5-MoE-A2.7B-Chat.fp16.bin
28.6 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.fp16.bin with huggingface_hub 3 months ago