PrunaAI
/

Qwen1.5-MoE-A2.7B-Chat-GGUF-smashed

Model card Files Files and versions Community

Qwen1.5-MoE-A2.7B-Chat-GGUF-smashed

2 contributors

History: 11 commits

johnrachwanpruna's picture

johnrachwanpruna

Upload Qwen1.5-MoE-A2.7B-Chat.Q4_K_S.gguf with huggingface_hub

f8e1efa verified 4 months ago

.gitattributes

2.15 kB

Upload Qwen1.5-MoE-A2.7B-Chat.Q4_K_S.gguf with huggingface_hub 4 months ago
Qwen1.5-MoE-A2.7B-Chat.IQ3_M.gguf
6.93 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.IQ3_M.gguf with huggingface_hub 4 months ago
Qwen1.5-MoE-A2.7B-Chat.IQ3_S.gguf
6.84 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.IQ3_S.gguf with huggingface_hub 4 months ago
Qwen1.5-MoE-A2.7B-Chat.IQ4_NL.gguf
8.25 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.IQ4_NL.gguf with huggingface_hub 4 months ago
Qwen1.5-MoE-A2.7B-Chat.IQ4_XS.gguf
7.94 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.IQ4_XS.gguf with huggingface_hub 4 months ago
Qwen1.5-MoE-A2.7B-Chat.Q3_K_M.gguf
7.43 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.Q3_K_M.gguf with huggingface_hub 4 months ago
Qwen1.5-MoE-A2.7B-Chat.Q3_K_S.gguf
6.84 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.Q3_K_S.gguf with huggingface_hub 4 months ago
Qwen1.5-MoE-A2.7B-Chat.Q4_K_S.gguf
8.7 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.Q4_K_S.gguf with huggingface_hub 4 months ago
Qwen1.5-MoE-A2.7B-Chat.Q5_K_S.gguf
10.2 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.Q5_K_S.gguf with huggingface_hub 4 months ago
Qwen1.5-MoE-A2.7B-Chat.Q8_0.gguf
15.2 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.Q8_0.gguf with huggingface_hub 4 months ago
Qwen1.5-MoE-A2.7B-Chat.fp16.bin
28.6 GB
LFS

Upload Qwen1.5-MoE-A2.7B-Chat.fp16.bin with huggingface_hub 4 months ago