mav23
/

Qwen2.5-3B-Instruct-abliterated-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Qwen2.5-3B-Instruct-abliterated-GGUF

1 contributor

History: 13 commits

mav23's picture

Upload folder using huggingface_hub

331d265 verified 10 days ago

.gitattributes

2.47 kB

Upload folder using huggingface_hub 10 days ago
README.md

3.06 kB

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q2_K.gguf

1.27 GB
LFS

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q3_K.gguf

1.59 GB
LFS

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q3_K_L.gguf

1.71 GB
LFS

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q3_K_M.gguf

1.59 GB
LFS

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q3_K_S.gguf

1.45 GB
LFS

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q4_0.gguf

1.82 GB
LFS

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q4_1.gguf

2 GB
LFS

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q4_K.gguf

1.93 GB
LFS

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q4_K_M.gguf

1.93 GB
LFS

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q4_K_S.gguf

1.83 GB
LFS

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q5_0.gguf

2.17 GB
LFS

Upload folder using huggingface_hub 10 days ago
qwen2.5-3b-instruct-abliterated.Q5_1.gguf

2.34 GB
LFS

Upload folder using huggingface_hub 10 days ago