GGUFs for Hercules-Qwen 1.5 14B - https://huggingface.co/M4-ai/Hercules-Qwen1.5-14B

iMatrix GGUFs generated with Kalomaze's semi-random groups_merged.txt

Downloads last month
40
GGUF
Model size
14.2B params
Architecture
qwen2
Inference API
Unable to determine this model’s pipeline type. Check the docs .

Dataset used to train MarsupialAI/Hercules-Qwen1.5-14B_iMatrix_GGUF