GGUFs for Hercules-Qwen 1.5 14B - https://huggingface.co/M4-ai/Hercules-Qwen1.5-14B

iMatrix GGUFs generated with Kalomaze's semi-random groups_merged.txt

Downloads last month
17
GGUF
Model size
14.2B params
Architecture
qwen2
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.

Dataset used to train MarsupialAI/Hercules-Qwen1.5-14B_iMatrix_GGUF