GGUFs
#1
by
MarsupialAI
- opened
Regular Q_K and iMatrix GGUFs uploading here: https://huggingface.co/MarsupialAI/Qwen1.5-32B_iMatrix_GGUF
lgtm! would you mind telling us what data did you train imatrix on?
As per the model card, kalomaze's groups_merged.txt. The file is included in the repo.