Importance Matrix Quants
#2
by
InferenceIllusionist
- opened
Hey - big fan of your models! Checked and saw that no one had shared any newer importance matrix quants of Typhon-Mixtral-v1 yet so I'm upping them here just as a heads up: https://huggingface.co/InferenceIllusionist/Typhon-Mixtral-v1-iMat-GGUF
I see, thanks a lot! Linked to main repo
InferenceIllusionist
changed discussion status to
closed
No problem at all, thanks for linking as well!