GGUF / IQ / Imatrix

#6
by ABX-AI - opened

Added a gguf repo here, since I noticed other repos have missing quants, or it's by totally unknown (to me) authors.

https://huggingface.co/ABX-AI/phi-2-orange-v2-GGUF-IQ-Imatrix

Includes Q6, Q8 and F16.

@ABX-AI fantastic - thank you!

@ABX-AI fantastic - thank you!

Thank you for the finetune!

Sign up or log in to comment