Exl2 quants please

#8
by rjmehta - opened

Thank you for this DPO version. Exl2 quants please

Hi,
Thanks for the request. I have never done Exl2 quants, but maybe we can ask @LoneStriker if he has time?
If not, I can look to see how to do it with high quality.

Hi,
Thanks for the request. I have never done Exl2 quants, but maybe we can ask @LoneStriker if he has time?
If not, I can look to see how to do it with high quality.

exl2 quants uploading here:
https://huggingface.co/models?sort=trending&search=LoneStriker+Llama-3-70B-Instruct-DPO-v0.4

rjmehta changed discussion status to closed

Sign up or log in to comment