exl2
#1
by
DmitryPLSKN
- opened
@LoneStriker
can I ask you to do exl2 quants?
upd: https://huggingface.co/gghfez/WizardLM-2-8x22B-Beige
These 8x22B models are pretty massive, even quantized. Uploading here:
https://huggingface.co/models?search=LoneStriker%20WizardLM-2-8x22B-Beige
These 8x22B models are pretty massive, even quantized. Uploading here:
https://huggingface.co/models?search=LoneStriker%20WizardLM-2-8x22B-Beige
Thanks, I know it's big, I run everything through the cloud
@LoneStriker Thanks mate. It would have taken me almost two weeks to finish uploading these.