Request for 8bpw quant please
#2
by
dasChronos1
- opened
Would it be possible to get the full 8bpw quant for exl2? The model is relatively small so it would be cool to get the most out of it.
Thank you!
Would it be possible to get the full 8bpw quant for exl2? The model is relatively small so it would be cool to get the most out of it.
Thank you!
Uploading to (https://huggingface.co/Nitral-AI/Poppy_Porpoise-1.0-L3-8B-8bpw-exl2) now, will take a while to upload however.
Would it be possible to get the full 8bpw quant for exl2? The model is relatively small so it would be cool to get the most out of it.
Thank you!Uploading to (https://huggingface.co/Nitral-AI/Poppy_Porpoise-1.0-L3-8B-8bpw-exl2) now, will take a while to upload however.
Thank you so much! Will test it out later today.
dasChronos1
changed discussion status to
closed