Hi, could you please add miquliz-120b?
#4
by
Kotokin
- opened
Can you please add or give a guide on quantization if possible from 2-3090
I would love it too, it looks great
yeah, the new V2 seems interesting to try in a smaller quant as well - https://huggingface.co/wolfram/miquliz-120b-v2.0
The author himself provided a version but forget to include a good imatrix. so either we wait for that or maybe someone else can do it properly.
yeah trying to upload it now, might take a day, especially if it fails and I have to retry
KnutJaegersberg
changed discussion status to
closed