A request for quantization.

#1
by Kotokin - opened

Hi, can you please quantize the following model into iq2_xs? Miquliz 120B v2.0

Hello,

Ask to Artefact2 or Kooten, my current hardware is too modest to reasonably iMatrix and quantize such beasts.

Thanks

Kotokin changed discussion status to closed

Sign up or log in to comment