Quant Please

#1
by WoolCool - opened

Could you please quantizing this model? @TheBloke That would be very much appreciated!

This model has been supported by any quantization method yet? I ran this using hf bitsandbytes

We plan to release the quantization version of the YAYI2 model by the end of this month. Thank you:)

wenge-research changed discussion status to closed

Sign up or log in to comment