f16 GGUF

#1
by weezywitasneezy - opened

Would it be possible to get an f16 GGUF quant for this? Thanks so much!

Unfortunately, my setup does not support f16 quants, although it kinda would make sense especially for small 7B models (I am still debating whether to do something about it). I made one manually, and it should be up by now.

mradermacher changed discussion status to closed

Thanks so much!

Cheers :) If you have any other quantisation requests in the future, don't hold back.

Sign up or log in to comment