Full precision weights

#6
by imone - opened

Are there full precision weights without quantization?

/ /(。•‿•。)\ \۶🥬 yeee

@imone , you are a little late to the party. there was a whole 24-hour long discussion that was closed by the creator of this repo. please check that out.

miqu -> mi qu -> mistral quantized

It's quantized by design™ (or for leak purposes, depending on how you look at it).

@imone , you are a little late to the party. there was a whole 24-hour long discussion that was closed by the creator of this repo. please check that out.

Just read through the whole thing. It's crazy how unorganized it got that HF staff had to get involved and lock it

Owner

miqu -> mi qu -> mistral quantized

It's quantized by design™ (or for leak purposes, depending on how you look at it).

It refers to me uploading q2k only, it gained more traction than I anticipated and I folded and uploaded bigger ones.

miqudev changed discussion status to closed

Sign up or log in to comment