F16 perhaps?
#1
by
colourspec
- opened
The original is in F32, was looking to use something close to source but F32 is bit much.
I'd normnally pass, but since it's currently generating, I tried to patch the f16 quant in. Should generate after the IQ3_M.
mradermacher
changed discussion status to
closed