How

#1
by amgadhasan - opened

How did you get the original fp16 parameters from the q5 quant?

probably through some reverse conversion

These aren't the original fp16 params, they're GGUF quant converted 1:1 to PyTorch format. Mostly for testing purposes.

alpindale changed discussion status to closed

Sign up or log in to comment