f16 is all weights forced to f16 | |
f16f32 is a mix of f16/f32 | |
you can pip install gguf and load em up in python (after joining the split files together) if you want to poke at the weights |
f16 is all weights forced to f16 | |
f16f32 is a mix of f16/f32 | |
you can pip install gguf and load em up in python (after joining the split files together) if you want to poke at the weights |