which base precision did you used in the quantization?
#3
by aamobp - opened
i just wanted to make sure which base precision did you used in quantization? is it was bf16 or similar precision, or is it was fp8?
There is the answer in the model card!
"The pre-quantized PyTorch checkpoints are in unsloth/MiniMax-H3-FP8."