quantized ONNX export and inference

#1
by Centaur31 - opened

Hi!
I have 2 questions about the model.

  1. how did you export the 4 quantized models in the ONNX folder?
    and 2) how do you inference the quantized ONNX model?
    Thanks!

Sign up or log in to comment