GPTQ

#10
by momo4826 - opened

Hi, I want to quantize this model with AutoGPTQ, could you provide several hundred samples as calibration data?

Fengshenbang-LM org

Hi, I want to quantize this model with AutoGPTQ, could you provide several hundred samples as calibration data?

Hello, could you provide an email address so that we can share the data with you?

I appreciate your willingness to share the data, however, I haven't received it.

Whenever it's convenient for you, could you please check and send it? echoguo4826@gmail.com

Thx!

Fengshenbang-LM org

I appreciate your willingness to share the data, however, I haven't received it.

Whenever it's convenient for you, could you please check and send it? echoguo4826@gmail.com

Thx!

Sorry for the late reply. We have two different understandings about calibration data, whether they are used for training or testing the inference results to ensure the performance. So, are you requesting the training data or the inference results from our model? Thanks for clarifying the term.

Sign up or log in to comment