Dequanting Script

#1
by RonanMcGovern - opened

Would you have a script you could share for dequantizing? I assume from nf4?

Hi @RonanMcGovern , you can refer to https://github.com/ludwig-ai/ludwig/blob/master/examples/llm_base_model_dequantization/phi_2_dequantization.py for an example of a script that performs dequantization on a model.

many thanks

RonanMcGovern changed discussion status to closed

Sign up or log in to comment