ModuleNotFoundError: No module named 'optimum'

#9
by netranga - opened

downloaded the model locally and am trying the provided code and running into the following error:

File /anaconda/envs/azureml_py310_sdkv2/lib/python3.10/site-packages/transformers/quantizers/quantizer_gptq.py:47, in GptqHfQuantizer.init(self, quantization_config, **kwargs)
45 def init(self, quantization_config: QuantizationConfigMixin, **kwargs):
46 super().init(quantization_config, **kwargs)
---> 47 from optimum.gptq import GPTQQuantizer
49 self.optimum_quantizer = GPTQQuantizer.from_dict(self.quantization_config.to_dict_optimum())

ModuleNotFoundError: No module named 'optimum'

I've installed optimum and restarted the kernel but still same error. Anyone run into this / have any solutions?

Sign up or log in to comment