runtime error
Exit code: 1. Reason: er.json: 100%|██████████| 7.03M/7.03M [00:00<00:00, 41.2MB/s] config.json: 0%| | 0.00/1.26k [00:00<?, ?B/s][A config.json: 100%|██████████| 1.26k/1.26k [00:00<00:00, 7.42MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 23, in <module> model = AutoModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 564, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3647, in from_pretrained config.quantization_config = AutoHfQuantizer.merge_quantization_configs( File "/usr/local/lib/python3.10/site-packages/transformers/quantizers/auto.py", line 173, in merge_quantization_configs quantization_config = AutoQuantizationConfig.from_dict(quantization_config) File "/usr/local/lib/python3.10/site-packages/transformers/quantizers/auto.py", line 103, in from_dict return target_cls.from_dict(quantization_config_dict) File "/usr/local/lib/python3.10/site-packages/transformers/utils/quantization_config.py", line 102, in from_dict config = cls(**config_dict) File "/usr/local/lib/python3.10/site-packages/transformers/utils/quantization_config.py", line 653, in __init__ self.post_init() File "/usr/local/lib/python3.10/site-packages/transformers/utils/quantization_config.py", line 722, in post_init optimum_version = version.parse(importlib.metadata.version("optimum")) File "/usr/local/lib/python3.10/importlib/metadata/__init__.py", line 996, in version return distribution(distribution_name).version File "/usr/local/lib/python3.10/importlib/metadata/__init__.py", line 969, in distribution return Distribution.from_name(distribution_name) File "/usr/local/lib/python3.10/importlib/metadata/__init__.py", line 548, in from_name raise PackageNotFoundError(name) importlib.metadata.PackageNotFoundError: No package metadata was found for optimum
Container logs:
Fetching error logs...