runtime error

0<00:00, 47.3MB/s] Downloading (…)of-00002.safetensors: 99%|█████████▉| 3.48G/3.50G [01:01<00:00, 50.8MB/s] Downloading (…)of-00002.safetensors: 100%|█████████▉| 3.49G/3.50G [01:01<00:00, 45.9MB/s] Downloading (…)of-00002.safetensors: 100%|██████████| 3.50G/3.50G [01:01<00:00, 49.7MB/s] Downloading (…)of-00002.safetensors: 100%|██████████| 3.50G/3.50G [01:01<00:00, 56.7MB/s] Downloading shards: 100%|██████████| 2/2 [04:21<00:00, 118.78s/it] Downloading shards: 100%|██████████| 2/2 [04:21<00:00, 130.94s/it] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Traceback (most recent call last): File "/home/user/app/app.py", line 31, in <module> model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config = bnb_config,device_map={"":0},token='hf_**********************************') File "/home/user/.local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 563, in from_pretrained return model_class.from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3215, in from_pretrained ) = cls._load_pretrained_model( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3603, in _load_pretrained_model new_error_msgs, offload_index, state_dict_index = _load_state_dict_into_meta_model( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 748, in _load_state_dict_into_meta_model set_module_quantized_tensor_to_device( File "/home/user/.local/lib/python3.10/site-packages/transformers/integrations/bitsandbytes.py", line 58, in set_module_quantized_tensor_to_device if old_value.device == torch.device("meta") and device not in ["meta", torch.device("meta")] and value is None: NameError: name 'torch' is not defined

Container logs: