runtime error
��| 7.19G/7.26G [05:01<00:03, 18.0MB/s] Downloading model.safetensors: 99%|█████████▉| 7.20G/7.26G [05:02<00:03, 14.3MB/s] Downloading model.safetensors: 99%|█████████▉| 7.21G/7.26G [05:02<00:02, 16.7MB/s] Downloading model.safetensors: 100%|█████████▉| 7.22G/7.26G [05:03<00:02, 14.1MB/s] Downloading model.safetensors: 100%|█████████▉| 7.24G/7.26G [05:03<00:01, 18.1MB/s] Downloading model.safetensors: 100%|█████████▉| 7.25G/7.26G [05:04<00:00, 22.9MB/s] Downloading model.safetensors: 100%|█████████▉| 7.26G/7.26G [05:04<00:00, 25.8MB/s] Downloading model.safetensors: 100%|██████████| 7.26G/7.26G [05:04<00:00, 23.8MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 12, in <module> model = AutoGPTQForCausalLM.from_quantized(model_name_or_path, File "/home/user/.local/lib/python3.10/site-packages/auto_gptq/modeling/auto.py", line 108, in from_quantized return quant_func( File "/home/user/.local/lib/python3.10/site-packages/auto_gptq/modeling/_base.py", line 875, in from_quantized accelerate.utils.modeling.load_checkpoint_in_model( File "/home/user/.local/lib/python3.10/site-packages/accelerate/utils/modeling.py", line 1357, in load_checkpoint_in_model checkpoint = load_state_dict(checkpoint_file, device_map=device_map) File "/home/user/.local/lib/python3.10/site-packages/accelerate/utils/modeling.py", line 1186, in load_state_dict return safe_load_file(checkpoint_file, device=list(device_map.values())[0]) File "/home/user/.local/lib/python3.10/site-packages/safetensors/torch.py", line 310, in load_file result[k] = f.get_tensor(k) File "/home/user/.local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 298, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...