runtime error
config.json: 0%| | 0.00/738 [00:00<?, ?B/s][A config.json: 100%|██████████| 738/738 [00:00<00:00, 4.42MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 13, in <module> model = AutoGPTQForCausalLM.from_quantized( File "/home/user/.local/lib/python3.10/site-packages/auto_gptq/modeling/auto.py", line 133, in from_quantized return quant_func( File "/home/user/.local/lib/python3.10/site-packages/auto_gptq/modeling/_base.py", line 920, in from_quantized if unsupported_reason is None and _validate_marlin_device_support(): File "/home/user/.local/lib/python3.10/site-packages/auto_gptq/utils/marlin_utils.py", line 107, in _validate_marlin_device_support device_capacity = torch.cuda.get_device_capability() File "/home/user/.local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 439, in get_device_capability prop = get_device_properties(device) File "/home/user/.local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 453, in get_device_properties _lazy_init() # will define _get_device_properties File "/home/user/.local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 302, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...