runtime error

d: nvidia-cuda-cupti-cu12==12.1.105 in /usr/local/lib/python3.10/site-packages (from torch->flash-attn) (12.1.105) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in /usr/local/lib/python3.10/site-packages (from torch->flash-attn) (12.1.105) Requirement already satisfied: nvidia-nvjitlink-cu12 in /usr/local/lib/python3.10/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch->flash-attn) (12.4.127) Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.10/site-packages (from jinja2->torch->flash-attn) (2.1.5) Requirement already satisfied: mpmath>=0.19 in /usr/local/lib/python3.10/site-packages (from sympy->torch->flash-attn) (1.3.0) [notice] A new release of pip available: 22.3.1 -> 24.0 [notice] To update, run: /usr/local/bin/python -m pip install --upgrade pip Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained. The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored. Traceback (most recent call last): File "/home/user/app/app.py", line 20, in <module> model = LlavaQwen2ForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3481, in from_pretrained state_dict = load_state_dict(resolved_archive_file) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 514, in load_state_dict return safe_load_file(checkpoint_file) File "/usr/local/lib/python3.10/site-packages/safetensors/torch.py", line 310, in load_file result[k] = f.get_tensor(k) File "/usr/local/lib/python3.10/site-packages/torch/utils/_device.py", line 77, in __torch_function__ return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 302, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx

Container logs: