libcudart.so.11.0: cannot open shared object file: No such file or directory
Hi,
I have environment with:
pip install torch==2.2.2 torchvision==0.17.2 torchaudio==2.2.2 --index-url https://download.pytorch.org/whl/cu121
pip install flash-attn
I get the following error.
auto_factory.py 562 from_pretrained
model_class = _get_model_class(config, cls._model_mapping)
auto_factory.py 383 _get_model_class
supported_models = model_mapping[type(config)]
auto_factory.py 734 getitem
return self._load_attr_from_module(model_type, model_name)
auto_factory.py 748 _load_attr_from_module
return getattribute_from_module(self._modules[module_name], attr)
auto_factory.py 692 getattribute_from_module
if hasattr(module, attr):
import_utils.py 1500 getattr
module = self._get_module(self._class_to_module[name])
import_utils.py 1512 _get_module
raise RuntimeError(
RuntimeError:
Failed to import transformers.models.mistral.modeling_mistral because of the following error (look up to see its traceback):
libcudart.so.11.0: cannot open shared object file: No such file or directory