runtime error

as nvcc available? If you're installing within a container from https://hub.docker.com/r/pytorch/pytorch, only images whose names contain 'devel' will provide nvcc. warnings.warn( Traceback (most recent call last): File "<string>", line 2, in <module> File "<pip-setuptools-caller>", line 34, in <module> File "/tmp/pip-install-r2z1p82s/flash-attn_5bb34f77c1894b5db85ad509a664562f/setup.py", line 134, in <module> CUDAExtension( File "/usr/local/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1077, in CUDAExtension library_dirs += library_paths(cuda=True) File "/usr/local/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1204, in library_paths if (not os.path.exists(_join_cuda_home(lib_dir)) and File "/usr/local/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 2419, in _join_cuda_home raise OSError('CUDA_HOME environment variable is not set. ' OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root. [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: metadata-generation-failed × Encountered error while generating package metadata. ╰─> See above for output. note: This is an issue with the package mentioned above, not pip. hint: See above for details. [notice] A new release of pip available: 22.3.1 -> 24.0 [notice] To update, run: pip install --upgrade pip Traceback (most recent call last): File "/home/user/app/app.py", line 14, in <module> install_package('flash-attn') File "/home/user/app/app.py", line 11, in install_package subprocess.check_call(['pip', 'install', package, '--no-build-isolation']) File "/usr/local/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['pip', 'install', 'flash-attn', '--no-build-isolation']' returned non-zero exit status 1.

Container logs:

Fetching error logs...