AWQ compile fails against 23.06 Pytorch container on L4
Possible relevant bits from the logs(they are very long):
48.69 No CUDA runtime is found, using CUDA_HOME='/usr/local/cuda'
48.75 running install
48.75 /usr/local/lib/python3.10/dist-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
48.75 warnings.warn(
48.78 /usr/local/lib/python3.10/dist-packages/setuptools/command/easy_install.py:144: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
48.78 warnings.warn(
er
107.1 ptxas gemm_cuda_gen.compute_52.ptx, line 1019; error : Feature 'mma' requires .target sm_70 or higher
107.1 ptxas gemm_cuda_gen.compute_52.ptx, line 1019; error : Feature '.m16n8k16' requires .target sm_80 or higher
107.1 ptxas gemm_cuda_gen.compute_52.ptx, line 1023; error : Feature 'mma' requires .target sm_70 or higher
107.1 ptxas gemm_cuda_gen.compute_52.ptx, line 1023; error : Feature '.m16n8k16' requires .target sm_80 or higher
107.1 ptxas fatal : Ptx assembly aborted due to errors
107.1 ninja: build stopped: subcommand failed.
107.1 Traceback (most recent call last):
107.1 File "/usr/local/lib/python3.10/dist-packages/torch/utils/cpp_extension.py", line 1894, in _run_ninja_build
107.1 subprocess.run(
107.1 File "/usr/lib/python3.10/subprocess.py", line 524, in run
107.1 raise CalledProcessError(retcode, process.args,
107.1 subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.
107.1
107.1 The above exception was the direct cause of the following exception:
107.1 _write_ninja_file_and_compile_objects(
107.1 File "/usr/local/lib/python3.10/dist-packages/torch/utils/cpp_extension.py", line 1573, in _write_ninja_file_and_compile_objects
107.1 _run_ninja_build(
107.1 File "/usr/local/lib/python3.10/dist-packages/torch/utils/cpp_extension.py", line 1910, in _run_ninja_build
107.1 raise RuntimeError(message) from e
107.1 RuntimeError: Error compiling objects for extension