@Andy1621
Added pre-built wheels for causal_conv1d and mamba_ssm, which were built in nvidia/cuda:11.8.0-cudnn8-devel-ubuntu22.04 so we don't need to build them at startup. (CUDA is not available at startup on ZeroGPU)
I've already tested this on both on ZeroGPU and a normal GPU.

Andy1621 changed pull request status to open
Andy1621 changed pull request status to merged
OpenGVLab org

It works!

Sign up or log in to comment