Can you build a cuda.so file? I've been trying to build but I can't get it to work.
#1
by
taozi555
- opened
Can you build a cuda.so file?
I've been trying to build but I can't get it to work.
can you help me?
I can't, because a nvidia gpu is required for compiling models for cuda, and I don't have it.
Have you tried running it using vulkan? Do you have the vulkan driver https://mlc.ai/mlc-llm/docs/install/gpu.html#vulkan-driver