If CUDA or OpenCL is not being built, default to not building the corresponding plugins