Skip setting the device when using qdp-jit