Only create the handle if we specify a device to gpu_init().