Do not move the GpuSubtensor to the GPU when this do not make sence