transfers only ref_size from/to the GPU