Fix forward gridding with pre-existing gpu data.