Don't do two copies of data on inplace operations unless it is non-contiguous and we really need to.