also in-place convert the ArrayRef columns