Don't create nary_union when not needed.