Remove the columns if they label are left or right aligned