Only make y a column vector if it's not one-hot.