Don't mean-center categorical columns