Also patch categorical_to_int in patsy.build.