I did the binary conversion in the fit_transform method instead.  It works there for some reason.