Drop the patsy_patch

As of version 0.3.0 patsy includes a fast path for skipping
NA detection of boolean arrays, which is what our patch added.
That's the version of patsy on conda now, so I think we can
stop monkeypatching patsy.