ENH: Handle missing for extra data with formulas

This should handle all the missing data issues when going through patsy. I know this is mentioned in #1877. Probably elsewhere, but I have to run.

### TODO
- [x] Add to release notes