Added some NaT's and restructured those tests a bit so they weren't so sprawling.

I think `test_date_unit` in `test_pandas.py` has your other point covered, it tests against a df with date index and date column, or am I misunderstanding?