ENH: handle np.datetime64,np.timedelta64,date,timedelta types