TST/BUG: allow invalid Timestamps to pass thru as datetimes when operating with offsets

closes #5312