BUG: Fix ``.diff`` on datelike and timedelta operations (GH3100_)

close #3100