BUG: big endian timedelta fix (GH5779)