Compare to timedelta instead to avoid oddities with Pythons implementation of timedeltas