Always convert to datetime on comparisons because of inconsistencies between Time#to_f and DateTime#to_f