Add isFinite check to retry time