Restart if too_long_without_feedback only if we had negative feedback.