Stop timeout timer if we stop polling.