Nope, only chill out if it was a variance timeout

This allows other timeouts to freak.