Prevent our only thread from getting stuck on timeouts