Don't set timeout on a bad socket