Don't accept connections while leaving