Fix breakage when bringing down cluster.

Its mainly for the firewall rules.