Only open the firewall port if we actually use the firewall