Add an e2e case for public IPs