Fail if provider.provision_public_ip_address doesn't return an IP