Only prefer the access_ip if asking for public network