Allow peers to tell us of their actual IPs.