Make it possible to set an address from either side of a socket FD.