We'll still reply normally but follow up messages would come from a different `from_addr`. My feeling is that we'll be able to handle this better once we have support for endpoints in transports.