[IPVS] Use the configured endpoint, if possible.