uniform way to handle tcp server addr for both local/remote ipvs