Support subnet host-routes by adding InterfaceRouteTable to the ports

I think you can handle that case by walk all the VMI back ref list and add the the IRT for all of them. That should work because in case of a shared IP a preference mechanism on the overlay is used to define which port should be used.