Remove hardcoded port in RemoteRouterSpec, see #3369

I'm not sure this is the reason for the failure, but it should be cleaned up anyway.