UriInfo sets port portion of url as path

Fixes an issue where PathInfo makes `:port` part of the `.Path`.  

The .NET Uri implementations eats this up and so appears to be working but mono will start making urls starting with `:port/path` in the path causing the wrong urls to be hit.