Remove the port value caching code.

This should never have gone in really. It is the calling code's responsibility
to cache data if/when required.