Make the server_port lazy.  This seems to prevent some uninit warnings.
Refactor the remote install tests too.

These would really be a good reason to use Test::Class.