Specifying connection port in KeyServer

This is reference to issue https://github.com/openpgp-keychain/openpgp-keychain/issues/97. I have made specifying connection port possible in KeyServer. Please verify and let me know if any changes are required.