Check port before connecting, not on client creation

This will take care of 'utils.tests.test_ssh_client.test_ssh_client_copies' failure on jenkins + it's a bit more verbose.