Should use the ~/.ssh/config to set the SSH port