Only create the sshdir when an ssh key is provided