Actually kill the tests sshd process. Provide a custom know_hosts file to use