SSHMaster: Keep a reference to the tempdir around so we can be sure it hasn't been deleted when closing the connection