Removes old public ssh file