Guarantee the tarball output directory