Make new tarball before installing it