Removing tarballs to re-add them later