Further simplify packer template for making ubuntu vagrant boxes

Also clean .gitignores a bit and fix a few manifest bugs