Remove package.json files after a new version is fetched, fix tests