Remove package's package.json from cache

This file is inlined in the main package.json