Saying that, if we allow a different filenames to be specified in package.json, we will want to consider caching it. It's be nice to not have to load package.json at all on startup - is there anything else in there that is currently needed on startup?