Keep a separate cache for each config file.