[ALLI-2296] Additional fix for extra config caching.