Add an additional check to make sure caching is configured for source