Ensure we have source directory to be cached