Discard MetadataCache after jobs have been run
Skip writing MetadataStore if --dry-run