Fix up auto-rerunning of changed pipelines