Test if a new file will break the pipeline