thread2 added; validates against set of requried metadata fields
thread2 does not ingest files missing metadata