unitid are necessary for deduplicate purposes