Adds de-duplication checks