improves duplication message/filtering