added sparse condition to set predicate dupe checking