added function to measure different types of dupe checking and the results in the comments