removing duplicates from ranking