In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.

To assess the consistency of annotations and also eliminate coincidental annotations, we used agreement rates, which is calculated by dividing the number of senses under each category where the annotators annotate consistently by the total number of each kind of sense. And considering the potential impact of unbalanced distribution of senses, we also used the Kappa value.
Question: Which inter-annotator metric do they use?
agreement rates Kappa value