In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.

The experiment settings from this paper and evaluation protocol for the Mboshi corpus (Boundary F-scores using the ZRC speech reference) are the same from BIBREF8. Table presents the results for bilingual UWS and multilingual leveraging.
Question: Does the paper report the accuracy of the model?
No

Each passage was labelled by 3 unique annotators.
Question: How many annotators were there?
3

To assess the consistency of annotations and also eliminate coincidental annotations, we used agreement rates, which is calculated by dividing the number of senses under each category where the annotators annotate consistently by the total number of each kind of sense. And considering the potential impact of unbalanced distribution of senses, we also used the Kappa value.
Question: Which inter-annotator metric do they use?
agreement rates Kappa value