In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
Q: When testing across languages, we report accuracy for two setups: average accuracy over each single-language model (Avg), and accuracy obtained when training on the concatenation of all languages but the target one (All). The latter setting is also used for the embeddings model. We report accuracy for all experiments.
Question: What are the evaluation metrics used?
A:
average accuracy over each single-language model (Avg), and accuracy obtained when training on the concatenation of all languages but the target one (All)