Detailed Instructions: In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
Q: Despite these shortcomings in using WER as a metric of success, the WER can reflect our model's effectiveness in generating questions that are similar to those of SQuAD based on the given reading passage and answer. WER can be used for initial analyses that can lead to deeper insights as discussed further below.
Question: Why did they choose WER as evaluation metric?
A:
WER can reflect our model's effectiveness in generating questions that are similar to those of SQuAD WER can be used for initial analyses