Teacher:In this task, you will be presented with a context from an academic paper and you have to write an answerable question based on the context. Your questions can be extractive, abstractive, or yes-no questions.
Teacher: Now, understand the problem? Solve this instance: Furthermore, the gains in WER over the baseline are significantly larger for the Density Ratio method than for Shallow Fusion, with up to 28% relative reduction in WER (17.5% $
ightarrow $ 12.5%) compared to up to 17% relative reduction (17.5% $
ightarrow $ 14.5%) for Shallow Fusion, in the no fine-tuning scenario.
Student:
What metrics are used for evaluation?