Before revision:  This highlights a stark trade-off between the two primary metrics for this task -- NDCG and MRR . We find that this is because dense annotations in the dataset do not correlate well with the original ground-truth answers to questions , often rewarding the model for generic responses (e.g. "can't tell") .
After revision:  This highlights a stark trade-off between the two primary metrics for this task -- NDCG and MRR . We find that this is because dense annotations in the dataset do not correlate well with the original ground-truth answers to questions .