Before revision:  We find that for reasonable baseline models, `I don't know' is preferred over the reference more than half the time, but this can be mitigated with hyperparameter tuning  .
After revision:  We find that for reasonable baseline models, `I don't know' is preferred over the reference more than half the time, but this can be mitigated with hyperparameter tuning . RUQ allows for the direct analysis of the `I don't know' problem, which has been addressed but not analyzed by prior work .