Detailed Instructions: In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
Problem:For instance, BIBREF16 and BIBREF17 showed that a hypothesis-only baseline performs better than chance due to cues on their lexical choice and sentence length. Similarly, BIBREF18 showed that NLI models tend to predict entailment for sentence pairs with a high lexical overlap.
Question: What are examples of these artifacts?
Solution:
hypothesis-only baseline performs better than chance due to cues on their lexical choice and sentence length NLI models tend to predict entailment for sentence pairs with a high lexical overlap