Question: What are the weaknesses found by non-expert annotators of current state-of-the-art NLI models?
Answer: state-of-the-art models learn to exploit spurious statistical patterns in datasets, human annotators—be they seasoned NLP researchers or non-experts—might easily be able to construct examples that expose model brittleness