Query: What difficulties do BERT model typically have ?
Source: arxiv2_taclccby4_license.pdf
Relevant passages:
BERT does not "under- stand" negation and is insensitive to malformed input.
BERT struggles with representations of num- bers.
BERT cannot reason based on its world knowledge
BERT struggles with pragmatic inference and role-based event knowledge