Question: By how much do they outperform standard BERT?
Answer: up to four percentage points in accuracy