Question: Do the BERT-based embeddings improve results?
Answer: Yes