Before revision:  We compared the use of a traditional model (Random Forest) with  a hierarchical encoder attention-based neural network (HEA) model using two language embeddings based on BERT and BioBERT.
After revision:  We compared the performance of a traditional model (Random Forest) with a hierarchical encoder attention-based neural network (HEA) model using two language embeddings based on BERT and BioBERT.