Question: Is the baseline a non-heirarchical model like BERT?
Answer: There were hierarchical and non-hierarchical baselines; BERT was one of those baselines