Question: What were the baselines?
Answer: a BiLSTM over all words in the respective sequences with randomly initialised word embeddings, following BIBREF30