In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
Q: The base sentence embedding model is a BiLSTM over all words in the respective sequences with randomly initialised word embeddings, following BIBREF30 . We opt for this strong baseline sentence encoding model, as opposed to engineering sentence embeddings that work particularly well for this dataset, to showcase the dataset. We would expect pre-trained contextual encoding models, e.g. ELMO BIBREF33 , ULMFit BIBREF34 , BERT BIBREF35 , to offer complementary performance gains, as has been shown for a few recent papers BIBREF36 , BIBREF37 .
Question: What were the baselines?
A:
a BiLSTM over all words in the respective sequences with randomly initialised word embeddings, following BIBREF30