You will be given a definition of a task first, then some input of the task.
In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.

Embedding: We developed different variations of our models with a simple lookup table embeddings learned from scratch and using high-performance contextual embeddings, which are ELMo BIBREF11, BERT BIBREF16 and ClinicalBERT BIBREF13 (trained and provided by the authors).
Question: What embeddings are used?
Output:
simple lookup table embeddings learned from scratch using high-performance contextual embeddings, which are ELMo BIBREF11, BERT BIBREF16 and ClinicalBERT BIBREF13