Given the task definition and input, reply with output. In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.

Throughout all our experiments, we used BERT-Base BIBREF2 to provide the state-of-the-art contextualized modeling of the input text.

Semantic Retrieval: We treated the neural semantic retrieval at both the paragraph and sentence level as binary classification problems with models' parameters updated by minimizing binary cross entropy loss.
Question: How do they model the neural retrieval modules?
BERT-Base BIBREF2 to provide the state-of-the-art contextualized modeling