instruction:
In this task, you will be presented with a context from an academic paper and a question separated with a 
. You have to answer the question based on the context.
question:
To test the difficulty of our dataset, we checked the majority class label and the accuracies of five state-of-the-art NLI models adopting different approaches: BiMPM (Bilateral Multi-Perspective Matching Model; BIBREF31 , BIBREF31 ), ESIM (Enhanced Sequential Inference Model; BIBREF32 , BIBREF32 ), Decomposable Attention Model BIBREF33 , KIM (Knowledge-based Inference Model; BIBREF34 , BIBREF34 ), and BERT (Bidirectional Encoder Representations from Transformers model; BIBREF35 , BIBREF35 ). Regarding BERT, we checked the performance of a model pretrained on Wikipedia and BookCorpus for language modeling and trained with SNLI and MultiNLI. 
 Question: What NLI models do they analyze?
answer:
BiMPM ESIM Decomposable Attention Model KIM BERT


question:
after a shared CLWE space has been induced, the task is to retrieve target language translations for a test set of source language words retrieve target language translations for a test set of source language words BLI is cast as a ranking task in our BLI setup with only one correct translation for each “query” word, MAP is equal to mean reciprocal rank (MRR) 
 Question: How does BLI measure alignment quality?
answer:
we use mean average precision (MAP) as the main evaluation metric


question:
Following BIBREF21, we sample $K$ captions for each image when applying REINFORCE: ${\hat{c}}_1 \ldots {\hat{c}}_K$, ${\hat{c}}_k \sim p_{\theta }(c|I)$,

The baseline for each sampled caption is defined as the average reward of the rest samples. 
 Question: What baseline function is used in REINFORCE algorithm?
answer:

baseline for each sampled caption is defined as the average reward of the rest samples