In this task, you will be presented with a context from an academic paper and you have to write an answerable question based on the context. Your questions can be extractive, abstractive, or yes-no questions.

[Q]: We adapted BERTNLU from ConvLab-2.  We implemented a rule-based model (RuleDST) and adapted TRADE (Transferable Dialogue State Generator) BIBREF19 in this experiment.  We adapted a vanilla policy trained in a supervised fashion from ConvLab-2 (SL policy). 
[A]: What are the benchmark models?


[Q]: The model consists of one layer of LSTM followed by three dense layers. The LSTM layer uses a dropout value of 0.2. 
[A]: Do they use dropout?


[Q]: We find that the visual attention is very sparse, in that just one source encoding is attended to (the maximum visual attention over source encodings, across the test set, has mean 0.99 and standard deviation 0.015), thereby limiting the use of modulation. In both cases, we find that the visual component of the attention hasn't learnt any variation over the source encodings, again suggesting that the visual embeddings do not lend themselves to enhancing token-level discriminativess during prediction. We find this to be consistent across sentences of different lengths.
[A]:
What is result of their attention distribution analysis?