TASK DEFINITION: In this task, you will be presented with a context from an academic paper and you have to write an answerable question based on the context. Your questions can be extractive, abstractive, or yes-no questions.
PROBLEM: The ensembles were formed by simply averaging the predictions from the constituent single models.

SOLUTION: How does their ensemble method work?

PROBLEM: Annotator votes for one of the seven emotions, namely Ekman’s six basic emotions BIBREF1, plus the neutral.

SOLUTION: What labels does the dataset have?

PROBLEM: For NMT, we used the KyotoNMT system BIBREF16 . The NMT training settings are the same as those of the best systems that participated in WAT 2016. The sizes of the source and target vocabularies, the source and target side embeddings, the hidden states, the attention mechanism hidden states, and the deep softmax output with a 2-maxout layer were set to 32,000, 620, 1000, 1000, and 500, respectively. We used 2-layer LSTMs for both the source and target sides. ADAM was used as the learning algorithm, with a dropout rate of 20% for the inter-layer dropout, and L2 regularization with a weight decay coefficient of 1e-6. The mini batch size was 64, and sentences longer than 80 tokens were discarded.

SOLUTION:
What kinds of neural networks did they use in this paper?