instruction:
In this task, you will be presented with a context from an academic paper and a question separated with a 
. You have to answer the question based on the context.
question:
We apply the Generative Pre-trained Transformer (GPT) BIBREF2 as our pre-trained language model.  
 Question: What pretrained LM is used?
answer:
Generative Pre-trained Transformer (GPT)


question:
Macaw also supports Wizard of Oz studies or intermediary-based information seeking studies. The architecture of Macaw for such setup is presented in FIGREF16. As shown in the figure, the seeker interacts with a real conversational interface that supports multi-modal and mixed-initiative interactions in multiple devices. The intermediary (or the wizard) receives the seeker's message and performs different information seeking actions with Macaw. All seeker-intermediary and intermediary-system interactions will be logged for further analysis. 
 Question: What is a wizard of oz setup?
answer:
seeker interacts with a real conversational interface intermediary (or the wizard) receives the seeker's message and performs different information seeking actions


question:
Subsequently, an LSTM decoder generates the characters in the output word form using encoder states and an attention mechanism. 
 Question: What architecture does the decoder have?
answer:

LSTM