Q: In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
On the other hand, in the case of MHD, instead of the integration at attention level, we assign multiple decoders for each head and then integrate their outputs to get a final output.
Question: Does each attention head in the decoder calculate the same output?
A:
No