Question: What are the different variations of the attention-based approach which are examined?
Answer: classic RNN model, avgRNN model, attentionRNN model and multiattention RNN model with and without a projected layer
Alternative answer:  four attention mechanisms instead of one, a projection layer for the word embeddings