Question: What architectural factors were investigated?
Answer: type of recurrent unit, type of attention, choice of sequential vs. tree-based model structure