Question: How were their results compared to state-of-the-art?
Answer: transformer model achieves higher BLEU score than both Attention encoder-decoder and sequence-sequence model