Question: Do they use attention?
Answer: Yes