Question: Do they use attention?
Answer: Yes
Alternative answer: Yes