Question: Do they use multi-attention heads?
Answer: Yes