Before revision:  Furthermore, we found some architectures with reduced numbers of attention heads have better performance.
After revision:  We have also found that some architectures with reduced numbers of attention heads have better performance.