 In this paper, we  show how a standard transformer can be morphed into a hierarchical one by using specially designed attention masks and positional embeddings.
<meaning-changed>  In this paper, we  show how a standard transformer can be morphed into a hierarchical one by using specially designed attention masks and positional embeddings.
 In this paper, we propose a generalized framework for Hierarchical Transformer Encoders and show how a standard transformer can be morphed into a hierarchical one by using specially designed attention masks and positional embeddings.