Before revision:  In this paper, we  show how a standard transformer can be morphed into a hierarchical one by using specially designed attention masks and positional embeddings.
After revision:  In this paper, we propose a generalized framework for Hierarchical Transformer Encoders and show how a standard transformer can be morphed into a hierarchical one by using specially designed attention masks and positional embeddings.