Before revision:  In this paper, we  show how a standard transformer can be morphed into a hierarchical one by using specially designed attention masks and positional embeddings.
After revision:  In this paper, we show how a standard transformer can be morphed into any hierarchical encoder, including HRED and HIBERT like models, by using specially designed attention masks and positional embeddings.