Before revision: Transformer is being widely used in Neural Machine Translation (NMT). Deploying Transformer models to mobile or edge devices with limited resources is challenging because of heavy computation  and memory overhead during inference  .
After revision: The deployment of widely used Transformer architecture is challenging because of heavy computation and memory overhead during inference .