Before revision:  We present EdgeBERT  an in-depth and principled algorithm and hardware design methodology to achieve minimal latency and energy consumption on multi-task NLP inference.
After revision:  We present EdgeBERT an in-depth algorithm-hardware co-design for latency-aware energy optimization for multi-task NLP inference.