Before revision:  To improve GPU utilization and achieve high throughput, it splits a mini-batch into a set of micro-batches and allows the overlapping of the pipelines of multiple micro-batches, including those belonging to different mini-batches.
After revision:  To improve GPU utilization and achieve high throughput, it splits a mini-batch into a set of micro-batches . It allows the overlapping of the pipelines of multiple micro-batches, including those belonging to different mini-batches.