Add data prefetcher
🚀 Feature
Add the data prefetcher shown in amp.
NVIDIA/apex#304 (comment)
I feel like it will increase the memory usage (because the gpu would contain two batches of data at the same time). It can be a configuration of trainer.
Motivation
should accelerate the training speed.