How can I integrate shuffling BN (in MoCo) with PTL?
https://github.com/facebookresearch/moco/blob/master/moco/builder.py#L68-L113
This part breaks PTL's abstraction around DDP, and I'm not sure how to integrate it cleanly. Thank you so much!