specialized hardware like GPUs so it's because you do a lot of reshapes and transposes and so it's never an optimal thing to do so here's the summary of moco one of the main advantages of moco is it is very minimal so it's very easy to use and replicate and it has no architectural change can be easily applied for downstream tasks there is no notion of a patch and it's distilling in variances for images using data augmentations and so the pre-training procedure looks very much like supervised learning and therefore it can