get comparable or even better results and the momentum encoder memory bank can assume adds a lot of stability to the training and decouples back size from the number of negatives and therefore this lets you train with way fewer GPUs than what's needed for CPC or like methods the disadvantage with moco is that because you introduce momentum and date you need to figure out what's the right decay rate for that and that has an extra type of parameter and another disadvantage is in image augmentation the invariances may not be applicable to