Before revision:  We perform extensive ablations to determine which factors contribute to the quality of the learned embeddings  .
After revision:  We perform extensive ablations to determine which factors contribute to the quality of the learned embeddings scale with both the number of trainable parameters and the amount of unlabelled training data, making further improvements straightforward .