Before revision:  These models are  pre-trained on large amounts of unlabelled data by self-supervision and can be effectively applied for downstream tasks.
After revision:  These models are pre-trained on large amounts of unlabeled data by self-supervision and can be effectively applied for downstream tasks.