Before revision:  These models are  pre-trained on large amounts of unlabelled data by self-supervision and can be effectively applied for downstream tasks.
After revision:  These models are usually pre-trained on large amounts of unlabelled data by self-supervision and can be effectively applied for downstream tasks.