Before revision:   The method leverages (1)  a pre-trained language model (BERT) to adjust for the text , and (2) distant supervision to improve the quality of noisy proxies .
After revision:  The method leverages (1) distant supervision to improve the quality of noisy proxies, and (2) a pre-trained language model (BERT) to adjust for the text , and (2) distant supervision to improve the quality of noisy proxies .