Before revision:  We train CoTexT on different combination of available PL corpus including both "bimodal" and "unimodal" data where the former is the combinations of both natural texts and their corresponding code snippets in an input sequence and the latter is merely code snippets.
After revision:  We train CoTexT on different combination of available PL corpus including both "bimodal" and "unimodal" data . Here, bimodal data is the combination of text and corresponding code snippets in an input sequence and the latter is merely code snippets.