Create README.md

README.md

@@ -0,0 +1,5 @@
+This is a `microsoft/codebert-base-mlm` model, trained for 1,000,000 steps (with `batch_size=32`)  on **Python** code from the `codeparrot/github-code-clean` dataset, on the masked-language-modeling task.
+
+It is intended to be used in CodeBERTScore: [https://github.com/neulab/code-bert-score](https://github.com/neulab/code-bert-score), but can be used for any other model or task.
+
+For more information, see: [https://github.com/neulab/code-bert-score](https://github.com/neulab/code-bert-score)