Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
## JavaBERT
|
2 |
+
A BERT-like model pretrained on Java software code.
|
3 |
+
|
4 |
+
### Training Data
|
5 |
+
The model is trained on 2,998,345 Java files retrieved from Open Source projects on GitHub.
|
6 |
+
|
7 |
+
### Training Objective
|
8 |
+
MLM (Masked Language Model) objective was used to train this model.
|
9 |
+
|
10 |
+
### Usage
|
11 |
+
```python
|
12 |
+
from transformers import pipeline
|
13 |
+
pipe = pipeline('fill-mask', model='CAUKiel/JavaBERT')
|
14 |
+
output = pipe(CODE) # Replace with Java code; Use '[MASK]' to mask tokens/words in the code.
|
15 |
+
```
|