Update README.md
Browse files
README.md
CHANGED
@@ -26,7 +26,7 @@ pip install torch
|
|
26 |
|
27 |
## Pre-processing details
|
28 |
|
29 |
-
In order to use
|
30 |
|
31 |
* remove all greek diacritics
|
32 |
* convert to lowercase
|
@@ -48,9 +48,9 @@ def preprocess(text, default_replace=""):
|
|
48 |
```python
|
49 |
from transformers import AutoTokenizer, AutoModelForMaskedLM
|
50 |
|
51 |
-
tokenizer = AutoTokenizer.from_pretrained("pchatz/palobert-base-greek-social-media")
|
52 |
|
53 |
-
model = AutoModelForMaskedLM.from_pretrained("pchatz/palobert-base-greek-social-media")
|
54 |
```
|
55 |
You can use this model directly with a pipeline for masked language modeling:
|
56 |
|
|
|
26 |
|
27 |
## Pre-processing details
|
28 |
|
29 |
+
In order to use this model, the text needs to be pre-processed as follows:
|
30 |
|
31 |
* remove all greek diacritics
|
32 |
* convert to lowercase
|
|
|
48 |
```python
|
49 |
from transformers import AutoTokenizer, AutoModelForMaskedLM
|
50 |
|
51 |
+
tokenizer = AutoTokenizer.from_pretrained("pchatz/palobert-base-greek-social-media-v2")
|
52 |
|
53 |
+
model = AutoModelForMaskedLM.from_pretrained("pchatz/palobert-base-greek-social-media-v2")
|
54 |
```
|
55 |
You can use this model directly with a pipeline for masked language modeling:
|
56 |
|