bonadossou
commited on
Commit
•
35c14d2
1
Parent(s):
133eaf3
Update README.md
Browse files
README.md
CHANGED
@@ -83,6 +83,7 @@ model = XLMRobertaModel.from_pretrained("bonadossou/afrolm_active_learning")
|
|
83 |
tokenizer = XLMRobertaTokenizer.from_pretrained("bonadossou/afrolm_active_learning")
|
84 |
tokenizer.model_max_length = 256
|
85 |
```
|
|
|
86 |
|
87 |
## Reproducing our result: Training and Evaluation
|
88 |
|
|
|
83 |
tokenizer = XLMRobertaTokenizer.from_pretrained("bonadossou/afrolm_active_learning")
|
84 |
tokenizer.model_max_length = 256
|
85 |
```
|
86 |
+
`Autotokenizer` class does not successfully load our tokenizer. So we recommend to use directly the `XLMRobertaTokenizer` class. Depending on your task, you will load the according mode of the model. Read the [XLMRoberta Documentation](https://huggingface.co/docs/transformers/model_doc/xlm-roberta)
|
87 |
|
88 |
## Reproducing our result: Training and Evaluation
|
89 |
|