bonadossou commited on
Commit
35c14d2
1 Parent(s): 133eaf3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -83,6 +83,7 @@ model = XLMRobertaModel.from_pretrained("bonadossou/afrolm_active_learning")
83
  tokenizer = XLMRobertaTokenizer.from_pretrained("bonadossou/afrolm_active_learning")
84
  tokenizer.model_max_length = 256
85
  ```
 
86
 
87
  ## Reproducing our result: Training and Evaluation
88
 
 
83
  tokenizer = XLMRobertaTokenizer.from_pretrained("bonadossou/afrolm_active_learning")
84
  tokenizer.model_max_length = 256
85
  ```
86
+ `Autotokenizer` class does not successfully load our tokenizer. So we recommend to use directly the `XLMRobertaTokenizer` class. Depending on your task, you will load the according mode of the model. Read the [XLMRoberta Documentation](https://huggingface.co/docs/transformers/model_doc/xlm-roberta)
87
 
88
  ## Reproducing our result: Training and Evaluation
89