pourmand1376 commited on
Commit
3d7c34b
โ€ข
1 Parent(s): 264ea79

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -2
README.md CHANGED
@@ -10,7 +10,6 @@ Some Examples for filling the mask:
10
  ุฐูŽู„ููƒูŽ [MASK] ู„ูŽุง ุฑูŽูŠู’ุจูŽ ูููŠู‡ู ู‡ูุฏู‹ู‰ ู„ูู„ู’ู…ูุชู‘ูŽู‚ููŠู†ูŽ
11
  ```
12
  - ```
13
- ูููŠ ู‚ูู„ููˆุจูู‡ูู…ู’ ู…ูŽุฑูŽุถูŒ ููŽุฒูŽุงุฏูŽู‡ูู…ู ุงู„ู„ู‘ูŽู‡ู ู…ูŽุฑูŽุถู‹ุง ูˆูŽู„ูŽู‡ูู…ู’ [MASK] ุฃูŽู„ููŠู…ูŒ ุจูู…ูŽุง ูƒูŽุงู†ููˆุง ูŠูŽูƒู’ุฐูุจููˆู†ูŽ
14
- ```
15
 
16
  This model is fine-tuned on [Bert Base Arabic](https://huggingface.co/asafaya/bert-base-arabic) for 30 epochs. We have used `Masked Language Modeling` to fine-tune the model. Also, after each 5 epochs, we have completely masked the words again for the model to learn the embeddings very well and not overfit the data.
 
10
  ุฐูŽู„ููƒูŽ [MASK] ู„ูŽุง ุฑูŽูŠู’ุจูŽ ูููŠู‡ู ู‡ูุฏู‹ู‰ ู„ูู„ู’ู…ูุชู‘ูŽู‚ููŠู†ูŽ
11
  ```
12
  - ```
13
+ ูŠูŽุง ุฃูŽูŠู‘ูู‡ูŽุง ุงู„ู†ู‘ูŽุงุณู ุงุนู’ุจูุฏููˆุง ุฑูŽุจู‘ูŽูƒูู…ู ุงู„ู‘ูŽุฐููŠ ุฎูŽู„ูŽู‚ูŽูƒูู…ู’ ูˆูŽุงู„ู‘ูŽุฐููŠู†ูŽ ู…ูู†ู’ ู‚ูŽุจู’ู„ููƒูู…ู’ ู„ูŽุนูŽู„ู‘ูŽูƒูู…ู’ [MASK]```
 
14
 
15
  This model is fine-tuned on [Bert Base Arabic](https://huggingface.co/asafaya/bert-base-arabic) for 30 epochs. We have used `Masked Language Modeling` to fine-tune the model. Also, after each 5 epochs, we have completely masked the words again for the model to learn the embeddings very well and not overfit the data.