pourmand1376 commited on
Commit
8981ee0
โ€ข
1 Parent(s): 3d7c34b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -10,6 +10,7 @@ Some Examples for filling the mask:
10
  ุฐูŽู„ููƒูŽ [MASK] ู„ูŽุง ุฑูŽูŠู’ุจูŽ ูููŠู‡ู ู‡ูุฏู‹ู‰ ู„ูู„ู’ู…ูุชู‘ูŽู‚ููŠู†ูŽ
11
  ```
12
  - ```
13
- ูŠูŽุง ุฃูŽูŠู‘ูู‡ูŽุง ุงู„ู†ู‘ูŽุงุณู ุงุนู’ุจูุฏููˆุง ุฑูŽุจู‘ูŽูƒูู…ู ุงู„ู‘ูŽุฐููŠ ุฎูŽู„ูŽู‚ูŽูƒูู…ู’ ูˆูŽุงู„ู‘ูŽุฐููŠู†ูŽ ู…ูู†ู’ ู‚ูŽุจู’ู„ููƒูู…ู’ ู„ูŽุนูŽู„ู‘ูŽูƒูู…ู’ [MASK]```
 
14
 
15
  This model is fine-tuned on [Bert Base Arabic](https://huggingface.co/asafaya/bert-base-arabic) for 30 epochs. We have used `Masked Language Modeling` to fine-tune the model. Also, after each 5 epochs, we have completely masked the words again for the model to learn the embeddings very well and not overfit the data.
 
10
  ุฐูŽู„ููƒูŽ [MASK] ู„ูŽุง ุฑูŽูŠู’ุจูŽ ูููŠู‡ู ู‡ูุฏู‹ู‰ ู„ูู„ู’ู…ูุชู‘ูŽู‚ููŠู†ูŽ
11
  ```
12
  - ```
13
+ ูŠูŽุง ุฃูŽูŠู‘ูู‡ูŽุง ุงู„ู†ู‘ูŽุงุณู ุงุนู’ุจูุฏููˆุง ุฑูŽุจู‘ูŽูƒูู…ู ุงู„ู‘ูŽุฐููŠ ุฎูŽู„ูŽู‚ูŽูƒูู…ู’ ูˆูŽุงู„ู‘ูŽุฐููŠู†ูŽ ู…ูู†ู’ ู‚ูŽุจู’ู„ููƒูู…ู’ ู„ูŽุนูŽู„ู‘ูŽูƒูู…ู’ [MASK]
14
+ ```
15
 
16
  This model is fine-tuned on [Bert Base Arabic](https://huggingface.co/asafaya/bert-base-arabic) for 30 epochs. We have used `Masked Language Modeling` to fine-tune the model. Also, after each 5 epochs, we have completely masked the words again for the model to learn the embeddings very well and not overfit the data.