Update README.md
Browse files
README.md
CHANGED
@@ -21,7 +21,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
21 |
|
22 |
# Adv_BERT_msda
|
23 |
|
24 |
-
This model is
|
25 |
It achieves the following results on the evaluation set:
|
26 |
- Loss: 0.4117
|
27 |
- Accuracy: 0.8655
|
@@ -43,7 +43,7 @@ It achieves the following results on the evaluation set:
|
|
43 |
|
44 |
## Training procedure
|
45 |
|
46 |
-
We have trained this model using the
|
47 |
|
48 |
### Training hyperparameters
|
49 |
|
|
|
21 |
|
22 |
# Adv_BERT_msda
|
23 |
|
24 |
+
This model is an **adversarially fine-tuned** version of [aubmindlab/bert-base-arabertv2](https://huggingface.co/aubmindlab/bert-base-arabertv2) on the Sentiment Analysis for Social Media Posts in Arabic Dialect (MSDA) dataset, augmented by our generated adversarial examples.
|
25 |
It achieves the following results on the evaluation set:
|
26 |
- Loss: 0.4117
|
27 |
- Accuracy: 0.8655
|
|
|
43 |
|
44 |
## Training procedure
|
45 |
|
46 |
+
We have trained this model using the PaperSpace GPU-Cloud service. We used a machine with 8 CPUs, 45GB RAM, and A6000 GPU with 48GB RAM.
|
47 |
|
48 |
### Training hyperparameters
|
49 |
|