Hugging Face's logo

parsi-ai-nlpclass
/
PersianEase

Text2Text Generation
Transformers
Safetensors
Persian
t5
text-generation-inference
Inference Endpoints
Model card Files Community
PardisSzah commited on
Commit
352c11a
•
1 Parent(s): 9208d25

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -12
README.md CHANGED
@@ -12,18 +12,19 @@ This model is fine-tuned to generate informal text from formal text based on the
12
 
13
  ## Evaluation Metrics
14
 
15
- | Metric | Basic Model | Base Persian T5 | Our Model |
16
- |----------------------|-------------|-----------------|-------------|
17
- | BLEU-1 | 0.524 | 0.212 | **0.636** |
18
- | BLEU-2 | 0.358 | 0.137 | **0.511** |
19
- | BLEU-3 | 0.254 | 0.096 | **0.416** |
20
- | BLEU-4 | 0.18 | 0.068 | **0.337** |
21
- | Bert-Score Precision | 0.671 | 0.537 | **0.797** |
22
- | Bert-Score Recall | 0.712 | 0.570 | **0.805** |
23
- | Bert-Score F1 Score | 0.690 | 0.549 | **0.800** |
24
- | ROUGE-1 F1 Score | 0.553 | - | **0.645** |
25
- | ROUGE-2 F1 Score | 0.274 | - | **0.427** |
26
- | ROUGE-l F1 Score | 0.522 | - | **0.628** |
 
27
 
28
 
29
 
 
12
 
13
  ## Evaluation Metrics
14
 
15
+ | Metric | Basic Model | Base Persian T5 | Previous Semester Model | Our Model |
16
+ |----------------------|-------------|-----------------|--------------------------|----------------|
17
+ | BLEU-1 | 0.269 | 0.256 | 0.397 | **0.664** |
18
+ | BLEU-2 | 0.137 | 0.171 | 0.299 | **0.539** |
19
+ | BLEU-3 | 0.084 | 0.121 | 0.231 | **0.444** |
20
+ | BLEU-4 | 0.054 | 0.086 | 0.177 | **0.364** |
21
+ | Bert-Score Precision | 0.581 | 0.583 | 0.665 | **0.826** |
22
+ | Bert-Score Recall | 0.629 | 0.614 | 0.659 | **0.820** |
23
+ | Bert-Score F1 Score | 0.603 | 0.595 | 0.658 | **0.822** |
24
+ | ROUGE-1 F1 Score | 0.259 | - | - | **0.701** |
25
+ | ROUGE-2 F1 Score | 0.061 | - | - | **0.475** |
26
+ | ROUGE-l F1 Score | 0.250 | - | - | **0.675** |
27
+
28
 
29
 
30