Hugging Face's logo

JulienRPA
/
BERT2BERT_pretrained_LC-QuAD_2.0

Text2Text Generation
Transformers
PyTorch
TensorBoard
encoder-decoder
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
JulienRPA commited on
Commit
b05a30e
•
1 Parent(s): e826374

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -19
README.md CHANGED
@@ -15,11 +15,11 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model was trained from scratch on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.9002
19
- - Bleu: 79.5906
20
- - Em: 0.08
21
- - Rm: 0.9565
22
- - Gen Len: 48.48
23
 
24
  ## Model description
25
 
@@ -49,20 +49,20 @@ The following hyperparameters were used during training:
49
 
50
  ### Training results
51
 
52
- | Training Loss | Epoch | Step | Bleu | Em | Gen Len | Validation Loss | Rm |
53
- |:-------------:|:-----:|:-----:|:-------:|:----:|:-------:|:---------------:|:------:|
54
- | 7.2445 | 0.83 | 2000 | 1.523 | 0.0 | 204.48 | 7.5619 | nan |
55
- | 3.4458 | 1.66 | 4000 | 16.0372 | 0.0 | 76.36 | 3.4202 | nan |
56
- | 2.2571 | 2.49 | 6000 | 34.5826 | 0.0 | 48.98 | 2.1971 | 0.8125 |
57
- | 1.5696 | 3.32 | 8000 | 53.8822 | 0.0 | 48.7 | 1.6802 | 1.0 |
58
- | 1.1359 | 4.15 | 10000 | 64.5591 | 0.02 | 45.2 | 1.3464 | 0.973 |
59
- | 0.9994 | 4.98 | 12000 | 68.0869 | 0.02 | 47.76 | 1.0576 | 0.8889 |
60
- | 0.7275 | 5.81 | 14000 | 74.1032 | 0.02 | 46.52 | 0.9522 | 0.9556 |
61
- | 0.5868 | 6.64 | 16000 | 0.9307 | 71.6124| 0.02 | 0.9556 | 47.52 |
62
- | 0.4499 | 7.47 | 18000 | 0.8866 | 77.237| 0.06 | 0.9574 | 46.0 |
63
- | 0.3515 | 8.3 | 20000 | 0.9070 | 77.5798| 0.08 | 0.9574 | 47.5 |
64
- | 0.292 | 9.13 | 22000 | 0.8905 | 78.649| 0.06 | 0.9574 | 47.96 |
65
- | 0.2658 | 9.96 | 24000 | 0.9002 | 79.5906| 0.08 | 0.9565 | 48.48 |
66
 
67
 
68
  ### Framework versions
 
15
 
16
  This model was trained from scratch on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.9337
19
+ - Bleu: 81.2301
20
+ - Em: 0.1
21
+ - Rm: 0.22
22
+ - Gen Len: 46.9
23
 
24
  ## Model description
25
 
 
49
 
50
  ### Training results
51
 
52
+ | Training Loss | Epoch | Step | Validation Loss | Bleu | Em | Rm | Gen Len |
53
+ |:-------------:|:-----:|:-----:|:---------------:|:-------:|:----:|:----:|:-------:|
54
+ | 8.0718 | 0.83 | 2000 | 6.9689 | 5.8841 | 0.0 | 0.0 | 126.98 |
55
+ | 3.6551 | 1.66 | 4000 | 3.5248 | 20.8847 | 0.0 | 0.0 | 30.46 |
56
+ | 2.3528 | 2.49 | 6000 | 2.1427 | 47.9723 | 0.0 | 0.02 | 44.52 |
57
+ | 1.5534 | 3.32 | 8000 | 1.5217 | 63.3606 | 0.0 | 0.06 | 46.32 |
58
+ | 1.1024 | 4.15 | 10000 | 1.2364 | 67.3193 | 0.04 | 0.14 | 42.5 |
59
+ | 0.9597 | 4.98 | 12000 | 0.9974 | 74.2575 | 0.04 | 0.16 | 47.52 |
60
+ | 0.7033 | 5.81 | 14000 | 0.9390 | 74.9164 | 0.08 | 0.2 | 45.64 |
61
+ | 0.5446 | 6.64 | 16000 | 0.9508 | 75.9224 | 0.06 | 0.14 | 47.34 |
62
+ | 0.4362 | 7.47 | 18000 | 0.8897 | 77.2209 | 0.1 | 0.22 | 44.36 |
63
+ | 0.3231 | 8.3 | 20000 | 0.9232 | 78.5526 | 0.16 | 0.26 | 46.66 |
64
+ | 0.2584 | 9.13 | 22000 | 0.9404 | 79.9787 | 0.1 | 0.2 | 47.52 |
65
+ | 0.2387 | 9.96 | 24000 | 0.9337 | 81.2301 | 0.1 | 0.22 | 46.9 |
66
 
67
 
68
  ### Framework versions