kxx-kkk commited on
Commit
795d002
1 Parent(s): 23a8d86

End of training

Browse files
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [kxx-kkk/FYP_sq2_mrqa_adqa_synqa](https://huggingface.co/kxx-kkk/FYP_sq2_mrqa_adqa_synqa) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 2.5802
19
 
20
  ## Model description
21
 
@@ -34,7 +34,7 @@ More information needed
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
- - learning_rate: 2e-05
38
  - train_batch_size: 16
39
  - eval_batch_size: 16
40
  - seed: 42
@@ -47,12 +47,12 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 2.7511 | 0.48 | 300 | 2.9918 |
51
- | 2.538 | 0.96 | 600 | 2.8853 |
52
- | 2.428 | 1.44 | 900 | 2.6102 |
53
- | 2.408 | 1.92 | 1200 | 2.5302 |
54
- | 2.3025 | 2.4 | 1500 | 2.5252 |
55
- | 2.2878 | 2.88 | 1800 | 2.5802 |
56
 
57
 
58
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [kxx-kkk/FYP_sq2_mrqa_adqa_synqa](https://huggingface.co/kxx-kkk/FYP_sq2_mrqa_adqa_synqa) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.7493
19
 
20
  ## Model description
21
 
 
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
+ - learning_rate: 1e-05
38
  - train_batch_size: 16
39
  - eval_batch_size: 16
40
  - seed: 42
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 2.8084 | 0.48 | 300 | 3.1468 |
51
+ | 2.5707 | 0.96 | 600 | 2.9035 |
52
+ | 2.5187 | 1.44 | 900 | 2.7175 |
53
+ | 2.4463 | 1.91 | 1200 | 2.7497 |
54
+ | 2.4328 | 2.39 | 1500 | 2.7229 |
55
+ | 2.3839 | 2.87 | 1800 | 2.7493 |
56
 
57
 
58
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:82653a28827fef18e4b883936e172b3977868918837350129499251e155738ab
3
  size 735356752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff5483a1762939304fe67bf52941948c596c1276ea2a9f6c9b126be8635466a5
3
  size 735356752
runs/Apr09_16-25-18_c7d422db5045/events.out.tfevents.1712679919.c7d422db5045.1943.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:15ffdbfb7f24ecde4b78dd6951df82eefad6e9a54131745d1a66db244c4caf27
3
- size 7899
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7603b29051238cbe90b15a71f9ac6a7d25084ebfb77a24c27b715e2c69fdde63
3
+ size 8253