idah4 commited on
Commit
e7eaf03
1 Parent(s): 3860434

Model save

Browse files
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [gogamza/kobart-base-v2](https://huggingface.co/gogamza/kobart-base-v2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 0.2196
19
 
20
  ## Model description
21
 
@@ -34,26 +34,34 @@ More information needed
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
- - learning_rate: 0.0001
38
  - train_batch_size: 16
39
  - eval_batch_size: 16
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
  - lr_scheduler_warmup_steps: 400
44
- - num_epochs: 5
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | No log | 0.63 | 100 | 0.6907 |
51
- | No log | 1.26 | 200 | 0.3665 |
52
- | No log | 1.89 | 300 | 0.3132 |
53
- | No log | 2.52 | 400 | 0.2873 |
54
- | 1.1333 | 3.14 | 500 | 0.2600 |
55
- | 1.1333 | 3.77 | 600 | 0.2312 |
56
- | 1.1333 | 4.4 | 700 | 0.2196 |
 
 
 
 
 
 
 
 
57
 
58
 
59
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [gogamza/kobart-base-v2](https://huggingface.co/gogamza/kobart-base-v2) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.2586
19
 
20
  ## Model description
21
 
 
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
+ - learning_rate: 1e-05
38
  - train_batch_size: 16
39
  - eval_batch_size: 16
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
  - lr_scheduler_warmup_steps: 400
44
+ - num_epochs: 10
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | No log | 0.63 | 100 | 2.9907 |
51
+ | No log | 1.26 | 200 | 0.9196 |
52
+ | No log | 1.89 | 300 | 0.5858 |
53
+ | No log | 2.52 | 400 | 0.4351 |
54
+ | 2.4889 | 3.14 | 500 | 0.3693 |
55
+ | 2.4889 | 3.77 | 600 | 0.3356 |
56
+ | 2.4889 | 4.4 | 700 | 0.3182 |
57
+ | 2.4889 | 5.03 | 800 | 0.3017 |
58
+ | 2.4889 | 5.66 | 900 | 0.2949 |
59
+ | 0.3483 | 6.29 | 1000 | 0.2798 |
60
+ | 0.3483 | 6.92 | 1100 | 0.2748 |
61
+ | 0.3483 | 7.55 | 1200 | 0.2695 |
62
+ | 0.3483 | 8.18 | 1300 | 0.2649 |
63
+ | 0.3483 | 8.81 | 1400 | 0.2610 |
64
+ | 0.2753 | 9.43 | 1500 | 0.2586 |
65
 
66
 
67
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:be7b05effe555e1f4b87384c82388574330d3131b2bdb5e9b4cfeb2a538d7ae9
3
  size 495589768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be6401be4faf2f7be0c074ec6ebfba36ca6e4c5d528674b95665362411ed433d
3
  size 495589768
runs/Apr15_13-10-43_fa02c93dd5cc/events.out.tfevents.1713186645.fa02c93dd5cc.2726.5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:24fbcf6db08bd10512a91dffb73eba3a982e59a605c0a9476465661c8c349dd7
3
- size 7841
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b59051725509275c5470cfe8603220df8a26d9e63cdb8bd4a61b66405f4df46a
3
+ size 10514