learn3r commited on
Commit
99c281a
1 Parent(s): 754f7be

End of training

Browse files
Files changed (5) hide show
  1. README.md +21 -8
  2. all_results.json +18 -0
  3. eval_results.json +13 -0
  4. train_results.json +8 -0
  5. trainer_state.json +2133 -0
README.md CHANGED
@@ -1,11 +1,24 @@
1
  ---
 
2
  tags:
3
  - generated_from_trainer
 
 
4
  metrics:
5
  - rouge
6
  model-index:
7
  - name: longt5_xl_gov_memsum_bp_20
8
- results: []
 
 
 
 
 
 
 
 
 
 
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -13,14 +26,14 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # longt5_xl_gov_memsum_bp_20
15
 
16
- This model was trained from scratch on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 4.3339
19
- - Rouge1: 39.5612
20
- - Rouge2: 13.4283
21
- - Rougel: 17.3666
22
- - Rougelsum: 37.6526
23
- - Gen Len: 1710.4111
24
 
25
  ## Model description
26
 
 
1
  ---
2
+ base_model: /exports/eddie/scratch/s1970716/models/summarization/longt5_xl_gov_memsum_bp_15/checkpoint-1360
3
  tags:
4
  - generated_from_trainer
5
+ datasets:
6
+ - learn3r/gov_report_memsum_bp
7
  metrics:
8
  - rouge
9
  model-index:
10
  - name: longt5_xl_gov_memsum_bp_20
11
+ results:
12
+ - task:
13
+ name: Summarization
14
+ type: summarization
15
+ dataset:
16
+ name: learn3r/gov_report_memsum_bp
17
+ type: learn3r/gov_report_memsum_bp
18
+ metrics:
19
+ - name: Rouge1
20
+ type: rouge
21
+ value: 42.5601
22
  ---
23
 
24
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
26
 
27
  # longt5_xl_gov_memsum_bp_20
28
 
29
+ This model is a fine-tuned version of [/exports/eddie/scratch/s1970716/models/summarization/longt5_xl_gov_memsum_bp_15/checkpoint-1360](https://huggingface.co//exports/eddie/scratch/s1970716/models/summarization/longt5_xl_gov_memsum_bp_15/checkpoint-1360) on the learn3r/gov_report_memsum_bp dataset.
30
  It achieves the following results on the evaluation set:
31
+ - Loss: 3.6259
32
+ - Rouge1: 42.5601
33
+ - Rouge2: 14.1791
34
+ - Rougel: 17.9691
35
+ - Rougelsum: 40.487
36
+ - Gen Len: 1510.8695
37
 
38
  ## Model description
39
 
all_results.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 4.99,
3
+ "eval_gen_len": 1510.8694758478932,
4
+ "eval_loss": 3.6259207725524902,
5
+ "eval_rouge1": 42.5601,
6
+ "eval_rouge2": 14.1791,
7
+ "eval_rougeL": 17.9691,
8
+ "eval_rougeLsum": 40.487,
9
+ "eval_runtime": 18932.6952,
10
+ "eval_samples": 973,
11
+ "eval_samples_per_second": 0.051,
12
+ "eval_steps_per_second": 0.006,
13
+ "train_loss": 0.10004215405925232,
14
+ "train_runtime": 141879.0284,
15
+ "train_samples": 17457,
16
+ "train_samples_per_second": 0.615,
17
+ "train_steps_per_second": 0.005
18
+ }
eval_results.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 4.99,
3
+ "eval_gen_len": 1510.8694758478932,
4
+ "eval_loss": 3.6259207725524902,
5
+ "eval_rouge1": 42.5601,
6
+ "eval_rouge2": 14.1791,
7
+ "eval_rougeL": 17.9691,
8
+ "eval_rougeLsum": 40.487,
9
+ "eval_runtime": 18932.6952,
10
+ "eval_samples": 973,
11
+ "eval_samples_per_second": 0.051,
12
+ "eval_steps_per_second": 0.006
13
+ }
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 4.99,
3
+ "train_loss": 0.10004215405925232,
4
+ "train_runtime": 141879.0284,
5
+ "train_samples": 17457,
6
+ "train_samples_per_second": 0.615,
7
+ "train_steps_per_second": 0.005
8
+ }
trainer_state.json ADDED
@@ -0,0 +1,2133 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 3.6259207725524902,
3
+ "best_model_checkpoint": "/exports/eddie/scratch/s1970716/models/summarization/longt5_xl_gov_memsum_bp_20/checkpoint-136",
4
+ "epoch": 4.985679917516325,
5
+ "eval_steps": 500,
6
+ "global_step": 680,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.01,
13
+ "learning_rate": 0.001,
14
+ "loss": 0.1745,
15
+ "step": 2
16
+ },
17
+ {
18
+ "epoch": 0.03,
19
+ "learning_rate": 0.001,
20
+ "loss": 0.1678,
21
+ "step": 4
22
+ },
23
+ {
24
+ "epoch": 0.04,
25
+ "learning_rate": 0.001,
26
+ "loss": 0.1686,
27
+ "step": 6
28
+ },
29
+ {
30
+ "epoch": 0.06,
31
+ "learning_rate": 0.001,
32
+ "loss": 0.1572,
33
+ "step": 8
34
+ },
35
+ {
36
+ "epoch": 0.07,
37
+ "learning_rate": 0.001,
38
+ "loss": 0.1619,
39
+ "step": 10
40
+ },
41
+ {
42
+ "epoch": 0.09,
43
+ "learning_rate": 0.001,
44
+ "loss": 0.1668,
45
+ "step": 12
46
+ },
47
+ {
48
+ "epoch": 0.1,
49
+ "learning_rate": 0.001,
50
+ "loss": 0.1699,
51
+ "step": 14
52
+ },
53
+ {
54
+ "epoch": 0.12,
55
+ "learning_rate": 0.001,
56
+ "loss": 0.1651,
57
+ "step": 16
58
+ },
59
+ {
60
+ "epoch": 0.13,
61
+ "learning_rate": 0.001,
62
+ "loss": 0.1616,
63
+ "step": 18
64
+ },
65
+ {
66
+ "epoch": 0.15,
67
+ "learning_rate": 0.001,
68
+ "loss": 0.1565,
69
+ "step": 20
70
+ },
71
+ {
72
+ "epoch": 0.16,
73
+ "learning_rate": 0.001,
74
+ "loss": 0.1558,
75
+ "step": 22
76
+ },
77
+ {
78
+ "epoch": 0.18,
79
+ "learning_rate": 0.001,
80
+ "loss": 0.1532,
81
+ "step": 24
82
+ },
83
+ {
84
+ "epoch": 0.19,
85
+ "learning_rate": 0.001,
86
+ "loss": 0.1623,
87
+ "step": 26
88
+ },
89
+ {
90
+ "epoch": 0.21,
91
+ "learning_rate": 0.001,
92
+ "loss": 0.1571,
93
+ "step": 28
94
+ },
95
+ {
96
+ "epoch": 0.22,
97
+ "learning_rate": 0.001,
98
+ "loss": 0.1532,
99
+ "step": 30
100
+ },
101
+ {
102
+ "epoch": 0.23,
103
+ "learning_rate": 0.001,
104
+ "loss": 0.164,
105
+ "step": 32
106
+ },
107
+ {
108
+ "epoch": 0.25,
109
+ "learning_rate": 0.001,
110
+ "loss": 0.1516,
111
+ "step": 34
112
+ },
113
+ {
114
+ "epoch": 0.26,
115
+ "learning_rate": 0.001,
116
+ "loss": 0.1572,
117
+ "step": 36
118
+ },
119
+ {
120
+ "epoch": 0.28,
121
+ "learning_rate": 0.001,
122
+ "loss": 0.1609,
123
+ "step": 38
124
+ },
125
+ {
126
+ "epoch": 0.29,
127
+ "learning_rate": 0.001,
128
+ "loss": 0.1581,
129
+ "step": 40
130
+ },
131
+ {
132
+ "epoch": 0.31,
133
+ "learning_rate": 0.001,
134
+ "loss": 0.1586,
135
+ "step": 42
136
+ },
137
+ {
138
+ "epoch": 0.32,
139
+ "learning_rate": 0.001,
140
+ "loss": 0.1621,
141
+ "step": 44
142
+ },
143
+ {
144
+ "epoch": 0.34,
145
+ "learning_rate": 0.001,
146
+ "loss": 0.1573,
147
+ "step": 46
148
+ },
149
+ {
150
+ "epoch": 0.35,
151
+ "learning_rate": 0.001,
152
+ "loss": 0.1541,
153
+ "step": 48
154
+ },
155
+ {
156
+ "epoch": 0.37,
157
+ "learning_rate": 0.001,
158
+ "loss": 0.1584,
159
+ "step": 50
160
+ },
161
+ {
162
+ "epoch": 0.38,
163
+ "learning_rate": 0.001,
164
+ "loss": 0.1574,
165
+ "step": 52
166
+ },
167
+ {
168
+ "epoch": 0.4,
169
+ "learning_rate": 0.001,
170
+ "loss": 0.1505,
171
+ "step": 54
172
+ },
173
+ {
174
+ "epoch": 0.41,
175
+ "learning_rate": 0.001,
176
+ "loss": 0.1567,
177
+ "step": 56
178
+ },
179
+ {
180
+ "epoch": 0.43,
181
+ "learning_rate": 0.001,
182
+ "loss": 0.1573,
183
+ "step": 58
184
+ },
185
+ {
186
+ "epoch": 0.44,
187
+ "learning_rate": 0.001,
188
+ "loss": 0.1584,
189
+ "step": 60
190
+ },
191
+ {
192
+ "epoch": 0.45,
193
+ "learning_rate": 0.001,
194
+ "loss": 0.1561,
195
+ "step": 62
196
+ },
197
+ {
198
+ "epoch": 0.47,
199
+ "learning_rate": 0.001,
200
+ "loss": 0.1543,
201
+ "step": 64
202
+ },
203
+ {
204
+ "epoch": 0.48,
205
+ "learning_rate": 0.001,
206
+ "loss": 0.1539,
207
+ "step": 66
208
+ },
209
+ {
210
+ "epoch": 0.5,
211
+ "learning_rate": 0.001,
212
+ "loss": 0.152,
213
+ "step": 68
214
+ },
215
+ {
216
+ "epoch": 0.51,
217
+ "learning_rate": 0.001,
218
+ "loss": 0.1485,
219
+ "step": 70
220
+ },
221
+ {
222
+ "epoch": 0.53,
223
+ "learning_rate": 0.001,
224
+ "loss": 0.1533,
225
+ "step": 72
226
+ },
227
+ {
228
+ "epoch": 0.54,
229
+ "learning_rate": 0.001,
230
+ "loss": 0.1653,
231
+ "step": 74
232
+ },
233
+ {
234
+ "epoch": 0.56,
235
+ "learning_rate": 0.001,
236
+ "loss": 0.1607,
237
+ "step": 76
238
+ },
239
+ {
240
+ "epoch": 0.57,
241
+ "learning_rate": 0.001,
242
+ "loss": 0.1625,
243
+ "step": 78
244
+ },
245
+ {
246
+ "epoch": 0.59,
247
+ "learning_rate": 0.001,
248
+ "loss": 0.1507,
249
+ "step": 80
250
+ },
251
+ {
252
+ "epoch": 0.6,
253
+ "learning_rate": 0.001,
254
+ "loss": 0.1605,
255
+ "step": 82
256
+ },
257
+ {
258
+ "epoch": 0.62,
259
+ "learning_rate": 0.001,
260
+ "loss": 0.1579,
261
+ "step": 84
262
+ },
263
+ {
264
+ "epoch": 0.63,
265
+ "learning_rate": 0.001,
266
+ "loss": 0.1525,
267
+ "step": 86
268
+ },
269
+ {
270
+ "epoch": 0.65,
271
+ "learning_rate": 0.001,
272
+ "loss": 0.156,
273
+ "step": 88
274
+ },
275
+ {
276
+ "epoch": 0.66,
277
+ "learning_rate": 0.001,
278
+ "loss": 0.1605,
279
+ "step": 90
280
+ },
281
+ {
282
+ "epoch": 0.67,
283
+ "learning_rate": 0.001,
284
+ "loss": 0.1586,
285
+ "step": 92
286
+ },
287
+ {
288
+ "epoch": 0.69,
289
+ "learning_rate": 0.001,
290
+ "loss": 0.1548,
291
+ "step": 94
292
+ },
293
+ {
294
+ "epoch": 0.7,
295
+ "learning_rate": 0.001,
296
+ "loss": 0.1491,
297
+ "step": 96
298
+ },
299
+ {
300
+ "epoch": 0.72,
301
+ "learning_rate": 0.001,
302
+ "loss": 0.1489,
303
+ "step": 98
304
+ },
305
+ {
306
+ "epoch": 0.73,
307
+ "learning_rate": 0.001,
308
+ "loss": 0.1596,
309
+ "step": 100
310
+ },
311
+ {
312
+ "epoch": 0.75,
313
+ "learning_rate": 0.001,
314
+ "loss": 0.1615,
315
+ "step": 102
316
+ },
317
+ {
318
+ "epoch": 0.76,
319
+ "learning_rate": 0.001,
320
+ "loss": 0.1638,
321
+ "step": 104
322
+ },
323
+ {
324
+ "epoch": 0.78,
325
+ "learning_rate": 0.001,
326
+ "loss": 0.1577,
327
+ "step": 106
328
+ },
329
+ {
330
+ "epoch": 0.79,
331
+ "learning_rate": 0.001,
332
+ "loss": 0.1552,
333
+ "step": 108
334
+ },
335
+ {
336
+ "epoch": 0.81,
337
+ "learning_rate": 0.001,
338
+ "loss": 0.1592,
339
+ "step": 110
340
+ },
341
+ {
342
+ "epoch": 0.82,
343
+ "learning_rate": 0.001,
344
+ "loss": 0.1632,
345
+ "step": 112
346
+ },
347
+ {
348
+ "epoch": 0.84,
349
+ "learning_rate": 0.001,
350
+ "loss": 0.1548,
351
+ "step": 114
352
+ },
353
+ {
354
+ "epoch": 0.85,
355
+ "learning_rate": 0.001,
356
+ "loss": 0.1509,
357
+ "step": 116
358
+ },
359
+ {
360
+ "epoch": 0.87,
361
+ "learning_rate": 0.001,
362
+ "loss": 0.1539,
363
+ "step": 118
364
+ },
365
+ {
366
+ "epoch": 0.88,
367
+ "learning_rate": 0.001,
368
+ "loss": 0.1584,
369
+ "step": 120
370
+ },
371
+ {
372
+ "epoch": 0.89,
373
+ "learning_rate": 0.001,
374
+ "loss": 0.1663,
375
+ "step": 122
376
+ },
377
+ {
378
+ "epoch": 0.91,
379
+ "learning_rate": 0.001,
380
+ "loss": 0.1628,
381
+ "step": 124
382
+ },
383
+ {
384
+ "epoch": 0.92,
385
+ "learning_rate": 0.001,
386
+ "loss": 0.1529,
387
+ "step": 126
388
+ },
389
+ {
390
+ "epoch": 0.94,
391
+ "learning_rate": 0.001,
392
+ "loss": 0.1506,
393
+ "step": 128
394
+ },
395
+ {
396
+ "epoch": 0.95,
397
+ "learning_rate": 0.001,
398
+ "loss": 0.1595,
399
+ "step": 130
400
+ },
401
+ {
402
+ "epoch": 0.97,
403
+ "learning_rate": 0.001,
404
+ "loss": 0.1564,
405
+ "step": 132
406
+ },
407
+ {
408
+ "epoch": 0.98,
409
+ "learning_rate": 0.001,
410
+ "loss": 0.1561,
411
+ "step": 134
412
+ },
413
+ {
414
+ "epoch": 1.0,
415
+ "learning_rate": 0.001,
416
+ "loss": 0.1591,
417
+ "step": 136
418
+ },
419
+ {
420
+ "epoch": 1.0,
421
+ "eval_gen_len": 1510.8694758478932,
422
+ "eval_loss": 3.6259207725524902,
423
+ "eval_rouge1": 42.5601,
424
+ "eval_rouge2": 14.1791,
425
+ "eval_rougeL": 17.9691,
426
+ "eval_rougeLsum": 40.487,
427
+ "eval_runtime": 18906.076,
428
+ "eval_samples_per_second": 0.051,
429
+ "eval_steps_per_second": 0.006,
430
+ "step": 136
431
+ },
432
+ {
433
+ "epoch": 1.01,
434
+ "learning_rate": 0.001,
435
+ "loss": 0.1101,
436
+ "step": 138
437
+ },
438
+ {
439
+ "epoch": 1.03,
440
+ "learning_rate": 0.001,
441
+ "loss": 0.099,
442
+ "step": 140
443
+ },
444
+ {
445
+ "epoch": 1.04,
446
+ "learning_rate": 0.001,
447
+ "loss": 0.0929,
448
+ "step": 142
449
+ },
450
+ {
451
+ "epoch": 1.06,
452
+ "learning_rate": 0.001,
453
+ "loss": 0.0896,
454
+ "step": 144
455
+ },
456
+ {
457
+ "epoch": 1.07,
458
+ "learning_rate": 0.001,
459
+ "loss": 0.0955,
460
+ "step": 146
461
+ },
462
+ {
463
+ "epoch": 1.09,
464
+ "learning_rate": 0.001,
465
+ "loss": 0.094,
466
+ "step": 148
467
+ },
468
+ {
469
+ "epoch": 1.1,
470
+ "learning_rate": 0.001,
471
+ "loss": 0.096,
472
+ "step": 150
473
+ },
474
+ {
475
+ "epoch": 1.11,
476
+ "learning_rate": 0.001,
477
+ "loss": 0.0938,
478
+ "step": 152
479
+ },
480
+ {
481
+ "epoch": 1.13,
482
+ "learning_rate": 0.001,
483
+ "loss": 0.0959,
484
+ "step": 154
485
+ },
486
+ {
487
+ "epoch": 1.14,
488
+ "learning_rate": 0.001,
489
+ "loss": 0.0987,
490
+ "step": 156
491
+ },
492
+ {
493
+ "epoch": 1.16,
494
+ "learning_rate": 0.001,
495
+ "loss": 0.1012,
496
+ "step": 158
497
+ },
498
+ {
499
+ "epoch": 1.17,
500
+ "learning_rate": 0.001,
501
+ "loss": 0.1017,
502
+ "step": 160
503
+ },
504
+ {
505
+ "epoch": 1.19,
506
+ "learning_rate": 0.001,
507
+ "loss": 0.1003,
508
+ "step": 162
509
+ },
510
+ {
511
+ "epoch": 1.2,
512
+ "learning_rate": 0.001,
513
+ "loss": 0.1055,
514
+ "step": 164
515
+ },
516
+ {
517
+ "epoch": 1.22,
518
+ "learning_rate": 0.001,
519
+ "loss": 0.105,
520
+ "step": 166
521
+ },
522
+ {
523
+ "epoch": 1.23,
524
+ "learning_rate": 0.001,
525
+ "loss": 0.1026,
526
+ "step": 168
527
+ },
528
+ {
529
+ "epoch": 1.25,
530
+ "learning_rate": 0.001,
531
+ "loss": 0.0987,
532
+ "step": 170
533
+ },
534
+ {
535
+ "epoch": 1.26,
536
+ "learning_rate": 0.001,
537
+ "loss": 0.1018,
538
+ "step": 172
539
+ },
540
+ {
541
+ "epoch": 1.28,
542
+ "learning_rate": 0.001,
543
+ "loss": 0.1062,
544
+ "step": 174
545
+ },
546
+ {
547
+ "epoch": 1.29,
548
+ "learning_rate": 0.001,
549
+ "loss": 0.1055,
550
+ "step": 176
551
+ },
552
+ {
553
+ "epoch": 1.31,
554
+ "learning_rate": 0.001,
555
+ "loss": 0.1005,
556
+ "step": 178
557
+ },
558
+ {
559
+ "epoch": 1.32,
560
+ "learning_rate": 0.001,
561
+ "loss": 0.1047,
562
+ "step": 180
563
+ },
564
+ {
565
+ "epoch": 1.33,
566
+ "learning_rate": 0.001,
567
+ "loss": 0.1065,
568
+ "step": 182
569
+ },
570
+ {
571
+ "epoch": 1.35,
572
+ "learning_rate": 0.001,
573
+ "loss": 0.1082,
574
+ "step": 184
575
+ },
576
+ {
577
+ "epoch": 1.36,
578
+ "learning_rate": 0.001,
579
+ "loss": 0.1068,
580
+ "step": 186
581
+ },
582
+ {
583
+ "epoch": 1.38,
584
+ "learning_rate": 0.001,
585
+ "loss": 0.1074,
586
+ "step": 188
587
+ },
588
+ {
589
+ "epoch": 1.39,
590
+ "learning_rate": 0.001,
591
+ "loss": 0.1077,
592
+ "step": 190
593
+ },
594
+ {
595
+ "epoch": 1.41,
596
+ "learning_rate": 0.001,
597
+ "loss": 0.1109,
598
+ "step": 192
599
+ },
600
+ {
601
+ "epoch": 1.42,
602
+ "learning_rate": 0.001,
603
+ "loss": 0.1011,
604
+ "step": 194
605
+ },
606
+ {
607
+ "epoch": 1.44,
608
+ "learning_rate": 0.001,
609
+ "loss": 0.1015,
610
+ "step": 196
611
+ },
612
+ {
613
+ "epoch": 1.45,
614
+ "learning_rate": 0.001,
615
+ "loss": 0.1015,
616
+ "step": 198
617
+ },
618
+ {
619
+ "epoch": 1.47,
620
+ "learning_rate": 0.001,
621
+ "loss": 0.1094,
622
+ "step": 200
623
+ },
624
+ {
625
+ "epoch": 1.48,
626
+ "learning_rate": 0.001,
627
+ "loss": 0.108,
628
+ "step": 202
629
+ },
630
+ {
631
+ "epoch": 1.5,
632
+ "learning_rate": 0.001,
633
+ "loss": 0.1041,
634
+ "step": 204
635
+ },
636
+ {
637
+ "epoch": 1.51,
638
+ "learning_rate": 0.001,
639
+ "loss": 0.1092,
640
+ "step": 206
641
+ },
642
+ {
643
+ "epoch": 1.53,
644
+ "learning_rate": 0.001,
645
+ "loss": 0.1085,
646
+ "step": 208
647
+ },
648
+ {
649
+ "epoch": 1.54,
650
+ "learning_rate": 0.001,
651
+ "loss": 0.1079,
652
+ "step": 210
653
+ },
654
+ {
655
+ "epoch": 1.55,
656
+ "learning_rate": 0.001,
657
+ "loss": 0.1074,
658
+ "step": 212
659
+ },
660
+ {
661
+ "epoch": 1.57,
662
+ "learning_rate": 0.001,
663
+ "loss": 0.1111,
664
+ "step": 214
665
+ },
666
+ {
667
+ "epoch": 1.58,
668
+ "learning_rate": 0.001,
669
+ "loss": 0.1153,
670
+ "step": 216
671
+ },
672
+ {
673
+ "epoch": 1.6,
674
+ "learning_rate": 0.001,
675
+ "loss": 0.1127,
676
+ "step": 218
677
+ },
678
+ {
679
+ "epoch": 1.61,
680
+ "learning_rate": 0.001,
681
+ "loss": 0.1141,
682
+ "step": 220
683
+ },
684
+ {
685
+ "epoch": 1.63,
686
+ "learning_rate": 0.001,
687
+ "loss": 0.1196,
688
+ "step": 222
689
+ },
690
+ {
691
+ "epoch": 1.64,
692
+ "learning_rate": 0.001,
693
+ "loss": 0.1138,
694
+ "step": 224
695
+ },
696
+ {
697
+ "epoch": 1.66,
698
+ "learning_rate": 0.001,
699
+ "loss": 0.1136,
700
+ "step": 226
701
+ },
702
+ {
703
+ "epoch": 1.67,
704
+ "learning_rate": 0.001,
705
+ "loss": 0.1147,
706
+ "step": 228
707
+ },
708
+ {
709
+ "epoch": 1.69,
710
+ "learning_rate": 0.001,
711
+ "loss": 0.1091,
712
+ "step": 230
713
+ },
714
+ {
715
+ "epoch": 1.7,
716
+ "learning_rate": 0.001,
717
+ "loss": 0.1104,
718
+ "step": 232
719
+ },
720
+ {
721
+ "epoch": 1.72,
722
+ "learning_rate": 0.001,
723
+ "loss": 0.1164,
724
+ "step": 234
725
+ },
726
+ {
727
+ "epoch": 1.73,
728
+ "learning_rate": 0.001,
729
+ "loss": 0.112,
730
+ "step": 236
731
+ },
732
+ {
733
+ "epoch": 1.74,
734
+ "learning_rate": 0.001,
735
+ "loss": 0.1132,
736
+ "step": 238
737
+ },
738
+ {
739
+ "epoch": 1.76,
740
+ "learning_rate": 0.001,
741
+ "loss": 0.1088,
742
+ "step": 240
743
+ },
744
+ {
745
+ "epoch": 1.77,
746
+ "learning_rate": 0.001,
747
+ "loss": 0.1126,
748
+ "step": 242
749
+ },
750
+ {
751
+ "epoch": 1.79,
752
+ "learning_rate": 0.001,
753
+ "loss": 0.112,
754
+ "step": 244
755
+ },
756
+ {
757
+ "epoch": 1.8,
758
+ "learning_rate": 0.001,
759
+ "loss": 0.1112,
760
+ "step": 246
761
+ },
762
+ {
763
+ "epoch": 1.82,
764
+ "learning_rate": 0.001,
765
+ "loss": 0.117,
766
+ "step": 248
767
+ },
768
+ {
769
+ "epoch": 1.83,
770
+ "learning_rate": 0.001,
771
+ "loss": 0.1128,
772
+ "step": 250
773
+ },
774
+ {
775
+ "epoch": 1.85,
776
+ "learning_rate": 0.001,
777
+ "loss": 0.1087,
778
+ "step": 252
779
+ },
780
+ {
781
+ "epoch": 1.86,
782
+ "learning_rate": 0.001,
783
+ "loss": 0.1149,
784
+ "step": 254
785
+ },
786
+ {
787
+ "epoch": 1.88,
788
+ "learning_rate": 0.001,
789
+ "loss": 0.1164,
790
+ "step": 256
791
+ },
792
+ {
793
+ "epoch": 1.89,
794
+ "learning_rate": 0.001,
795
+ "loss": 0.1199,
796
+ "step": 258
797
+ },
798
+ {
799
+ "epoch": 1.91,
800
+ "learning_rate": 0.001,
801
+ "loss": 0.1161,
802
+ "step": 260
803
+ },
804
+ {
805
+ "epoch": 1.92,
806
+ "learning_rate": 0.001,
807
+ "loss": 0.1136,
808
+ "step": 262
809
+ },
810
+ {
811
+ "epoch": 1.94,
812
+ "learning_rate": 0.001,
813
+ "loss": 0.111,
814
+ "step": 264
815
+ },
816
+ {
817
+ "epoch": 1.95,
818
+ "learning_rate": 0.001,
819
+ "loss": 0.1141,
820
+ "step": 266
821
+ },
822
+ {
823
+ "epoch": 1.96,
824
+ "learning_rate": 0.001,
825
+ "loss": 0.1109,
826
+ "step": 268
827
+ },
828
+ {
829
+ "epoch": 1.98,
830
+ "learning_rate": 0.001,
831
+ "loss": 0.1133,
832
+ "step": 270
833
+ },
834
+ {
835
+ "epoch": 1.99,
836
+ "learning_rate": 0.001,
837
+ "loss": 0.1186,
838
+ "step": 272
839
+ },
840
+ {
841
+ "epoch": 1.99,
842
+ "eval_gen_len": 1707.0400822199383,
843
+ "eval_loss": 3.788456678390503,
844
+ "eval_rouge1": 39.795,
845
+ "eval_rouge2": 13.2493,
846
+ "eval_rougeL": 17.3095,
847
+ "eval_rougeLsum": 37.9065,
848
+ "eval_runtime": 19648.4,
849
+ "eval_samples_per_second": 0.05,
850
+ "eval_steps_per_second": 0.006,
851
+ "step": 272
852
+ },
853
+ {
854
+ "epoch": 2.01,
855
+ "learning_rate": 0.001,
856
+ "loss": 0.0991,
857
+ "step": 274
858
+ },
859
+ {
860
+ "epoch": 2.02,
861
+ "learning_rate": 0.001,
862
+ "loss": 0.0755,
863
+ "step": 276
864
+ },
865
+ {
866
+ "epoch": 2.04,
867
+ "learning_rate": 0.001,
868
+ "loss": 0.0746,
869
+ "step": 278
870
+ },
871
+ {
872
+ "epoch": 2.05,
873
+ "learning_rate": 0.001,
874
+ "loss": 0.0766,
875
+ "step": 280
876
+ },
877
+ {
878
+ "epoch": 2.07,
879
+ "learning_rate": 0.001,
880
+ "loss": 0.0757,
881
+ "step": 282
882
+ },
883
+ {
884
+ "epoch": 2.08,
885
+ "learning_rate": 0.001,
886
+ "loss": 0.0772,
887
+ "step": 284
888
+ },
889
+ {
890
+ "epoch": 2.1,
891
+ "learning_rate": 0.001,
892
+ "loss": 0.0778,
893
+ "step": 286
894
+ },
895
+ {
896
+ "epoch": 2.11,
897
+ "learning_rate": 0.001,
898
+ "loss": 0.0788,
899
+ "step": 288
900
+ },
901
+ {
902
+ "epoch": 2.13,
903
+ "learning_rate": 0.001,
904
+ "loss": 0.0763,
905
+ "step": 290
906
+ },
907
+ {
908
+ "epoch": 2.14,
909
+ "learning_rate": 0.001,
910
+ "loss": 0.0826,
911
+ "step": 292
912
+ },
913
+ {
914
+ "epoch": 2.16,
915
+ "learning_rate": 0.001,
916
+ "loss": 0.0814,
917
+ "step": 294
918
+ },
919
+ {
920
+ "epoch": 2.17,
921
+ "learning_rate": 0.001,
922
+ "loss": 0.08,
923
+ "step": 296
924
+ },
925
+ {
926
+ "epoch": 2.18,
927
+ "learning_rate": 0.001,
928
+ "loss": 0.0799,
929
+ "step": 298
930
+ },
931
+ {
932
+ "epoch": 2.2,
933
+ "learning_rate": 0.001,
934
+ "loss": 0.0826,
935
+ "step": 300
936
+ },
937
+ {
938
+ "epoch": 2.21,
939
+ "learning_rate": 0.001,
940
+ "loss": 0.0791,
941
+ "step": 302
942
+ },
943
+ {
944
+ "epoch": 2.23,
945
+ "learning_rate": 0.001,
946
+ "loss": 0.0821,
947
+ "step": 304
948
+ },
949
+ {
950
+ "epoch": 2.24,
951
+ "learning_rate": 0.001,
952
+ "loss": 0.0846,
953
+ "step": 306
954
+ },
955
+ {
956
+ "epoch": 2.26,
957
+ "learning_rate": 0.001,
958
+ "loss": 0.081,
959
+ "step": 308
960
+ },
961
+ {
962
+ "epoch": 2.27,
963
+ "learning_rate": 0.001,
964
+ "loss": 0.0841,
965
+ "step": 310
966
+ },
967
+ {
968
+ "epoch": 2.29,
969
+ "learning_rate": 0.001,
970
+ "loss": 0.0838,
971
+ "step": 312
972
+ },
973
+ {
974
+ "epoch": 2.3,
975
+ "learning_rate": 0.001,
976
+ "loss": 0.0875,
977
+ "step": 314
978
+ },
979
+ {
980
+ "epoch": 2.32,
981
+ "learning_rate": 0.001,
982
+ "loss": 0.0871,
983
+ "step": 316
984
+ },
985
+ {
986
+ "epoch": 2.33,
987
+ "learning_rate": 0.001,
988
+ "loss": 0.0869,
989
+ "step": 318
990
+ },
991
+ {
992
+ "epoch": 2.35,
993
+ "learning_rate": 0.001,
994
+ "loss": 0.0905,
995
+ "step": 320
996
+ },
997
+ {
998
+ "epoch": 2.36,
999
+ "learning_rate": 0.001,
1000
+ "loss": 0.0947,
1001
+ "step": 322
1002
+ },
1003
+ {
1004
+ "epoch": 2.38,
1005
+ "learning_rate": 0.001,
1006
+ "loss": 0.1041,
1007
+ "step": 324
1008
+ },
1009
+ {
1010
+ "epoch": 2.39,
1011
+ "learning_rate": 0.001,
1012
+ "loss": 0.0915,
1013
+ "step": 326
1014
+ },
1015
+ {
1016
+ "epoch": 2.4,
1017
+ "learning_rate": 0.001,
1018
+ "loss": 0.0869,
1019
+ "step": 328
1020
+ },
1021
+ {
1022
+ "epoch": 2.42,
1023
+ "learning_rate": 0.001,
1024
+ "loss": 0.0854,
1025
+ "step": 330
1026
+ },
1027
+ {
1028
+ "epoch": 2.43,
1029
+ "learning_rate": 0.001,
1030
+ "loss": 0.0925,
1031
+ "step": 332
1032
+ },
1033
+ {
1034
+ "epoch": 2.45,
1035
+ "learning_rate": 0.001,
1036
+ "loss": 0.0961,
1037
+ "step": 334
1038
+ },
1039
+ {
1040
+ "epoch": 2.46,
1041
+ "learning_rate": 0.001,
1042
+ "loss": 0.0922,
1043
+ "step": 336
1044
+ },
1045
+ {
1046
+ "epoch": 2.48,
1047
+ "learning_rate": 0.001,
1048
+ "loss": 0.0847,
1049
+ "step": 338
1050
+ },
1051
+ {
1052
+ "epoch": 2.49,
1053
+ "learning_rate": 0.001,
1054
+ "loss": 0.0906,
1055
+ "step": 340
1056
+ },
1057
+ {
1058
+ "epoch": 2.51,
1059
+ "learning_rate": 0.001,
1060
+ "loss": 0.0891,
1061
+ "step": 342
1062
+ },
1063
+ {
1064
+ "epoch": 2.52,
1065
+ "learning_rate": 0.001,
1066
+ "loss": 0.0916,
1067
+ "step": 344
1068
+ },
1069
+ {
1070
+ "epoch": 2.54,
1071
+ "learning_rate": 0.001,
1072
+ "loss": 0.0907,
1073
+ "step": 346
1074
+ },
1075
+ {
1076
+ "epoch": 2.55,
1077
+ "learning_rate": 0.001,
1078
+ "loss": 0.0912,
1079
+ "step": 348
1080
+ },
1081
+ {
1082
+ "epoch": 2.57,
1083
+ "learning_rate": 0.001,
1084
+ "loss": 0.0857,
1085
+ "step": 350
1086
+ },
1087
+ {
1088
+ "epoch": 2.58,
1089
+ "learning_rate": 0.001,
1090
+ "loss": 0.0864,
1091
+ "step": 352
1092
+ },
1093
+ {
1094
+ "epoch": 2.6,
1095
+ "learning_rate": 0.001,
1096
+ "loss": 0.087,
1097
+ "step": 354
1098
+ },
1099
+ {
1100
+ "epoch": 2.61,
1101
+ "learning_rate": 0.001,
1102
+ "loss": 0.0957,
1103
+ "step": 356
1104
+ },
1105
+ {
1106
+ "epoch": 2.62,
1107
+ "learning_rate": 0.001,
1108
+ "loss": 0.089,
1109
+ "step": 358
1110
+ },
1111
+ {
1112
+ "epoch": 2.64,
1113
+ "learning_rate": 0.001,
1114
+ "loss": 0.0939,
1115
+ "step": 360
1116
+ },
1117
+ {
1118
+ "epoch": 2.65,
1119
+ "learning_rate": 0.001,
1120
+ "loss": 0.0891,
1121
+ "step": 362
1122
+ },
1123
+ {
1124
+ "epoch": 2.67,
1125
+ "learning_rate": 0.001,
1126
+ "loss": 0.0912,
1127
+ "step": 364
1128
+ },
1129
+ {
1130
+ "epoch": 2.68,
1131
+ "learning_rate": 0.001,
1132
+ "loss": 0.0932,
1133
+ "step": 366
1134
+ },
1135
+ {
1136
+ "epoch": 2.7,
1137
+ "learning_rate": 0.001,
1138
+ "loss": 0.0932,
1139
+ "step": 368
1140
+ },
1141
+ {
1142
+ "epoch": 2.71,
1143
+ "learning_rate": 0.001,
1144
+ "loss": 0.0923,
1145
+ "step": 370
1146
+ },
1147
+ {
1148
+ "epoch": 2.73,
1149
+ "learning_rate": 0.001,
1150
+ "loss": 0.0933,
1151
+ "step": 372
1152
+ },
1153
+ {
1154
+ "epoch": 2.74,
1155
+ "learning_rate": 0.001,
1156
+ "loss": 0.096,
1157
+ "step": 374
1158
+ },
1159
+ {
1160
+ "epoch": 2.76,
1161
+ "learning_rate": 0.001,
1162
+ "loss": 0.0923,
1163
+ "step": 376
1164
+ },
1165
+ {
1166
+ "epoch": 2.77,
1167
+ "learning_rate": 0.001,
1168
+ "loss": 0.0918,
1169
+ "step": 378
1170
+ },
1171
+ {
1172
+ "epoch": 2.79,
1173
+ "learning_rate": 0.001,
1174
+ "loss": 0.091,
1175
+ "step": 380
1176
+ },
1177
+ {
1178
+ "epoch": 2.8,
1179
+ "learning_rate": 0.001,
1180
+ "loss": 0.09,
1181
+ "step": 382
1182
+ },
1183
+ {
1184
+ "epoch": 2.82,
1185
+ "learning_rate": 0.001,
1186
+ "loss": 0.0894,
1187
+ "step": 384
1188
+ },
1189
+ {
1190
+ "epoch": 2.83,
1191
+ "learning_rate": 0.001,
1192
+ "loss": 0.0962,
1193
+ "step": 386
1194
+ },
1195
+ {
1196
+ "epoch": 2.84,
1197
+ "learning_rate": 0.001,
1198
+ "loss": 0.0923,
1199
+ "step": 388
1200
+ },
1201
+ {
1202
+ "epoch": 2.86,
1203
+ "learning_rate": 0.001,
1204
+ "loss": 0.0942,
1205
+ "step": 390
1206
+ },
1207
+ {
1208
+ "epoch": 2.87,
1209
+ "learning_rate": 0.001,
1210
+ "loss": 0.0999,
1211
+ "step": 392
1212
+ },
1213
+ {
1214
+ "epoch": 2.89,
1215
+ "learning_rate": 0.001,
1216
+ "loss": 0.0972,
1217
+ "step": 394
1218
+ },
1219
+ {
1220
+ "epoch": 2.9,
1221
+ "learning_rate": 0.001,
1222
+ "loss": 0.1022,
1223
+ "step": 396
1224
+ },
1225
+ {
1226
+ "epoch": 2.92,
1227
+ "learning_rate": 0.001,
1228
+ "loss": 0.0962,
1229
+ "step": 398
1230
+ },
1231
+ {
1232
+ "epoch": 2.93,
1233
+ "learning_rate": 0.001,
1234
+ "loss": 0.0917,
1235
+ "step": 400
1236
+ },
1237
+ {
1238
+ "epoch": 2.95,
1239
+ "learning_rate": 0.001,
1240
+ "loss": 0.0978,
1241
+ "step": 402
1242
+ },
1243
+ {
1244
+ "epoch": 2.96,
1245
+ "learning_rate": 0.001,
1246
+ "loss": 0.0909,
1247
+ "step": 404
1248
+ },
1249
+ {
1250
+ "epoch": 2.98,
1251
+ "learning_rate": 0.001,
1252
+ "loss": 0.0948,
1253
+ "step": 406
1254
+ },
1255
+ {
1256
+ "epoch": 2.99,
1257
+ "learning_rate": 0.001,
1258
+ "loss": 0.097,
1259
+ "step": 408
1260
+ },
1261
+ {
1262
+ "epoch": 3.0,
1263
+ "eval_gen_len": 1442.7728674203495,
1264
+ "eval_loss": 4.019211769104004,
1265
+ "eval_rouge1": 41.4441,
1266
+ "eval_rouge2": 13.4026,
1267
+ "eval_rougeL": 17.8804,
1268
+ "eval_rougeLsum": 39.4502,
1269
+ "eval_runtime": 18768.077,
1270
+ "eval_samples_per_second": 0.052,
1271
+ "eval_steps_per_second": 0.007,
1272
+ "step": 409
1273
+ },
1274
+ {
1275
+ "epoch": 3.01,
1276
+ "learning_rate": 0.001,
1277
+ "loss": 0.0843,
1278
+ "step": 410
1279
+ },
1280
+ {
1281
+ "epoch": 3.02,
1282
+ "learning_rate": 0.001,
1283
+ "loss": 0.0682,
1284
+ "step": 412
1285
+ },
1286
+ {
1287
+ "epoch": 3.04,
1288
+ "learning_rate": 0.001,
1289
+ "loss": 0.0673,
1290
+ "step": 414
1291
+ },
1292
+ {
1293
+ "epoch": 3.05,
1294
+ "learning_rate": 0.001,
1295
+ "loss": 0.0644,
1296
+ "step": 416
1297
+ },
1298
+ {
1299
+ "epoch": 3.06,
1300
+ "learning_rate": 0.001,
1301
+ "loss": 0.0659,
1302
+ "step": 418
1303
+ },
1304
+ {
1305
+ "epoch": 3.08,
1306
+ "learning_rate": 0.001,
1307
+ "loss": 0.0675,
1308
+ "step": 420
1309
+ },
1310
+ {
1311
+ "epoch": 3.09,
1312
+ "learning_rate": 0.001,
1313
+ "loss": 0.0648,
1314
+ "step": 422
1315
+ },
1316
+ {
1317
+ "epoch": 3.11,
1318
+ "learning_rate": 0.001,
1319
+ "loss": 0.0664,
1320
+ "step": 424
1321
+ },
1322
+ {
1323
+ "epoch": 3.12,
1324
+ "learning_rate": 0.001,
1325
+ "loss": 0.0714,
1326
+ "step": 426
1327
+ },
1328
+ {
1329
+ "epoch": 3.14,
1330
+ "learning_rate": 0.001,
1331
+ "loss": 0.0703,
1332
+ "step": 428
1333
+ },
1334
+ {
1335
+ "epoch": 3.15,
1336
+ "learning_rate": 0.001,
1337
+ "loss": 0.068,
1338
+ "step": 430
1339
+ },
1340
+ {
1341
+ "epoch": 3.17,
1342
+ "learning_rate": 0.001,
1343
+ "loss": 0.0683,
1344
+ "step": 432
1345
+ },
1346
+ {
1347
+ "epoch": 3.18,
1348
+ "learning_rate": 0.001,
1349
+ "loss": 0.0676,
1350
+ "step": 434
1351
+ },
1352
+ {
1353
+ "epoch": 3.2,
1354
+ "learning_rate": 0.001,
1355
+ "loss": 0.0703,
1356
+ "step": 436
1357
+ },
1358
+ {
1359
+ "epoch": 3.21,
1360
+ "learning_rate": 0.001,
1361
+ "loss": 0.0726,
1362
+ "step": 438
1363
+ },
1364
+ {
1365
+ "epoch": 3.23,
1366
+ "learning_rate": 0.001,
1367
+ "loss": 0.0712,
1368
+ "step": 440
1369
+ },
1370
+ {
1371
+ "epoch": 3.24,
1372
+ "learning_rate": 0.001,
1373
+ "loss": 0.0706,
1374
+ "step": 442
1375
+ },
1376
+ {
1377
+ "epoch": 3.26,
1378
+ "learning_rate": 0.001,
1379
+ "loss": 0.0736,
1380
+ "step": 444
1381
+ },
1382
+ {
1383
+ "epoch": 3.27,
1384
+ "learning_rate": 0.001,
1385
+ "loss": 0.0698,
1386
+ "step": 446
1387
+ },
1388
+ {
1389
+ "epoch": 3.28,
1390
+ "learning_rate": 0.001,
1391
+ "loss": 0.0753,
1392
+ "step": 448
1393
+ },
1394
+ {
1395
+ "epoch": 3.3,
1396
+ "learning_rate": 0.001,
1397
+ "loss": 0.0768,
1398
+ "step": 450
1399
+ },
1400
+ {
1401
+ "epoch": 3.31,
1402
+ "learning_rate": 0.001,
1403
+ "loss": 0.0764,
1404
+ "step": 452
1405
+ },
1406
+ {
1407
+ "epoch": 3.33,
1408
+ "learning_rate": 0.001,
1409
+ "loss": 0.0748,
1410
+ "step": 454
1411
+ },
1412
+ {
1413
+ "epoch": 3.34,
1414
+ "learning_rate": 0.001,
1415
+ "loss": 0.0721,
1416
+ "step": 456
1417
+ },
1418
+ {
1419
+ "epoch": 3.36,
1420
+ "learning_rate": 0.001,
1421
+ "loss": 0.0737,
1422
+ "step": 458
1423
+ },
1424
+ {
1425
+ "epoch": 3.37,
1426
+ "learning_rate": 0.001,
1427
+ "loss": 0.0717,
1428
+ "step": 460
1429
+ },
1430
+ {
1431
+ "epoch": 3.39,
1432
+ "learning_rate": 0.001,
1433
+ "loss": 0.0729,
1434
+ "step": 462
1435
+ },
1436
+ {
1437
+ "epoch": 3.4,
1438
+ "learning_rate": 0.001,
1439
+ "loss": 0.0722,
1440
+ "step": 464
1441
+ },
1442
+ {
1443
+ "epoch": 3.42,
1444
+ "learning_rate": 0.001,
1445
+ "loss": 0.0745,
1446
+ "step": 466
1447
+ },
1448
+ {
1449
+ "epoch": 3.43,
1450
+ "learning_rate": 0.001,
1451
+ "loss": 0.0779,
1452
+ "step": 468
1453
+ },
1454
+ {
1455
+ "epoch": 3.45,
1456
+ "learning_rate": 0.001,
1457
+ "loss": 0.0793,
1458
+ "step": 470
1459
+ },
1460
+ {
1461
+ "epoch": 3.46,
1462
+ "learning_rate": 0.001,
1463
+ "loss": 0.0836,
1464
+ "step": 472
1465
+ },
1466
+ {
1467
+ "epoch": 3.48,
1468
+ "learning_rate": 0.001,
1469
+ "loss": 0.0796,
1470
+ "step": 474
1471
+ },
1472
+ {
1473
+ "epoch": 3.49,
1474
+ "learning_rate": 0.001,
1475
+ "loss": 0.0806,
1476
+ "step": 476
1477
+ },
1478
+ {
1479
+ "epoch": 3.5,
1480
+ "learning_rate": 0.001,
1481
+ "loss": 0.0768,
1482
+ "step": 478
1483
+ },
1484
+ {
1485
+ "epoch": 3.52,
1486
+ "learning_rate": 0.001,
1487
+ "loss": 0.0765,
1488
+ "step": 480
1489
+ },
1490
+ {
1491
+ "epoch": 3.53,
1492
+ "learning_rate": 0.001,
1493
+ "loss": 0.0757,
1494
+ "step": 482
1495
+ },
1496
+ {
1497
+ "epoch": 3.55,
1498
+ "learning_rate": 0.001,
1499
+ "loss": 0.075,
1500
+ "step": 484
1501
+ },
1502
+ {
1503
+ "epoch": 3.56,
1504
+ "learning_rate": 0.001,
1505
+ "loss": 0.0735,
1506
+ "step": 486
1507
+ },
1508
+ {
1509
+ "epoch": 3.58,
1510
+ "learning_rate": 0.001,
1511
+ "loss": 0.0802,
1512
+ "step": 488
1513
+ },
1514
+ {
1515
+ "epoch": 3.59,
1516
+ "learning_rate": 0.001,
1517
+ "loss": 0.0768,
1518
+ "step": 490
1519
+ },
1520
+ {
1521
+ "epoch": 3.61,
1522
+ "learning_rate": 0.001,
1523
+ "loss": 0.0789,
1524
+ "step": 492
1525
+ },
1526
+ {
1527
+ "epoch": 3.62,
1528
+ "learning_rate": 0.001,
1529
+ "loss": 0.0801,
1530
+ "step": 494
1531
+ },
1532
+ {
1533
+ "epoch": 3.64,
1534
+ "learning_rate": 0.001,
1535
+ "loss": 0.0818,
1536
+ "step": 496
1537
+ },
1538
+ {
1539
+ "epoch": 3.65,
1540
+ "learning_rate": 0.001,
1541
+ "loss": 0.0838,
1542
+ "step": 498
1543
+ },
1544
+ {
1545
+ "epoch": 3.67,
1546
+ "learning_rate": 0.001,
1547
+ "loss": 0.0821,
1548
+ "step": 500
1549
+ },
1550
+ {
1551
+ "epoch": 3.68,
1552
+ "learning_rate": 0.001,
1553
+ "loss": 0.0831,
1554
+ "step": 502
1555
+ },
1556
+ {
1557
+ "epoch": 3.7,
1558
+ "learning_rate": 0.001,
1559
+ "loss": 0.0805,
1560
+ "step": 504
1561
+ },
1562
+ {
1563
+ "epoch": 3.71,
1564
+ "learning_rate": 0.001,
1565
+ "loss": 0.0793,
1566
+ "step": 506
1567
+ },
1568
+ {
1569
+ "epoch": 3.72,
1570
+ "learning_rate": 0.001,
1571
+ "loss": 0.0826,
1572
+ "step": 508
1573
+ },
1574
+ {
1575
+ "epoch": 3.74,
1576
+ "learning_rate": 0.001,
1577
+ "loss": 0.0825,
1578
+ "step": 510
1579
+ },
1580
+ {
1581
+ "epoch": 3.75,
1582
+ "learning_rate": 0.001,
1583
+ "loss": 0.0847,
1584
+ "step": 512
1585
+ },
1586
+ {
1587
+ "epoch": 3.77,
1588
+ "learning_rate": 0.001,
1589
+ "loss": 0.0862,
1590
+ "step": 514
1591
+ },
1592
+ {
1593
+ "epoch": 3.78,
1594
+ "learning_rate": 0.001,
1595
+ "loss": 0.0827,
1596
+ "step": 516
1597
+ },
1598
+ {
1599
+ "epoch": 3.8,
1600
+ "learning_rate": 0.001,
1601
+ "loss": 0.084,
1602
+ "step": 518
1603
+ },
1604
+ {
1605
+ "epoch": 3.81,
1606
+ "learning_rate": 0.001,
1607
+ "loss": 0.0854,
1608
+ "step": 520
1609
+ },
1610
+ {
1611
+ "epoch": 3.83,
1612
+ "learning_rate": 0.001,
1613
+ "loss": 0.0843,
1614
+ "step": 522
1615
+ },
1616
+ {
1617
+ "epoch": 3.84,
1618
+ "learning_rate": 0.001,
1619
+ "loss": 0.0817,
1620
+ "step": 524
1621
+ },
1622
+ {
1623
+ "epoch": 3.86,
1624
+ "learning_rate": 0.001,
1625
+ "loss": 0.081,
1626
+ "step": 526
1627
+ },
1628
+ {
1629
+ "epoch": 3.87,
1630
+ "learning_rate": 0.001,
1631
+ "loss": 0.0842,
1632
+ "step": 528
1633
+ },
1634
+ {
1635
+ "epoch": 3.89,
1636
+ "learning_rate": 0.001,
1637
+ "loss": 0.0798,
1638
+ "step": 530
1639
+ },
1640
+ {
1641
+ "epoch": 3.9,
1642
+ "learning_rate": 0.001,
1643
+ "loss": 0.0864,
1644
+ "step": 532
1645
+ },
1646
+ {
1647
+ "epoch": 3.92,
1648
+ "learning_rate": 0.001,
1649
+ "loss": 0.0856,
1650
+ "step": 534
1651
+ },
1652
+ {
1653
+ "epoch": 3.93,
1654
+ "learning_rate": 0.001,
1655
+ "loss": 0.0831,
1656
+ "step": 536
1657
+ },
1658
+ {
1659
+ "epoch": 3.94,
1660
+ "learning_rate": 0.001,
1661
+ "loss": 0.0844,
1662
+ "step": 538
1663
+ },
1664
+ {
1665
+ "epoch": 3.96,
1666
+ "learning_rate": 0.001,
1667
+ "loss": 0.0848,
1668
+ "step": 540
1669
+ },
1670
+ {
1671
+ "epoch": 3.97,
1672
+ "learning_rate": 0.001,
1673
+ "loss": 0.0862,
1674
+ "step": 542
1675
+ },
1676
+ {
1677
+ "epoch": 3.99,
1678
+ "learning_rate": 0.001,
1679
+ "loss": 0.0818,
1680
+ "step": 544
1681
+ },
1682
+ {
1683
+ "epoch": 4.0,
1684
+ "eval_gen_len": 1741.0236382322714,
1685
+ "eval_loss": 4.169858932495117,
1686
+ "eval_rouge1": 40.2374,
1687
+ "eval_rouge2": 13.5869,
1688
+ "eval_rougeL": 17.364,
1689
+ "eval_rougeLsum": 38.2969,
1690
+ "eval_runtime": 19669.3949,
1691
+ "eval_samples_per_second": 0.049,
1692
+ "eval_steps_per_second": 0.006,
1693
+ "step": 545
1694
+ },
1695
+ {
1696
+ "epoch": 4.0,
1697
+ "learning_rate": 0.001,
1698
+ "loss": 0.0813,
1699
+ "step": 546
1700
+ },
1701
+ {
1702
+ "epoch": 4.02,
1703
+ "learning_rate": 0.001,
1704
+ "loss": 0.06,
1705
+ "step": 548
1706
+ },
1707
+ {
1708
+ "epoch": 4.03,
1709
+ "learning_rate": 0.001,
1710
+ "loss": 0.0593,
1711
+ "step": 550
1712
+ },
1713
+ {
1714
+ "epoch": 4.05,
1715
+ "learning_rate": 0.001,
1716
+ "loss": 0.0568,
1717
+ "step": 552
1718
+ },
1719
+ {
1720
+ "epoch": 4.06,
1721
+ "learning_rate": 0.001,
1722
+ "loss": 0.0591,
1723
+ "step": 554
1724
+ },
1725
+ {
1726
+ "epoch": 4.08,
1727
+ "learning_rate": 0.001,
1728
+ "loss": 0.0603,
1729
+ "step": 556
1730
+ },
1731
+ {
1732
+ "epoch": 4.09,
1733
+ "learning_rate": 0.001,
1734
+ "loss": 0.062,
1735
+ "step": 558
1736
+ },
1737
+ {
1738
+ "epoch": 4.11,
1739
+ "learning_rate": 0.001,
1740
+ "loss": 0.0613,
1741
+ "step": 560
1742
+ },
1743
+ {
1744
+ "epoch": 4.12,
1745
+ "learning_rate": 0.001,
1746
+ "loss": 0.0623,
1747
+ "step": 562
1748
+ },
1749
+ {
1750
+ "epoch": 4.14,
1751
+ "learning_rate": 0.001,
1752
+ "loss": 0.0625,
1753
+ "step": 564
1754
+ },
1755
+ {
1756
+ "epoch": 4.15,
1757
+ "learning_rate": 0.001,
1758
+ "loss": 0.0631,
1759
+ "step": 566
1760
+ },
1761
+ {
1762
+ "epoch": 4.16,
1763
+ "learning_rate": 0.001,
1764
+ "loss": 0.0605,
1765
+ "step": 568
1766
+ },
1767
+ {
1768
+ "epoch": 4.18,
1769
+ "learning_rate": 0.001,
1770
+ "loss": 0.0609,
1771
+ "step": 570
1772
+ },
1773
+ {
1774
+ "epoch": 4.19,
1775
+ "learning_rate": 0.001,
1776
+ "loss": 0.0623,
1777
+ "step": 572
1778
+ },
1779
+ {
1780
+ "epoch": 4.21,
1781
+ "learning_rate": 0.001,
1782
+ "loss": 0.0631,
1783
+ "step": 574
1784
+ },
1785
+ {
1786
+ "epoch": 4.22,
1787
+ "learning_rate": 0.001,
1788
+ "loss": 0.0618,
1789
+ "step": 576
1790
+ },
1791
+ {
1792
+ "epoch": 4.24,
1793
+ "learning_rate": 0.001,
1794
+ "loss": 0.0634,
1795
+ "step": 578
1796
+ },
1797
+ {
1798
+ "epoch": 4.25,
1799
+ "learning_rate": 0.001,
1800
+ "loss": 0.0623,
1801
+ "step": 580
1802
+ },
1803
+ {
1804
+ "epoch": 4.27,
1805
+ "learning_rate": 0.001,
1806
+ "loss": 0.0618,
1807
+ "step": 582
1808
+ },
1809
+ {
1810
+ "epoch": 4.28,
1811
+ "learning_rate": 0.001,
1812
+ "loss": 0.0651,
1813
+ "step": 584
1814
+ },
1815
+ {
1816
+ "epoch": 4.3,
1817
+ "learning_rate": 0.001,
1818
+ "loss": 0.064,
1819
+ "step": 586
1820
+ },
1821
+ {
1822
+ "epoch": 4.31,
1823
+ "learning_rate": 0.001,
1824
+ "loss": 0.0666,
1825
+ "step": 588
1826
+ },
1827
+ {
1828
+ "epoch": 4.33,
1829
+ "learning_rate": 0.001,
1830
+ "loss": 0.0644,
1831
+ "step": 590
1832
+ },
1833
+ {
1834
+ "epoch": 4.34,
1835
+ "learning_rate": 0.001,
1836
+ "loss": 0.0678,
1837
+ "step": 592
1838
+ },
1839
+ {
1840
+ "epoch": 4.36,
1841
+ "learning_rate": 0.001,
1842
+ "loss": 0.0675,
1843
+ "step": 594
1844
+ },
1845
+ {
1846
+ "epoch": 4.37,
1847
+ "learning_rate": 0.001,
1848
+ "loss": 0.0635,
1849
+ "step": 596
1850
+ },
1851
+ {
1852
+ "epoch": 4.38,
1853
+ "learning_rate": 0.001,
1854
+ "loss": 0.0669,
1855
+ "step": 598
1856
+ },
1857
+ {
1858
+ "epoch": 4.4,
1859
+ "learning_rate": 0.001,
1860
+ "loss": 0.0644,
1861
+ "step": 600
1862
+ },
1863
+ {
1864
+ "epoch": 4.41,
1865
+ "learning_rate": 0.001,
1866
+ "loss": 0.0671,
1867
+ "step": 602
1868
+ },
1869
+ {
1870
+ "epoch": 4.43,
1871
+ "learning_rate": 0.001,
1872
+ "loss": 0.0646,
1873
+ "step": 604
1874
+ },
1875
+ {
1876
+ "epoch": 4.44,
1877
+ "learning_rate": 0.001,
1878
+ "loss": 0.067,
1879
+ "step": 606
1880
+ },
1881
+ {
1882
+ "epoch": 4.46,
1883
+ "learning_rate": 0.001,
1884
+ "loss": 0.0663,
1885
+ "step": 608
1886
+ },
1887
+ {
1888
+ "epoch": 4.47,
1889
+ "learning_rate": 0.001,
1890
+ "loss": 0.0664,
1891
+ "step": 610
1892
+ },
1893
+ {
1894
+ "epoch": 4.49,
1895
+ "learning_rate": 0.001,
1896
+ "loss": 0.0697,
1897
+ "step": 612
1898
+ },
1899
+ {
1900
+ "epoch": 4.5,
1901
+ "learning_rate": 0.001,
1902
+ "loss": 0.0671,
1903
+ "step": 614
1904
+ },
1905
+ {
1906
+ "epoch": 4.52,
1907
+ "learning_rate": 0.001,
1908
+ "loss": 0.0701,
1909
+ "step": 616
1910
+ },
1911
+ {
1912
+ "epoch": 4.53,
1913
+ "learning_rate": 0.001,
1914
+ "loss": 0.0745,
1915
+ "step": 618
1916
+ },
1917
+ {
1918
+ "epoch": 4.55,
1919
+ "learning_rate": 0.001,
1920
+ "loss": 0.076,
1921
+ "step": 620
1922
+ },
1923
+ {
1924
+ "epoch": 4.56,
1925
+ "learning_rate": 0.001,
1926
+ "loss": 0.0692,
1927
+ "step": 622
1928
+ },
1929
+ {
1930
+ "epoch": 4.58,
1931
+ "learning_rate": 0.001,
1932
+ "loss": 0.071,
1933
+ "step": 624
1934
+ },
1935
+ {
1936
+ "epoch": 4.59,
1937
+ "learning_rate": 0.001,
1938
+ "loss": 0.0718,
1939
+ "step": 626
1940
+ },
1941
+ {
1942
+ "epoch": 4.6,
1943
+ "learning_rate": 0.001,
1944
+ "loss": 0.0731,
1945
+ "step": 628
1946
+ },
1947
+ {
1948
+ "epoch": 4.62,
1949
+ "learning_rate": 0.001,
1950
+ "loss": 0.078,
1951
+ "step": 630
1952
+ },
1953
+ {
1954
+ "epoch": 4.63,
1955
+ "learning_rate": 0.001,
1956
+ "loss": 0.0747,
1957
+ "step": 632
1958
+ },
1959
+ {
1960
+ "epoch": 4.65,
1961
+ "learning_rate": 0.001,
1962
+ "loss": 0.0787,
1963
+ "step": 634
1964
+ },
1965
+ {
1966
+ "epoch": 4.66,
1967
+ "learning_rate": 0.001,
1968
+ "loss": 0.073,
1969
+ "step": 636
1970
+ },
1971
+ {
1972
+ "epoch": 4.68,
1973
+ "learning_rate": 0.001,
1974
+ "loss": 0.0689,
1975
+ "step": 638
1976
+ },
1977
+ {
1978
+ "epoch": 4.69,
1979
+ "learning_rate": 0.001,
1980
+ "loss": 0.0722,
1981
+ "step": 640
1982
+ },
1983
+ {
1984
+ "epoch": 4.71,
1985
+ "learning_rate": 0.001,
1986
+ "loss": 0.0754,
1987
+ "step": 642
1988
+ },
1989
+ {
1990
+ "epoch": 4.72,
1991
+ "learning_rate": 0.001,
1992
+ "loss": 0.073,
1993
+ "step": 644
1994
+ },
1995
+ {
1996
+ "epoch": 4.74,
1997
+ "learning_rate": 0.001,
1998
+ "loss": 0.076,
1999
+ "step": 646
2000
+ },
2001
+ {
2002
+ "epoch": 4.75,
2003
+ "learning_rate": 0.001,
2004
+ "loss": 0.0704,
2005
+ "step": 648
2006
+ },
2007
+ {
2008
+ "epoch": 4.77,
2009
+ "learning_rate": 0.001,
2010
+ "loss": 0.0707,
2011
+ "step": 650
2012
+ },
2013
+ {
2014
+ "epoch": 4.78,
2015
+ "learning_rate": 0.001,
2016
+ "loss": 0.0707,
2017
+ "step": 652
2018
+ },
2019
+ {
2020
+ "epoch": 4.8,
2021
+ "learning_rate": 0.001,
2022
+ "loss": 0.071,
2023
+ "step": 654
2024
+ },
2025
+ {
2026
+ "epoch": 4.81,
2027
+ "learning_rate": 0.001,
2028
+ "loss": 0.0715,
2029
+ "step": 656
2030
+ },
2031
+ {
2032
+ "epoch": 4.82,
2033
+ "learning_rate": 0.001,
2034
+ "loss": 0.0714,
2035
+ "step": 658
2036
+ },
2037
+ {
2038
+ "epoch": 4.84,
2039
+ "learning_rate": 0.001,
2040
+ "loss": 0.0706,
2041
+ "step": 660
2042
+ },
2043
+ {
2044
+ "epoch": 4.85,
2045
+ "learning_rate": 0.001,
2046
+ "loss": 0.0718,
2047
+ "step": 662
2048
+ },
2049
+ {
2050
+ "epoch": 4.87,
2051
+ "learning_rate": 0.001,
2052
+ "loss": 0.0712,
2053
+ "step": 664
2054
+ },
2055
+ {
2056
+ "epoch": 4.88,
2057
+ "learning_rate": 0.001,
2058
+ "loss": 0.0737,
2059
+ "step": 666
2060
+ },
2061
+ {
2062
+ "epoch": 4.9,
2063
+ "learning_rate": 0.001,
2064
+ "loss": 0.0764,
2065
+ "step": 668
2066
+ },
2067
+ {
2068
+ "epoch": 4.91,
2069
+ "learning_rate": 0.001,
2070
+ "loss": 0.0766,
2071
+ "step": 670
2072
+ },
2073
+ {
2074
+ "epoch": 4.93,
2075
+ "learning_rate": 0.001,
2076
+ "loss": 0.0748,
2077
+ "step": 672
2078
+ },
2079
+ {
2080
+ "epoch": 4.94,
2081
+ "learning_rate": 0.001,
2082
+ "loss": 0.0798,
2083
+ "step": 674
2084
+ },
2085
+ {
2086
+ "epoch": 4.96,
2087
+ "learning_rate": 0.001,
2088
+ "loss": 0.079,
2089
+ "step": 676
2090
+ },
2091
+ {
2092
+ "epoch": 4.97,
2093
+ "learning_rate": 0.001,
2094
+ "loss": 0.0765,
2095
+ "step": 678
2096
+ },
2097
+ {
2098
+ "epoch": 4.99,
2099
+ "learning_rate": 0.001,
2100
+ "loss": 0.0786,
2101
+ "step": 680
2102
+ },
2103
+ {
2104
+ "epoch": 4.99,
2105
+ "eval_gen_len": 1710.4110996916752,
2106
+ "eval_loss": 4.333888530731201,
2107
+ "eval_rouge1": 39.5612,
2108
+ "eval_rouge2": 13.4283,
2109
+ "eval_rougeL": 17.3666,
2110
+ "eval_rougeLsum": 37.6526,
2111
+ "eval_runtime": 19644.4491,
2112
+ "eval_samples_per_second": 0.05,
2113
+ "eval_steps_per_second": 0.006,
2114
+ "step": 680
2115
+ },
2116
+ {
2117
+ "epoch": 4.99,
2118
+ "step": 680,
2119
+ "total_flos": 1.2370900624117678e+18,
2120
+ "train_loss": 0.10004215405925232,
2121
+ "train_runtime": 141879.0284,
2122
+ "train_samples_per_second": 0.615,
2123
+ "train_steps_per_second": 0.005
2124
+ }
2125
+ ],
2126
+ "logging_steps": 2,
2127
+ "max_steps": 680,
2128
+ "num_train_epochs": 5,
2129
+ "save_steps": 500,
2130
+ "total_flos": 1.2370900624117678e+18,
2131
+ "trial_name": null,
2132
+ "trial_params": null
2133
+ }