learn3r commited on
Commit
1b92866
1 Parent(s): 1865434

End of training

Browse files
Files changed (5) hide show
  1. README.md +13 -13
  2. all_results.json +18 -0
  3. eval_results.json +13 -0
  4. train_results.json +8 -0
  5. trainer_state.json +2133 -0
README.md CHANGED
@@ -4,25 +4,25 @@ base_model: google/long-t5-tglobal-xl
4
  tags:
5
  - generated_from_trainer
6
  datasets:
7
- - scrolls
8
  metrics:
9
  - rouge
10
  model-index:
11
  - name: longt5_xl_gov_5
12
  results:
13
  - task:
14
- name: Sequence-to-sequence Language Modeling
15
- type: text2text-generation
16
  dataset:
17
- name: scrolls
18
- type: scrolls
19
  config: gov_report
20
  split: validation
21
  args: gov_report
22
  metrics:
23
  - name: Rouge1
24
  type: rouge
25
- value: 55.9961
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -30,14 +30,14 @@ should probably proofread and complete it, then remove this comment. -->
30
 
31
  # longt5_xl_gov_5
32
 
33
- This model is a fine-tuned version of [google/long-t5-tglobal-xl](https://huggingface.co/google/long-t5-tglobal-xl) on the scrolls dataset.
34
  It achieves the following results on the evaluation set:
35
- - Loss: 1.4569
36
- - Rouge1: 55.9961
37
- - Rouge2: 26.2205
38
- - Rougel: 29.0409
39
- - Rougelsum: 53.3109
40
- - Gen Len: 883.0463
41
 
42
  ## Model description
43
 
 
4
  tags:
5
  - generated_from_trainer
6
  datasets:
7
+ - tau/scrolls
8
  metrics:
9
  - rouge
10
  model-index:
11
  - name: longt5_xl_gov_5
12
  results:
13
  - task:
14
+ name: Summarization
15
+ type: summarization
16
  dataset:
17
+ name: tau/scrolls gov_report
18
+ type: tau/scrolls
19
  config: gov_report
20
  split: validation
21
  args: gov_report
22
  metrics:
23
  - name: Rouge1
24
  type: rouge
25
+ value: 54.2522
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
30
 
31
  # longt5_xl_gov_5
32
 
33
+ This model is a fine-tuned version of [google/long-t5-tglobal-xl](https://huggingface.co/google/long-t5-tglobal-xl) on the tau/scrolls gov_report dataset.
34
  It achieves the following results on the evaluation set:
35
+ - Loss: 1.4141
36
+ - Rouge1: 54.2522
37
+ - Rouge2: 24.7528
38
+ - Rougel: 27.2444
39
+ - Rougelsum: 51.5916
40
+ - Gen Len: 889.25
41
 
42
  ## Model description
43
 
all_results.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 4.99,
3
+ "eval_gen_len": 889.25,
4
+ "eval_loss": 1.4141343832015991,
5
+ "eval_rouge1": 54.2522,
6
+ "eval_rouge2": 24.7528,
7
+ "eval_rougeL": 27.2444,
8
+ "eval_rougeLsum": 51.5916,
9
+ "eval_runtime": 9829.8875,
10
+ "eval_samples": 972,
11
+ "eval_samples_per_second": 0.099,
12
+ "eval_steps_per_second": 0.012,
13
+ "train_loss": 1.3253671477822697,
14
+ "train_runtime": 159961.9679,
15
+ "train_samples": 17457,
16
+ "train_samples_per_second": 0.546,
17
+ "train_steps_per_second": 0.004
18
+ }
eval_results.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 4.99,
3
+ "eval_gen_len": 889.25,
4
+ "eval_loss": 1.4141343832015991,
5
+ "eval_rouge1": 54.2522,
6
+ "eval_rouge2": 24.7528,
7
+ "eval_rougeL": 27.2444,
8
+ "eval_rougeLsum": 51.5916,
9
+ "eval_runtime": 9829.8875,
10
+ "eval_samples": 972,
11
+ "eval_samples_per_second": 0.099,
12
+ "eval_steps_per_second": 0.012
13
+ }
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 4.99,
3
+ "train_loss": 1.3253671477822697,
4
+ "train_runtime": 159961.9679,
5
+ "train_samples": 17457,
6
+ "train_samples_per_second": 0.546,
7
+ "train_steps_per_second": 0.004
8
+ }
trainer_state.json ADDED
@@ -0,0 +1,2133 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 1.4141343832015991,
3
+ "best_model_checkpoint": "/exports/eddie/scratch/s1970716/models/summarization/longt5_xl_gov_5/checkpoint-272",
4
+ "epoch": 4.9859655152660824,
5
+ "eval_steps": 500,
6
+ "global_step": 680,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.01,
13
+ "learning_rate": 0.001,
14
+ "loss": 2.5533,
15
+ "step": 2
16
+ },
17
+ {
18
+ "epoch": 0.03,
19
+ "learning_rate": 0.001,
20
+ "loss": 3.3547,
21
+ "step": 4
22
+ },
23
+ {
24
+ "epoch": 0.04,
25
+ "learning_rate": 0.001,
26
+ "loss": 2.3004,
27
+ "step": 6
28
+ },
29
+ {
30
+ "epoch": 0.06,
31
+ "learning_rate": 0.001,
32
+ "loss": 1.8304,
33
+ "step": 8
34
+ },
35
+ {
36
+ "epoch": 0.07,
37
+ "learning_rate": 0.001,
38
+ "loss": 2.1026,
39
+ "step": 10
40
+ },
41
+ {
42
+ "epoch": 0.09,
43
+ "learning_rate": 0.001,
44
+ "loss": 2.2411,
45
+ "step": 12
46
+ },
47
+ {
48
+ "epoch": 0.1,
49
+ "learning_rate": 0.001,
50
+ "loss": 2.0959,
51
+ "step": 14
52
+ },
53
+ {
54
+ "epoch": 0.12,
55
+ "learning_rate": 0.001,
56
+ "loss": 1.8304,
57
+ "step": 16
58
+ },
59
+ {
60
+ "epoch": 0.13,
61
+ "learning_rate": 0.001,
62
+ "loss": 1.7896,
63
+ "step": 18
64
+ },
65
+ {
66
+ "epoch": 0.15,
67
+ "learning_rate": 0.001,
68
+ "loss": 1.7457,
69
+ "step": 20
70
+ },
71
+ {
72
+ "epoch": 0.16,
73
+ "learning_rate": 0.001,
74
+ "loss": 1.7814,
75
+ "step": 22
76
+ },
77
+ {
78
+ "epoch": 0.18,
79
+ "learning_rate": 0.001,
80
+ "loss": 1.7677,
81
+ "step": 24
82
+ },
83
+ {
84
+ "epoch": 0.19,
85
+ "learning_rate": 0.001,
86
+ "loss": 1.8154,
87
+ "step": 26
88
+ },
89
+ {
90
+ "epoch": 0.21,
91
+ "learning_rate": 0.001,
92
+ "loss": 1.7556,
93
+ "step": 28
94
+ },
95
+ {
96
+ "epoch": 0.22,
97
+ "learning_rate": 0.001,
98
+ "loss": 1.9631,
99
+ "step": 30
100
+ },
101
+ {
102
+ "epoch": 0.23,
103
+ "learning_rate": 0.001,
104
+ "loss": 2.0997,
105
+ "step": 32
106
+ },
107
+ {
108
+ "epoch": 0.25,
109
+ "learning_rate": 0.001,
110
+ "loss": 2.0355,
111
+ "step": 34
112
+ },
113
+ {
114
+ "epoch": 0.26,
115
+ "learning_rate": 0.001,
116
+ "loss": 2.1162,
117
+ "step": 36
118
+ },
119
+ {
120
+ "epoch": 0.28,
121
+ "learning_rate": 0.001,
122
+ "loss": 2.0213,
123
+ "step": 38
124
+ },
125
+ {
126
+ "epoch": 0.29,
127
+ "learning_rate": 0.001,
128
+ "loss": 1.9922,
129
+ "step": 40
130
+ },
131
+ {
132
+ "epoch": 0.31,
133
+ "learning_rate": 0.001,
134
+ "loss": 2.0452,
135
+ "step": 42
136
+ },
137
+ {
138
+ "epoch": 0.32,
139
+ "learning_rate": 0.001,
140
+ "loss": 1.961,
141
+ "step": 44
142
+ },
143
+ {
144
+ "epoch": 0.34,
145
+ "learning_rate": 0.001,
146
+ "loss": 1.8321,
147
+ "step": 46
148
+ },
149
+ {
150
+ "epoch": 0.35,
151
+ "learning_rate": 0.001,
152
+ "loss": 1.8563,
153
+ "step": 48
154
+ },
155
+ {
156
+ "epoch": 0.37,
157
+ "learning_rate": 0.001,
158
+ "loss": 2.2232,
159
+ "step": 50
160
+ },
161
+ {
162
+ "epoch": 0.38,
163
+ "learning_rate": 0.001,
164
+ "loss": 2.0869,
165
+ "step": 52
166
+ },
167
+ {
168
+ "epoch": 0.4,
169
+ "learning_rate": 0.001,
170
+ "loss": 2.3297,
171
+ "step": 54
172
+ },
173
+ {
174
+ "epoch": 0.41,
175
+ "learning_rate": 0.001,
176
+ "loss": 2.353,
177
+ "step": 56
178
+ },
179
+ {
180
+ "epoch": 0.43,
181
+ "learning_rate": 0.001,
182
+ "loss": 1.975,
183
+ "step": 58
184
+ },
185
+ {
186
+ "epoch": 0.44,
187
+ "learning_rate": 0.001,
188
+ "loss": 1.9746,
189
+ "step": 60
190
+ },
191
+ {
192
+ "epoch": 0.45,
193
+ "learning_rate": 0.001,
194
+ "loss": 1.703,
195
+ "step": 62
196
+ },
197
+ {
198
+ "epoch": 0.47,
199
+ "learning_rate": 0.001,
200
+ "loss": 1.8029,
201
+ "step": 64
202
+ },
203
+ {
204
+ "epoch": 0.48,
205
+ "learning_rate": 0.001,
206
+ "loss": 1.8786,
207
+ "step": 66
208
+ },
209
+ {
210
+ "epoch": 0.5,
211
+ "learning_rate": 0.001,
212
+ "loss": 1.8229,
213
+ "step": 68
214
+ },
215
+ {
216
+ "epoch": 0.51,
217
+ "learning_rate": 0.001,
218
+ "loss": 1.8989,
219
+ "step": 70
220
+ },
221
+ {
222
+ "epoch": 0.53,
223
+ "learning_rate": 0.001,
224
+ "loss": 1.7729,
225
+ "step": 72
226
+ },
227
+ {
228
+ "epoch": 0.54,
229
+ "learning_rate": 0.001,
230
+ "loss": 1.7334,
231
+ "step": 74
232
+ },
233
+ {
234
+ "epoch": 0.56,
235
+ "learning_rate": 0.001,
236
+ "loss": 1.9054,
237
+ "step": 76
238
+ },
239
+ {
240
+ "epoch": 0.57,
241
+ "learning_rate": 0.001,
242
+ "loss": 1.8183,
243
+ "step": 78
244
+ },
245
+ {
246
+ "epoch": 0.59,
247
+ "learning_rate": 0.001,
248
+ "loss": 1.7589,
249
+ "step": 80
250
+ },
251
+ {
252
+ "epoch": 0.6,
253
+ "learning_rate": 0.001,
254
+ "loss": 1.6687,
255
+ "step": 82
256
+ },
257
+ {
258
+ "epoch": 0.62,
259
+ "learning_rate": 0.001,
260
+ "loss": 1.681,
261
+ "step": 84
262
+ },
263
+ {
264
+ "epoch": 0.63,
265
+ "learning_rate": 0.001,
266
+ "loss": 1.6948,
267
+ "step": 86
268
+ },
269
+ {
270
+ "epoch": 0.65,
271
+ "learning_rate": 0.001,
272
+ "loss": 1.6912,
273
+ "step": 88
274
+ },
275
+ {
276
+ "epoch": 0.66,
277
+ "learning_rate": 0.001,
278
+ "loss": 1.6393,
279
+ "step": 90
280
+ },
281
+ {
282
+ "epoch": 0.67,
283
+ "learning_rate": 0.001,
284
+ "loss": 1.5826,
285
+ "step": 92
286
+ },
287
+ {
288
+ "epoch": 0.69,
289
+ "learning_rate": 0.001,
290
+ "loss": 1.6758,
291
+ "step": 94
292
+ },
293
+ {
294
+ "epoch": 0.7,
295
+ "learning_rate": 0.001,
296
+ "loss": 1.7602,
297
+ "step": 96
298
+ },
299
+ {
300
+ "epoch": 0.72,
301
+ "learning_rate": 0.001,
302
+ "loss": 1.6959,
303
+ "step": 98
304
+ },
305
+ {
306
+ "epoch": 0.73,
307
+ "learning_rate": 0.001,
308
+ "loss": 1.6268,
309
+ "step": 100
310
+ },
311
+ {
312
+ "epoch": 0.75,
313
+ "learning_rate": 0.001,
314
+ "loss": 1.7449,
315
+ "step": 102
316
+ },
317
+ {
318
+ "epoch": 0.76,
319
+ "learning_rate": 0.001,
320
+ "loss": 1.7258,
321
+ "step": 104
322
+ },
323
+ {
324
+ "epoch": 0.78,
325
+ "learning_rate": 0.001,
326
+ "loss": 1.7049,
327
+ "step": 106
328
+ },
329
+ {
330
+ "epoch": 0.79,
331
+ "learning_rate": 0.001,
332
+ "loss": 1.7017,
333
+ "step": 108
334
+ },
335
+ {
336
+ "epoch": 0.81,
337
+ "learning_rate": 0.001,
338
+ "loss": 1.6686,
339
+ "step": 110
340
+ },
341
+ {
342
+ "epoch": 0.82,
343
+ "learning_rate": 0.001,
344
+ "loss": 1.6871,
345
+ "step": 112
346
+ },
347
+ {
348
+ "epoch": 0.84,
349
+ "learning_rate": 0.001,
350
+ "loss": 1.666,
351
+ "step": 114
352
+ },
353
+ {
354
+ "epoch": 0.85,
355
+ "learning_rate": 0.001,
356
+ "loss": 1.6329,
357
+ "step": 116
358
+ },
359
+ {
360
+ "epoch": 0.87,
361
+ "learning_rate": 0.001,
362
+ "loss": 1.5889,
363
+ "step": 118
364
+ },
365
+ {
366
+ "epoch": 0.88,
367
+ "learning_rate": 0.001,
368
+ "loss": 1.6058,
369
+ "step": 120
370
+ },
371
+ {
372
+ "epoch": 0.89,
373
+ "learning_rate": 0.001,
374
+ "loss": 1.685,
375
+ "step": 122
376
+ },
377
+ {
378
+ "epoch": 0.91,
379
+ "learning_rate": 0.001,
380
+ "loss": 1.6222,
381
+ "step": 124
382
+ },
383
+ {
384
+ "epoch": 0.92,
385
+ "learning_rate": 0.001,
386
+ "loss": 1.5603,
387
+ "step": 126
388
+ },
389
+ {
390
+ "epoch": 0.94,
391
+ "learning_rate": 0.001,
392
+ "loss": 1.5587,
393
+ "step": 128
394
+ },
395
+ {
396
+ "epoch": 0.95,
397
+ "learning_rate": 0.001,
398
+ "loss": 1.6439,
399
+ "step": 130
400
+ },
401
+ {
402
+ "epoch": 0.97,
403
+ "learning_rate": 0.001,
404
+ "loss": 1.5574,
405
+ "step": 132
406
+ },
407
+ {
408
+ "epoch": 0.98,
409
+ "learning_rate": 0.001,
410
+ "loss": 1.5997,
411
+ "step": 134
412
+ },
413
+ {
414
+ "epoch": 1.0,
415
+ "learning_rate": 0.001,
416
+ "loss": 1.6209,
417
+ "step": 136
418
+ },
419
+ {
420
+ "epoch": 1.0,
421
+ "eval_gen_len": 904.1995884773662,
422
+ "eval_loss": 1.5433851480484009,
423
+ "eval_rouge1": 45.0062,
424
+ "eval_rouge2": 18.1618,
425
+ "eval_rougeL": 23.3808,
426
+ "eval_rougeLsum": 41.7616,
427
+ "eval_runtime": 9841.9339,
428
+ "eval_samples_per_second": 0.099,
429
+ "eval_steps_per_second": 0.012,
430
+ "step": 136
431
+ },
432
+ {
433
+ "epoch": 1.01,
434
+ "learning_rate": 0.001,
435
+ "loss": 1.5949,
436
+ "step": 138
437
+ },
438
+ {
439
+ "epoch": 1.03,
440
+ "learning_rate": 0.001,
441
+ "loss": 1.5982,
442
+ "step": 140
443
+ },
444
+ {
445
+ "epoch": 1.04,
446
+ "learning_rate": 0.001,
447
+ "loss": 1.4492,
448
+ "step": 142
449
+ },
450
+ {
451
+ "epoch": 1.06,
452
+ "learning_rate": 0.001,
453
+ "loss": 1.4375,
454
+ "step": 144
455
+ },
456
+ {
457
+ "epoch": 1.07,
458
+ "learning_rate": 0.001,
459
+ "loss": 1.4841,
460
+ "step": 146
461
+ },
462
+ {
463
+ "epoch": 1.09,
464
+ "learning_rate": 0.001,
465
+ "loss": 1.4383,
466
+ "step": 148
467
+ },
468
+ {
469
+ "epoch": 1.1,
470
+ "learning_rate": 0.001,
471
+ "loss": 1.5149,
472
+ "step": 150
473
+ },
474
+ {
475
+ "epoch": 1.11,
476
+ "learning_rate": 0.001,
477
+ "loss": 1.4563,
478
+ "step": 152
479
+ },
480
+ {
481
+ "epoch": 1.13,
482
+ "learning_rate": 0.001,
483
+ "loss": 1.494,
484
+ "step": 154
485
+ },
486
+ {
487
+ "epoch": 1.14,
488
+ "learning_rate": 0.001,
489
+ "loss": 1.4511,
490
+ "step": 156
491
+ },
492
+ {
493
+ "epoch": 1.16,
494
+ "learning_rate": 0.001,
495
+ "loss": 1.4888,
496
+ "step": 158
497
+ },
498
+ {
499
+ "epoch": 1.17,
500
+ "learning_rate": 0.001,
501
+ "loss": 1.4213,
502
+ "step": 160
503
+ },
504
+ {
505
+ "epoch": 1.19,
506
+ "learning_rate": 0.001,
507
+ "loss": 1.485,
508
+ "step": 162
509
+ },
510
+ {
511
+ "epoch": 1.2,
512
+ "learning_rate": 0.001,
513
+ "loss": 1.5013,
514
+ "step": 164
515
+ },
516
+ {
517
+ "epoch": 1.22,
518
+ "learning_rate": 0.001,
519
+ "loss": 1.477,
520
+ "step": 166
521
+ },
522
+ {
523
+ "epoch": 1.23,
524
+ "learning_rate": 0.001,
525
+ "loss": 1.4658,
526
+ "step": 168
527
+ },
528
+ {
529
+ "epoch": 1.25,
530
+ "learning_rate": 0.001,
531
+ "loss": 1.4408,
532
+ "step": 170
533
+ },
534
+ {
535
+ "epoch": 1.26,
536
+ "learning_rate": 0.001,
537
+ "loss": 1.472,
538
+ "step": 172
539
+ },
540
+ {
541
+ "epoch": 1.28,
542
+ "learning_rate": 0.001,
543
+ "loss": 1.4678,
544
+ "step": 174
545
+ },
546
+ {
547
+ "epoch": 1.29,
548
+ "learning_rate": 0.001,
549
+ "loss": 1.4211,
550
+ "step": 176
551
+ },
552
+ {
553
+ "epoch": 1.31,
554
+ "learning_rate": 0.001,
555
+ "loss": 1.4808,
556
+ "step": 178
557
+ },
558
+ {
559
+ "epoch": 1.32,
560
+ "learning_rate": 0.001,
561
+ "loss": 1.4623,
562
+ "step": 180
563
+ },
564
+ {
565
+ "epoch": 1.33,
566
+ "learning_rate": 0.001,
567
+ "loss": 1.4728,
568
+ "step": 182
569
+ },
570
+ {
571
+ "epoch": 1.35,
572
+ "learning_rate": 0.001,
573
+ "loss": 1.5118,
574
+ "step": 184
575
+ },
576
+ {
577
+ "epoch": 1.36,
578
+ "learning_rate": 0.001,
579
+ "loss": 1.5171,
580
+ "step": 186
581
+ },
582
+ {
583
+ "epoch": 1.38,
584
+ "learning_rate": 0.001,
585
+ "loss": 1.497,
586
+ "step": 188
587
+ },
588
+ {
589
+ "epoch": 1.39,
590
+ "learning_rate": 0.001,
591
+ "loss": 1.5148,
592
+ "step": 190
593
+ },
594
+ {
595
+ "epoch": 1.41,
596
+ "learning_rate": 0.001,
597
+ "loss": 1.5081,
598
+ "step": 192
599
+ },
600
+ {
601
+ "epoch": 1.42,
602
+ "learning_rate": 0.001,
603
+ "loss": 1.4425,
604
+ "step": 194
605
+ },
606
+ {
607
+ "epoch": 1.44,
608
+ "learning_rate": 0.001,
609
+ "loss": 1.4402,
610
+ "step": 196
611
+ },
612
+ {
613
+ "epoch": 1.45,
614
+ "learning_rate": 0.001,
615
+ "loss": 1.4361,
616
+ "step": 198
617
+ },
618
+ {
619
+ "epoch": 1.47,
620
+ "learning_rate": 0.001,
621
+ "loss": 1.4648,
622
+ "step": 200
623
+ },
624
+ {
625
+ "epoch": 1.48,
626
+ "learning_rate": 0.001,
627
+ "loss": 1.4701,
628
+ "step": 202
629
+ },
630
+ {
631
+ "epoch": 1.5,
632
+ "learning_rate": 0.001,
633
+ "loss": 1.4982,
634
+ "step": 204
635
+ },
636
+ {
637
+ "epoch": 1.51,
638
+ "learning_rate": 0.001,
639
+ "loss": 1.4692,
640
+ "step": 206
641
+ },
642
+ {
643
+ "epoch": 1.53,
644
+ "learning_rate": 0.001,
645
+ "loss": 1.4572,
646
+ "step": 208
647
+ },
648
+ {
649
+ "epoch": 1.54,
650
+ "learning_rate": 0.001,
651
+ "loss": 1.4563,
652
+ "step": 210
653
+ },
654
+ {
655
+ "epoch": 1.55,
656
+ "learning_rate": 0.001,
657
+ "loss": 1.4295,
658
+ "step": 212
659
+ },
660
+ {
661
+ "epoch": 1.57,
662
+ "learning_rate": 0.001,
663
+ "loss": 1.4421,
664
+ "step": 214
665
+ },
666
+ {
667
+ "epoch": 1.58,
668
+ "learning_rate": 0.001,
669
+ "loss": 1.4664,
670
+ "step": 216
671
+ },
672
+ {
673
+ "epoch": 1.6,
674
+ "learning_rate": 0.001,
675
+ "loss": 1.4408,
676
+ "step": 218
677
+ },
678
+ {
679
+ "epoch": 1.61,
680
+ "learning_rate": 0.001,
681
+ "loss": 1.4754,
682
+ "step": 220
683
+ },
684
+ {
685
+ "epoch": 1.63,
686
+ "learning_rate": 0.001,
687
+ "loss": 1.4685,
688
+ "step": 222
689
+ },
690
+ {
691
+ "epoch": 1.64,
692
+ "learning_rate": 0.001,
693
+ "loss": 1.4231,
694
+ "step": 224
695
+ },
696
+ {
697
+ "epoch": 1.66,
698
+ "learning_rate": 0.001,
699
+ "loss": 1.4786,
700
+ "step": 226
701
+ },
702
+ {
703
+ "epoch": 1.67,
704
+ "learning_rate": 0.001,
705
+ "loss": 1.4659,
706
+ "step": 228
707
+ },
708
+ {
709
+ "epoch": 1.69,
710
+ "learning_rate": 0.001,
711
+ "loss": 1.4834,
712
+ "step": 230
713
+ },
714
+ {
715
+ "epoch": 1.7,
716
+ "learning_rate": 0.001,
717
+ "loss": 1.4353,
718
+ "step": 232
719
+ },
720
+ {
721
+ "epoch": 1.72,
722
+ "learning_rate": 0.001,
723
+ "loss": 1.4318,
724
+ "step": 234
725
+ },
726
+ {
727
+ "epoch": 1.73,
728
+ "learning_rate": 0.001,
729
+ "loss": 1.4646,
730
+ "step": 236
731
+ },
732
+ {
733
+ "epoch": 1.75,
734
+ "learning_rate": 0.001,
735
+ "loss": 1.4728,
736
+ "step": 238
737
+ },
738
+ {
739
+ "epoch": 1.76,
740
+ "learning_rate": 0.001,
741
+ "loss": 1.4466,
742
+ "step": 240
743
+ },
744
+ {
745
+ "epoch": 1.77,
746
+ "learning_rate": 0.001,
747
+ "loss": 1.4871,
748
+ "step": 242
749
+ },
750
+ {
751
+ "epoch": 1.79,
752
+ "learning_rate": 0.001,
753
+ "loss": 1.4811,
754
+ "step": 244
755
+ },
756
+ {
757
+ "epoch": 1.8,
758
+ "learning_rate": 0.001,
759
+ "loss": 1.4979,
760
+ "step": 246
761
+ },
762
+ {
763
+ "epoch": 1.82,
764
+ "learning_rate": 0.001,
765
+ "loss": 1.4995,
766
+ "step": 248
767
+ },
768
+ {
769
+ "epoch": 1.83,
770
+ "learning_rate": 0.001,
771
+ "loss": 1.4496,
772
+ "step": 250
773
+ },
774
+ {
775
+ "epoch": 1.85,
776
+ "learning_rate": 0.001,
777
+ "loss": 1.4225,
778
+ "step": 252
779
+ },
780
+ {
781
+ "epoch": 1.86,
782
+ "learning_rate": 0.001,
783
+ "loss": 1.4784,
784
+ "step": 254
785
+ },
786
+ {
787
+ "epoch": 1.88,
788
+ "learning_rate": 0.001,
789
+ "loss": 1.4591,
790
+ "step": 256
791
+ },
792
+ {
793
+ "epoch": 1.89,
794
+ "learning_rate": 0.001,
795
+ "loss": 1.4277,
796
+ "step": 258
797
+ },
798
+ {
799
+ "epoch": 1.91,
800
+ "learning_rate": 0.001,
801
+ "loss": 1.4555,
802
+ "step": 260
803
+ },
804
+ {
805
+ "epoch": 1.92,
806
+ "learning_rate": 0.001,
807
+ "loss": 1.4385,
808
+ "step": 262
809
+ },
810
+ {
811
+ "epoch": 1.94,
812
+ "learning_rate": 0.001,
813
+ "loss": 1.4104,
814
+ "step": 264
815
+ },
816
+ {
817
+ "epoch": 1.95,
818
+ "learning_rate": 0.001,
819
+ "loss": 1.5014,
820
+ "step": 266
821
+ },
822
+ {
823
+ "epoch": 1.97,
824
+ "learning_rate": 0.001,
825
+ "loss": 1.4236,
826
+ "step": 268
827
+ },
828
+ {
829
+ "epoch": 1.98,
830
+ "learning_rate": 0.001,
831
+ "loss": 1.4521,
832
+ "step": 270
833
+ },
834
+ {
835
+ "epoch": 1.99,
836
+ "learning_rate": 0.001,
837
+ "loss": 1.418,
838
+ "step": 272
839
+ },
840
+ {
841
+ "epoch": 1.99,
842
+ "eval_gen_len": 889.25,
843
+ "eval_loss": 1.4141343832015991,
844
+ "eval_rouge1": 54.2522,
845
+ "eval_rouge2": 24.7528,
846
+ "eval_rougeL": 27.2444,
847
+ "eval_rougeLsum": 51.5916,
848
+ "eval_runtime": 9838.997,
849
+ "eval_samples_per_second": 0.099,
850
+ "eval_steps_per_second": 0.012,
851
+ "step": 272
852
+ },
853
+ {
854
+ "epoch": 2.01,
855
+ "learning_rate": 0.001,
856
+ "loss": 1.3789,
857
+ "step": 274
858
+ },
859
+ {
860
+ "epoch": 2.02,
861
+ "learning_rate": 0.001,
862
+ "loss": 1.2312,
863
+ "step": 276
864
+ },
865
+ {
866
+ "epoch": 2.04,
867
+ "learning_rate": 0.001,
868
+ "loss": 1.2565,
869
+ "step": 278
870
+ },
871
+ {
872
+ "epoch": 2.05,
873
+ "learning_rate": 0.001,
874
+ "loss": 1.277,
875
+ "step": 280
876
+ },
877
+ {
878
+ "epoch": 2.07,
879
+ "learning_rate": 0.001,
880
+ "loss": 1.2787,
881
+ "step": 282
882
+ },
883
+ {
884
+ "epoch": 2.08,
885
+ "learning_rate": 0.001,
886
+ "loss": 1.2645,
887
+ "step": 284
888
+ },
889
+ {
890
+ "epoch": 2.1,
891
+ "learning_rate": 0.001,
892
+ "loss": 1.2606,
893
+ "step": 286
894
+ },
895
+ {
896
+ "epoch": 2.11,
897
+ "learning_rate": 0.001,
898
+ "loss": 1.2462,
899
+ "step": 288
900
+ },
901
+ {
902
+ "epoch": 2.13,
903
+ "learning_rate": 0.001,
904
+ "loss": 1.2102,
905
+ "step": 290
906
+ },
907
+ {
908
+ "epoch": 2.14,
909
+ "learning_rate": 0.001,
910
+ "loss": 1.2467,
911
+ "step": 292
912
+ },
913
+ {
914
+ "epoch": 2.16,
915
+ "learning_rate": 0.001,
916
+ "loss": 1.2972,
917
+ "step": 294
918
+ },
919
+ {
920
+ "epoch": 2.17,
921
+ "learning_rate": 0.001,
922
+ "loss": 1.2813,
923
+ "step": 296
924
+ },
925
+ {
926
+ "epoch": 2.19,
927
+ "learning_rate": 0.001,
928
+ "loss": 1.241,
929
+ "step": 298
930
+ },
931
+ {
932
+ "epoch": 2.2,
933
+ "learning_rate": 0.001,
934
+ "loss": 1.2556,
935
+ "step": 300
936
+ },
937
+ {
938
+ "epoch": 2.21,
939
+ "learning_rate": 0.001,
940
+ "loss": 1.2738,
941
+ "step": 302
942
+ },
943
+ {
944
+ "epoch": 2.23,
945
+ "learning_rate": 0.001,
946
+ "loss": 1.2544,
947
+ "step": 304
948
+ },
949
+ {
950
+ "epoch": 2.24,
951
+ "learning_rate": 0.001,
952
+ "loss": 1.2378,
953
+ "step": 306
954
+ },
955
+ {
956
+ "epoch": 2.26,
957
+ "learning_rate": 0.001,
958
+ "loss": 1.2346,
959
+ "step": 308
960
+ },
961
+ {
962
+ "epoch": 2.27,
963
+ "learning_rate": 0.001,
964
+ "loss": 1.2624,
965
+ "step": 310
966
+ },
967
+ {
968
+ "epoch": 2.29,
969
+ "learning_rate": 0.001,
970
+ "loss": 1.2173,
971
+ "step": 312
972
+ },
973
+ {
974
+ "epoch": 2.3,
975
+ "learning_rate": 0.001,
976
+ "loss": 1.2658,
977
+ "step": 314
978
+ },
979
+ {
980
+ "epoch": 2.32,
981
+ "learning_rate": 0.001,
982
+ "loss": 1.2828,
983
+ "step": 316
984
+ },
985
+ {
986
+ "epoch": 2.33,
987
+ "learning_rate": 0.001,
988
+ "loss": 1.2518,
989
+ "step": 318
990
+ },
991
+ {
992
+ "epoch": 2.35,
993
+ "learning_rate": 0.001,
994
+ "loss": 1.268,
995
+ "step": 320
996
+ },
997
+ {
998
+ "epoch": 2.36,
999
+ "learning_rate": 0.001,
1000
+ "loss": 1.2691,
1001
+ "step": 322
1002
+ },
1003
+ {
1004
+ "epoch": 2.38,
1005
+ "learning_rate": 0.001,
1006
+ "loss": 1.263,
1007
+ "step": 324
1008
+ },
1009
+ {
1010
+ "epoch": 2.39,
1011
+ "learning_rate": 0.001,
1012
+ "loss": 1.2906,
1013
+ "step": 326
1014
+ },
1015
+ {
1016
+ "epoch": 2.4,
1017
+ "learning_rate": 0.001,
1018
+ "loss": 1.2462,
1019
+ "step": 328
1020
+ },
1021
+ {
1022
+ "epoch": 2.42,
1023
+ "learning_rate": 0.001,
1024
+ "loss": 1.2403,
1025
+ "step": 330
1026
+ },
1027
+ {
1028
+ "epoch": 2.43,
1029
+ "learning_rate": 0.001,
1030
+ "loss": 1.2701,
1031
+ "step": 332
1032
+ },
1033
+ {
1034
+ "epoch": 2.45,
1035
+ "learning_rate": 0.001,
1036
+ "loss": 1.2649,
1037
+ "step": 334
1038
+ },
1039
+ {
1040
+ "epoch": 2.46,
1041
+ "learning_rate": 0.001,
1042
+ "loss": 1.2267,
1043
+ "step": 336
1044
+ },
1045
+ {
1046
+ "epoch": 2.48,
1047
+ "learning_rate": 0.001,
1048
+ "loss": 1.2812,
1049
+ "step": 338
1050
+ },
1051
+ {
1052
+ "epoch": 2.49,
1053
+ "learning_rate": 0.001,
1054
+ "loss": 1.2561,
1055
+ "step": 340
1056
+ },
1057
+ {
1058
+ "epoch": 2.51,
1059
+ "learning_rate": 0.001,
1060
+ "loss": 1.2614,
1061
+ "step": 342
1062
+ },
1063
+ {
1064
+ "epoch": 2.52,
1065
+ "learning_rate": 0.001,
1066
+ "loss": 1.2928,
1067
+ "step": 344
1068
+ },
1069
+ {
1070
+ "epoch": 2.54,
1071
+ "learning_rate": 0.001,
1072
+ "loss": 1.2464,
1073
+ "step": 346
1074
+ },
1075
+ {
1076
+ "epoch": 2.55,
1077
+ "learning_rate": 0.001,
1078
+ "loss": 1.2291,
1079
+ "step": 348
1080
+ },
1081
+ {
1082
+ "epoch": 2.57,
1083
+ "learning_rate": 0.001,
1084
+ "loss": 1.2535,
1085
+ "step": 350
1086
+ },
1087
+ {
1088
+ "epoch": 2.58,
1089
+ "learning_rate": 0.001,
1090
+ "loss": 1.2453,
1091
+ "step": 352
1092
+ },
1093
+ {
1094
+ "epoch": 2.6,
1095
+ "learning_rate": 0.001,
1096
+ "loss": 1.2154,
1097
+ "step": 354
1098
+ },
1099
+ {
1100
+ "epoch": 2.61,
1101
+ "learning_rate": 0.001,
1102
+ "loss": 1.3274,
1103
+ "step": 356
1104
+ },
1105
+ {
1106
+ "epoch": 2.62,
1107
+ "learning_rate": 0.001,
1108
+ "loss": 1.2851,
1109
+ "step": 358
1110
+ },
1111
+ {
1112
+ "epoch": 2.64,
1113
+ "learning_rate": 0.001,
1114
+ "loss": 1.253,
1115
+ "step": 360
1116
+ },
1117
+ {
1118
+ "epoch": 2.65,
1119
+ "learning_rate": 0.001,
1120
+ "loss": 1.2939,
1121
+ "step": 362
1122
+ },
1123
+ {
1124
+ "epoch": 2.67,
1125
+ "learning_rate": 0.001,
1126
+ "loss": 1.2554,
1127
+ "step": 364
1128
+ },
1129
+ {
1130
+ "epoch": 2.68,
1131
+ "learning_rate": 0.001,
1132
+ "loss": 1.2893,
1133
+ "step": 366
1134
+ },
1135
+ {
1136
+ "epoch": 2.7,
1137
+ "learning_rate": 0.001,
1138
+ "loss": 1.2668,
1139
+ "step": 368
1140
+ },
1141
+ {
1142
+ "epoch": 2.71,
1143
+ "learning_rate": 0.001,
1144
+ "loss": 1.2619,
1145
+ "step": 370
1146
+ },
1147
+ {
1148
+ "epoch": 2.73,
1149
+ "learning_rate": 0.001,
1150
+ "loss": 1.2303,
1151
+ "step": 372
1152
+ },
1153
+ {
1154
+ "epoch": 2.74,
1155
+ "learning_rate": 0.001,
1156
+ "loss": 1.2802,
1157
+ "step": 374
1158
+ },
1159
+ {
1160
+ "epoch": 2.76,
1161
+ "learning_rate": 0.001,
1162
+ "loss": 1.2482,
1163
+ "step": 376
1164
+ },
1165
+ {
1166
+ "epoch": 2.77,
1167
+ "learning_rate": 0.001,
1168
+ "loss": 1.2512,
1169
+ "step": 378
1170
+ },
1171
+ {
1172
+ "epoch": 2.79,
1173
+ "learning_rate": 0.001,
1174
+ "loss": 1.3013,
1175
+ "step": 380
1176
+ },
1177
+ {
1178
+ "epoch": 2.8,
1179
+ "learning_rate": 0.001,
1180
+ "loss": 1.2722,
1181
+ "step": 382
1182
+ },
1183
+ {
1184
+ "epoch": 2.82,
1185
+ "learning_rate": 0.001,
1186
+ "loss": 1.2711,
1187
+ "step": 384
1188
+ },
1189
+ {
1190
+ "epoch": 2.83,
1191
+ "learning_rate": 0.001,
1192
+ "loss": 1.2437,
1193
+ "step": 386
1194
+ },
1195
+ {
1196
+ "epoch": 2.84,
1197
+ "learning_rate": 0.001,
1198
+ "loss": 1.2389,
1199
+ "step": 388
1200
+ },
1201
+ {
1202
+ "epoch": 2.86,
1203
+ "learning_rate": 0.001,
1204
+ "loss": 1.2792,
1205
+ "step": 390
1206
+ },
1207
+ {
1208
+ "epoch": 2.87,
1209
+ "learning_rate": 0.001,
1210
+ "loss": 1.3103,
1211
+ "step": 392
1212
+ },
1213
+ {
1214
+ "epoch": 2.89,
1215
+ "learning_rate": 0.001,
1216
+ "loss": 1.3027,
1217
+ "step": 394
1218
+ },
1219
+ {
1220
+ "epoch": 2.9,
1221
+ "learning_rate": 0.001,
1222
+ "loss": 1.2437,
1223
+ "step": 396
1224
+ },
1225
+ {
1226
+ "epoch": 2.92,
1227
+ "learning_rate": 0.001,
1228
+ "loss": 1.2682,
1229
+ "step": 398
1230
+ },
1231
+ {
1232
+ "epoch": 2.93,
1233
+ "learning_rate": 0.001,
1234
+ "loss": 1.2591,
1235
+ "step": 400
1236
+ },
1237
+ {
1238
+ "epoch": 2.95,
1239
+ "learning_rate": 0.001,
1240
+ "loss": 1.2806,
1241
+ "step": 402
1242
+ },
1243
+ {
1244
+ "epoch": 2.96,
1245
+ "learning_rate": 0.001,
1246
+ "loss": 1.2288,
1247
+ "step": 404
1248
+ },
1249
+ {
1250
+ "epoch": 2.98,
1251
+ "learning_rate": 0.001,
1252
+ "loss": 1.2457,
1253
+ "step": 406
1254
+ },
1255
+ {
1256
+ "epoch": 2.99,
1257
+ "learning_rate": 0.001,
1258
+ "loss": 1.2626,
1259
+ "step": 408
1260
+ },
1261
+ {
1262
+ "epoch": 3.0,
1263
+ "eval_gen_len": 878.4094650205761,
1264
+ "eval_loss": 1.4249345064163208,
1265
+ "eval_rouge1": 52.4332,
1266
+ "eval_rouge2": 23.708,
1267
+ "eval_rougeL": 27.2902,
1268
+ "eval_rougeLsum": 49.8071,
1269
+ "eval_runtime": 9854.5185,
1270
+ "eval_samples_per_second": 0.099,
1271
+ "eval_steps_per_second": 0.012,
1272
+ "step": 409
1273
+ },
1274
+ {
1275
+ "epoch": 3.01,
1276
+ "learning_rate": 0.001,
1277
+ "loss": 1.1762,
1278
+ "step": 410
1279
+ },
1280
+ {
1281
+ "epoch": 3.02,
1282
+ "learning_rate": 0.001,
1283
+ "loss": 1.1034,
1284
+ "step": 412
1285
+ },
1286
+ {
1287
+ "epoch": 3.04,
1288
+ "learning_rate": 0.001,
1289
+ "loss": 1.0806,
1290
+ "step": 414
1291
+ },
1292
+ {
1293
+ "epoch": 3.05,
1294
+ "learning_rate": 0.001,
1295
+ "loss": 1.0266,
1296
+ "step": 416
1297
+ },
1298
+ {
1299
+ "epoch": 3.06,
1300
+ "learning_rate": 0.001,
1301
+ "loss": 1.0486,
1302
+ "step": 418
1303
+ },
1304
+ {
1305
+ "epoch": 3.08,
1306
+ "learning_rate": 0.001,
1307
+ "loss": 1.0534,
1308
+ "step": 420
1309
+ },
1310
+ {
1311
+ "epoch": 3.09,
1312
+ "learning_rate": 0.001,
1313
+ "loss": 1.0261,
1314
+ "step": 422
1315
+ },
1316
+ {
1317
+ "epoch": 3.11,
1318
+ "learning_rate": 0.001,
1319
+ "loss": 1.0433,
1320
+ "step": 424
1321
+ },
1322
+ {
1323
+ "epoch": 3.12,
1324
+ "learning_rate": 0.001,
1325
+ "loss": 1.0878,
1326
+ "step": 426
1327
+ },
1328
+ {
1329
+ "epoch": 3.14,
1330
+ "learning_rate": 0.001,
1331
+ "loss": 1.0971,
1332
+ "step": 428
1333
+ },
1334
+ {
1335
+ "epoch": 3.15,
1336
+ "learning_rate": 0.001,
1337
+ "loss": 1.0331,
1338
+ "step": 430
1339
+ },
1340
+ {
1341
+ "epoch": 3.17,
1342
+ "learning_rate": 0.001,
1343
+ "loss": 1.0837,
1344
+ "step": 432
1345
+ },
1346
+ {
1347
+ "epoch": 3.18,
1348
+ "learning_rate": 0.001,
1349
+ "loss": 1.0788,
1350
+ "step": 434
1351
+ },
1352
+ {
1353
+ "epoch": 3.2,
1354
+ "learning_rate": 0.001,
1355
+ "loss": 1.0536,
1356
+ "step": 436
1357
+ },
1358
+ {
1359
+ "epoch": 3.21,
1360
+ "learning_rate": 0.001,
1361
+ "loss": 1.0676,
1362
+ "step": 438
1363
+ },
1364
+ {
1365
+ "epoch": 3.23,
1366
+ "learning_rate": 0.001,
1367
+ "loss": 1.0809,
1368
+ "step": 440
1369
+ },
1370
+ {
1371
+ "epoch": 3.24,
1372
+ "learning_rate": 0.001,
1373
+ "loss": 1.0762,
1374
+ "step": 442
1375
+ },
1376
+ {
1377
+ "epoch": 3.26,
1378
+ "learning_rate": 0.001,
1379
+ "loss": 1.0679,
1380
+ "step": 444
1381
+ },
1382
+ {
1383
+ "epoch": 3.27,
1384
+ "learning_rate": 0.001,
1385
+ "loss": 1.0514,
1386
+ "step": 446
1387
+ },
1388
+ {
1389
+ "epoch": 3.28,
1390
+ "learning_rate": 0.001,
1391
+ "loss": 1.1013,
1392
+ "step": 448
1393
+ },
1394
+ {
1395
+ "epoch": 3.3,
1396
+ "learning_rate": 0.001,
1397
+ "loss": 1.0957,
1398
+ "step": 450
1399
+ },
1400
+ {
1401
+ "epoch": 3.31,
1402
+ "learning_rate": 0.001,
1403
+ "loss": 1.0706,
1404
+ "step": 452
1405
+ },
1406
+ {
1407
+ "epoch": 3.33,
1408
+ "learning_rate": 0.001,
1409
+ "loss": 1.0755,
1410
+ "step": 454
1411
+ },
1412
+ {
1413
+ "epoch": 3.34,
1414
+ "learning_rate": 0.001,
1415
+ "loss": 1.0774,
1416
+ "step": 456
1417
+ },
1418
+ {
1419
+ "epoch": 3.36,
1420
+ "learning_rate": 0.001,
1421
+ "loss": 1.0796,
1422
+ "step": 458
1423
+ },
1424
+ {
1425
+ "epoch": 3.37,
1426
+ "learning_rate": 0.001,
1427
+ "loss": 1.0908,
1428
+ "step": 460
1429
+ },
1430
+ {
1431
+ "epoch": 3.39,
1432
+ "learning_rate": 0.001,
1433
+ "loss": 1.1043,
1434
+ "step": 462
1435
+ },
1436
+ {
1437
+ "epoch": 3.4,
1438
+ "learning_rate": 0.001,
1439
+ "loss": 1.0982,
1440
+ "step": 464
1441
+ },
1442
+ {
1443
+ "epoch": 3.42,
1444
+ "learning_rate": 0.001,
1445
+ "loss": 1.0942,
1446
+ "step": 466
1447
+ },
1448
+ {
1449
+ "epoch": 3.43,
1450
+ "learning_rate": 0.001,
1451
+ "loss": 1.0975,
1452
+ "step": 468
1453
+ },
1454
+ {
1455
+ "epoch": 3.45,
1456
+ "learning_rate": 0.001,
1457
+ "loss": 1.0786,
1458
+ "step": 470
1459
+ },
1460
+ {
1461
+ "epoch": 3.46,
1462
+ "learning_rate": 0.001,
1463
+ "loss": 1.1133,
1464
+ "step": 472
1465
+ },
1466
+ {
1467
+ "epoch": 3.48,
1468
+ "learning_rate": 0.001,
1469
+ "loss": 1.0705,
1470
+ "step": 474
1471
+ },
1472
+ {
1473
+ "epoch": 3.49,
1474
+ "learning_rate": 0.001,
1475
+ "loss": 1.1205,
1476
+ "step": 476
1477
+ },
1478
+ {
1479
+ "epoch": 3.5,
1480
+ "learning_rate": 0.001,
1481
+ "loss": 1.117,
1482
+ "step": 478
1483
+ },
1484
+ {
1485
+ "epoch": 3.52,
1486
+ "learning_rate": 0.001,
1487
+ "loss": 1.1035,
1488
+ "step": 480
1489
+ },
1490
+ {
1491
+ "epoch": 3.53,
1492
+ "learning_rate": 0.001,
1493
+ "loss": 1.0684,
1494
+ "step": 482
1495
+ },
1496
+ {
1497
+ "epoch": 3.55,
1498
+ "learning_rate": 0.001,
1499
+ "loss": 1.0812,
1500
+ "step": 484
1501
+ },
1502
+ {
1503
+ "epoch": 3.56,
1504
+ "learning_rate": 0.001,
1505
+ "loss": 1.0383,
1506
+ "step": 486
1507
+ },
1508
+ {
1509
+ "epoch": 3.58,
1510
+ "learning_rate": 0.001,
1511
+ "loss": 1.1239,
1512
+ "step": 488
1513
+ },
1514
+ {
1515
+ "epoch": 3.59,
1516
+ "learning_rate": 0.001,
1517
+ "loss": 1.1189,
1518
+ "step": 490
1519
+ },
1520
+ {
1521
+ "epoch": 3.61,
1522
+ "learning_rate": 0.001,
1523
+ "loss": 1.0958,
1524
+ "step": 492
1525
+ },
1526
+ {
1527
+ "epoch": 3.62,
1528
+ "learning_rate": 0.001,
1529
+ "loss": 1.0997,
1530
+ "step": 494
1531
+ },
1532
+ {
1533
+ "epoch": 3.64,
1534
+ "learning_rate": 0.001,
1535
+ "loss": 1.1264,
1536
+ "step": 496
1537
+ },
1538
+ {
1539
+ "epoch": 3.65,
1540
+ "learning_rate": 0.001,
1541
+ "loss": 1.1033,
1542
+ "step": 498
1543
+ },
1544
+ {
1545
+ "epoch": 3.67,
1546
+ "learning_rate": 0.001,
1547
+ "loss": 1.0644,
1548
+ "step": 500
1549
+ },
1550
+ {
1551
+ "epoch": 3.68,
1552
+ "learning_rate": 0.001,
1553
+ "loss": 1.0705,
1554
+ "step": 502
1555
+ },
1556
+ {
1557
+ "epoch": 3.7,
1558
+ "learning_rate": 0.001,
1559
+ "loss": 1.0929,
1560
+ "step": 504
1561
+ },
1562
+ {
1563
+ "epoch": 3.71,
1564
+ "learning_rate": 0.001,
1565
+ "loss": 1.0478,
1566
+ "step": 506
1567
+ },
1568
+ {
1569
+ "epoch": 3.72,
1570
+ "learning_rate": 0.001,
1571
+ "loss": 1.1277,
1572
+ "step": 508
1573
+ },
1574
+ {
1575
+ "epoch": 3.74,
1576
+ "learning_rate": 0.001,
1577
+ "loss": 1.0987,
1578
+ "step": 510
1579
+ },
1580
+ {
1581
+ "epoch": 3.75,
1582
+ "learning_rate": 0.001,
1583
+ "loss": 1.105,
1584
+ "step": 512
1585
+ },
1586
+ {
1587
+ "epoch": 3.77,
1588
+ "learning_rate": 0.001,
1589
+ "loss": 1.1306,
1590
+ "step": 514
1591
+ },
1592
+ {
1593
+ "epoch": 3.78,
1594
+ "learning_rate": 0.001,
1595
+ "loss": 1.1151,
1596
+ "step": 516
1597
+ },
1598
+ {
1599
+ "epoch": 3.8,
1600
+ "learning_rate": 0.001,
1601
+ "loss": 1.1238,
1602
+ "step": 518
1603
+ },
1604
+ {
1605
+ "epoch": 3.81,
1606
+ "learning_rate": 0.001,
1607
+ "loss": 1.1157,
1608
+ "step": 520
1609
+ },
1610
+ {
1611
+ "epoch": 3.83,
1612
+ "learning_rate": 0.001,
1613
+ "loss": 1.1197,
1614
+ "step": 522
1615
+ },
1616
+ {
1617
+ "epoch": 3.84,
1618
+ "learning_rate": 0.001,
1619
+ "loss": 1.095,
1620
+ "step": 524
1621
+ },
1622
+ {
1623
+ "epoch": 3.86,
1624
+ "learning_rate": 0.001,
1625
+ "loss": 1.1052,
1626
+ "step": 526
1627
+ },
1628
+ {
1629
+ "epoch": 3.87,
1630
+ "learning_rate": 0.001,
1631
+ "loss": 1.1495,
1632
+ "step": 528
1633
+ },
1634
+ {
1635
+ "epoch": 3.89,
1636
+ "learning_rate": 0.001,
1637
+ "loss": 1.1081,
1638
+ "step": 530
1639
+ },
1640
+ {
1641
+ "epoch": 3.9,
1642
+ "learning_rate": 0.001,
1643
+ "loss": 1.1378,
1644
+ "step": 532
1645
+ },
1646
+ {
1647
+ "epoch": 3.92,
1648
+ "learning_rate": 0.001,
1649
+ "loss": 1.0769,
1650
+ "step": 534
1651
+ },
1652
+ {
1653
+ "epoch": 3.93,
1654
+ "learning_rate": 0.001,
1655
+ "loss": 1.1236,
1656
+ "step": 536
1657
+ },
1658
+ {
1659
+ "epoch": 3.94,
1660
+ "learning_rate": 0.001,
1661
+ "loss": 1.0993,
1662
+ "step": 538
1663
+ },
1664
+ {
1665
+ "epoch": 3.96,
1666
+ "learning_rate": 0.001,
1667
+ "loss": 1.0958,
1668
+ "step": 540
1669
+ },
1670
+ {
1671
+ "epoch": 3.97,
1672
+ "learning_rate": 0.001,
1673
+ "loss": 1.1507,
1674
+ "step": 542
1675
+ },
1676
+ {
1677
+ "epoch": 3.99,
1678
+ "learning_rate": 0.001,
1679
+ "loss": 1.0992,
1680
+ "step": 544
1681
+ },
1682
+ {
1683
+ "epoch": 4.0,
1684
+ "eval_gen_len": 670.7047325102881,
1685
+ "eval_loss": 1.4211255311965942,
1686
+ "eval_rouge1": 55.2041,
1687
+ "eval_rouge2": 26.5229,
1688
+ "eval_rougeL": 29.9951,
1689
+ "eval_rougeLsum": 52.6487,
1690
+ "eval_runtime": 9282.99,
1691
+ "eval_samples_per_second": 0.105,
1692
+ "eval_steps_per_second": 0.013,
1693
+ "step": 545
1694
+ },
1695
+ {
1696
+ "epoch": 4.0,
1697
+ "learning_rate": 0.001,
1698
+ "loss": 1.0866,
1699
+ "step": 546
1700
+ },
1701
+ {
1702
+ "epoch": 4.02,
1703
+ "learning_rate": 0.001,
1704
+ "loss": 0.8617,
1705
+ "step": 548
1706
+ },
1707
+ {
1708
+ "epoch": 4.03,
1709
+ "learning_rate": 0.001,
1710
+ "loss": 0.878,
1711
+ "step": 550
1712
+ },
1713
+ {
1714
+ "epoch": 4.05,
1715
+ "learning_rate": 0.001,
1716
+ "loss": 0.8617,
1717
+ "step": 552
1718
+ },
1719
+ {
1720
+ "epoch": 4.06,
1721
+ "learning_rate": 0.001,
1722
+ "loss": 0.9181,
1723
+ "step": 554
1724
+ },
1725
+ {
1726
+ "epoch": 4.08,
1727
+ "learning_rate": 0.001,
1728
+ "loss": 0.9142,
1729
+ "step": 556
1730
+ },
1731
+ {
1732
+ "epoch": 4.09,
1733
+ "learning_rate": 0.001,
1734
+ "loss": 0.8928,
1735
+ "step": 558
1736
+ },
1737
+ {
1738
+ "epoch": 4.11,
1739
+ "learning_rate": 0.001,
1740
+ "loss": 0.9007,
1741
+ "step": 560
1742
+ },
1743
+ {
1744
+ "epoch": 4.12,
1745
+ "learning_rate": 0.001,
1746
+ "loss": 0.9425,
1747
+ "step": 562
1748
+ },
1749
+ {
1750
+ "epoch": 4.14,
1751
+ "learning_rate": 0.001,
1752
+ "loss": 0.9297,
1753
+ "step": 564
1754
+ },
1755
+ {
1756
+ "epoch": 4.15,
1757
+ "learning_rate": 0.001,
1758
+ "loss": 0.9367,
1759
+ "step": 566
1760
+ },
1761
+ {
1762
+ "epoch": 4.16,
1763
+ "learning_rate": 0.001,
1764
+ "loss": 0.9289,
1765
+ "step": 568
1766
+ },
1767
+ {
1768
+ "epoch": 4.18,
1769
+ "learning_rate": 0.001,
1770
+ "loss": 0.9027,
1771
+ "step": 570
1772
+ },
1773
+ {
1774
+ "epoch": 4.19,
1775
+ "learning_rate": 0.001,
1776
+ "loss": 0.9263,
1777
+ "step": 572
1778
+ },
1779
+ {
1780
+ "epoch": 4.21,
1781
+ "learning_rate": 0.001,
1782
+ "loss": 0.9208,
1783
+ "step": 574
1784
+ },
1785
+ {
1786
+ "epoch": 4.22,
1787
+ "learning_rate": 0.001,
1788
+ "loss": 0.8909,
1789
+ "step": 576
1790
+ },
1791
+ {
1792
+ "epoch": 4.24,
1793
+ "learning_rate": 0.001,
1794
+ "loss": 0.9407,
1795
+ "step": 578
1796
+ },
1797
+ {
1798
+ "epoch": 4.25,
1799
+ "learning_rate": 0.001,
1800
+ "loss": 0.9139,
1801
+ "step": 580
1802
+ },
1803
+ {
1804
+ "epoch": 4.27,
1805
+ "learning_rate": 0.001,
1806
+ "loss": 0.9096,
1807
+ "step": 582
1808
+ },
1809
+ {
1810
+ "epoch": 4.28,
1811
+ "learning_rate": 0.001,
1812
+ "loss": 0.9509,
1813
+ "step": 584
1814
+ },
1815
+ {
1816
+ "epoch": 4.3,
1817
+ "learning_rate": 0.001,
1818
+ "loss": 0.9396,
1819
+ "step": 586
1820
+ },
1821
+ {
1822
+ "epoch": 4.31,
1823
+ "learning_rate": 0.001,
1824
+ "loss": 0.9573,
1825
+ "step": 588
1826
+ },
1827
+ {
1828
+ "epoch": 4.33,
1829
+ "learning_rate": 0.001,
1830
+ "loss": 0.9431,
1831
+ "step": 590
1832
+ },
1833
+ {
1834
+ "epoch": 4.34,
1835
+ "learning_rate": 0.001,
1836
+ "loss": 0.9372,
1837
+ "step": 592
1838
+ },
1839
+ {
1840
+ "epoch": 4.36,
1841
+ "learning_rate": 0.001,
1842
+ "loss": 0.9375,
1843
+ "step": 594
1844
+ },
1845
+ {
1846
+ "epoch": 4.37,
1847
+ "learning_rate": 0.001,
1848
+ "loss": 0.9088,
1849
+ "step": 596
1850
+ },
1851
+ {
1852
+ "epoch": 4.38,
1853
+ "learning_rate": 0.001,
1854
+ "loss": 0.9325,
1855
+ "step": 598
1856
+ },
1857
+ {
1858
+ "epoch": 4.4,
1859
+ "learning_rate": 0.001,
1860
+ "loss": 0.9175,
1861
+ "step": 600
1862
+ },
1863
+ {
1864
+ "epoch": 4.41,
1865
+ "learning_rate": 0.001,
1866
+ "loss": 0.9467,
1867
+ "step": 602
1868
+ },
1869
+ {
1870
+ "epoch": 4.43,
1871
+ "learning_rate": 0.001,
1872
+ "loss": 0.9325,
1873
+ "step": 604
1874
+ },
1875
+ {
1876
+ "epoch": 4.44,
1877
+ "learning_rate": 0.001,
1878
+ "loss": 0.9501,
1879
+ "step": 606
1880
+ },
1881
+ {
1882
+ "epoch": 4.46,
1883
+ "learning_rate": 0.001,
1884
+ "loss": 0.9185,
1885
+ "step": 608
1886
+ },
1887
+ {
1888
+ "epoch": 4.47,
1889
+ "learning_rate": 0.001,
1890
+ "loss": 0.9673,
1891
+ "step": 610
1892
+ },
1893
+ {
1894
+ "epoch": 4.49,
1895
+ "learning_rate": 0.001,
1896
+ "loss": 0.9608,
1897
+ "step": 612
1898
+ },
1899
+ {
1900
+ "epoch": 4.5,
1901
+ "learning_rate": 0.001,
1902
+ "loss": 0.9238,
1903
+ "step": 614
1904
+ },
1905
+ {
1906
+ "epoch": 4.52,
1907
+ "learning_rate": 0.001,
1908
+ "loss": 0.9645,
1909
+ "step": 616
1910
+ },
1911
+ {
1912
+ "epoch": 4.53,
1913
+ "learning_rate": 0.001,
1914
+ "loss": 0.9575,
1915
+ "step": 618
1916
+ },
1917
+ {
1918
+ "epoch": 4.55,
1919
+ "learning_rate": 0.001,
1920
+ "loss": 0.9876,
1921
+ "step": 620
1922
+ },
1923
+ {
1924
+ "epoch": 4.56,
1925
+ "learning_rate": 0.001,
1926
+ "loss": 0.9601,
1927
+ "step": 622
1928
+ },
1929
+ {
1930
+ "epoch": 4.58,
1931
+ "learning_rate": 0.001,
1932
+ "loss": 0.9555,
1933
+ "step": 624
1934
+ },
1935
+ {
1936
+ "epoch": 4.59,
1937
+ "learning_rate": 0.001,
1938
+ "loss": 0.9603,
1939
+ "step": 626
1940
+ },
1941
+ {
1942
+ "epoch": 4.6,
1943
+ "learning_rate": 0.001,
1944
+ "loss": 0.9442,
1945
+ "step": 628
1946
+ },
1947
+ {
1948
+ "epoch": 4.62,
1949
+ "learning_rate": 0.001,
1950
+ "loss": 0.9681,
1951
+ "step": 630
1952
+ },
1953
+ {
1954
+ "epoch": 4.63,
1955
+ "learning_rate": 0.001,
1956
+ "loss": 0.9681,
1957
+ "step": 632
1958
+ },
1959
+ {
1960
+ "epoch": 4.65,
1961
+ "learning_rate": 0.001,
1962
+ "loss": 1.0074,
1963
+ "step": 634
1964
+ },
1965
+ {
1966
+ "epoch": 4.66,
1967
+ "learning_rate": 0.001,
1968
+ "loss": 0.9949,
1969
+ "step": 636
1970
+ },
1971
+ {
1972
+ "epoch": 4.68,
1973
+ "learning_rate": 0.001,
1974
+ "loss": 0.9764,
1975
+ "step": 638
1976
+ },
1977
+ {
1978
+ "epoch": 4.69,
1979
+ "learning_rate": 0.001,
1980
+ "loss": 0.9612,
1981
+ "step": 640
1982
+ },
1983
+ {
1984
+ "epoch": 4.71,
1985
+ "learning_rate": 0.001,
1986
+ "loss": 0.9607,
1987
+ "step": 642
1988
+ },
1989
+ {
1990
+ "epoch": 4.72,
1991
+ "learning_rate": 0.001,
1992
+ "loss": 0.9954,
1993
+ "step": 644
1994
+ },
1995
+ {
1996
+ "epoch": 4.74,
1997
+ "learning_rate": 0.001,
1998
+ "loss": 1.0018,
1999
+ "step": 646
2000
+ },
2001
+ {
2002
+ "epoch": 4.75,
2003
+ "learning_rate": 0.001,
2004
+ "loss": 0.9353,
2005
+ "step": 648
2006
+ },
2007
+ {
2008
+ "epoch": 4.77,
2009
+ "learning_rate": 0.001,
2010
+ "loss": 0.9209,
2011
+ "step": 650
2012
+ },
2013
+ {
2014
+ "epoch": 4.78,
2015
+ "learning_rate": 0.001,
2016
+ "loss": 0.9726,
2017
+ "step": 652
2018
+ },
2019
+ {
2020
+ "epoch": 4.8,
2021
+ "learning_rate": 0.001,
2022
+ "loss": 0.9745,
2023
+ "step": 654
2024
+ },
2025
+ {
2026
+ "epoch": 4.81,
2027
+ "learning_rate": 0.001,
2028
+ "loss": 0.9479,
2029
+ "step": 656
2030
+ },
2031
+ {
2032
+ "epoch": 4.82,
2033
+ "learning_rate": 0.001,
2034
+ "loss": 0.9508,
2035
+ "step": 658
2036
+ },
2037
+ {
2038
+ "epoch": 4.84,
2039
+ "learning_rate": 0.001,
2040
+ "loss": 0.9887,
2041
+ "step": 660
2042
+ },
2043
+ {
2044
+ "epoch": 4.85,
2045
+ "learning_rate": 0.001,
2046
+ "loss": 0.9553,
2047
+ "step": 662
2048
+ },
2049
+ {
2050
+ "epoch": 4.87,
2051
+ "learning_rate": 0.001,
2052
+ "loss": 0.9733,
2053
+ "step": 664
2054
+ },
2055
+ {
2056
+ "epoch": 4.88,
2057
+ "learning_rate": 0.001,
2058
+ "loss": 0.9416,
2059
+ "step": 666
2060
+ },
2061
+ {
2062
+ "epoch": 4.9,
2063
+ "learning_rate": 0.001,
2064
+ "loss": 0.9705,
2065
+ "step": 668
2066
+ },
2067
+ {
2068
+ "epoch": 4.91,
2069
+ "learning_rate": 0.001,
2070
+ "loss": 0.9931,
2071
+ "step": 670
2072
+ },
2073
+ {
2074
+ "epoch": 4.93,
2075
+ "learning_rate": 0.001,
2076
+ "loss": 1.0008,
2077
+ "step": 672
2078
+ },
2079
+ {
2080
+ "epoch": 4.94,
2081
+ "learning_rate": 0.001,
2082
+ "loss": 0.9638,
2083
+ "step": 674
2084
+ },
2085
+ {
2086
+ "epoch": 4.96,
2087
+ "learning_rate": 0.001,
2088
+ "loss": 0.995,
2089
+ "step": 676
2090
+ },
2091
+ {
2092
+ "epoch": 4.97,
2093
+ "learning_rate": 0.001,
2094
+ "loss": 0.9863,
2095
+ "step": 678
2096
+ },
2097
+ {
2098
+ "epoch": 4.99,
2099
+ "learning_rate": 0.001,
2100
+ "loss": 0.9974,
2101
+ "step": 680
2102
+ },
2103
+ {
2104
+ "epoch": 4.99,
2105
+ "eval_gen_len": 883.0462962962963,
2106
+ "eval_loss": 1.45689058303833,
2107
+ "eval_rouge1": 55.9961,
2108
+ "eval_rouge2": 26.2205,
2109
+ "eval_rougeL": 29.0409,
2110
+ "eval_rougeLsum": 53.3109,
2111
+ "eval_runtime": 9845.6326,
2112
+ "eval_samples_per_second": 0.099,
2113
+ "eval_steps_per_second": 0.012,
2114
+ "step": 680
2115
+ },
2116
+ {
2117
+ "epoch": 4.99,
2118
+ "step": 680,
2119
+ "total_flos": 5.765052082333483e+18,
2120
+ "train_loss": 1.3253671477822697,
2121
+ "train_runtime": 159961.9679,
2122
+ "train_samples_per_second": 0.546,
2123
+ "train_steps_per_second": 0.004
2124
+ }
2125
+ ],
2126
+ "logging_steps": 2,
2127
+ "max_steps": 680,
2128
+ "num_train_epochs": 5,
2129
+ "save_steps": 500,
2130
+ "total_flos": 5.765052082333483e+18,
2131
+ "trial_name": null,
2132
+ "trial_params": null
2133
+ }