100rab25 commited on
Commit
74ecf1e
1 Parent(s): 38c2ef4

End of training

Browse files
README.md CHANGED
@@ -22,7 +22,7 @@ model-index:
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
- value: 0.9777571825764597
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -32,8 +32,8 @@ should probably proofread and complete it, then remove this comment. -->
32
 
33
  This model is a fine-tuned version of [microsoft/swin-tiny-patch4-window7-224](https://huggingface.co/microsoft/swin-tiny-patch4-window7-224) on the imagefolder dataset.
34
  It achieves the following results on the evaluation set:
35
- - Loss: 0.0652
36
- - Accuracy: 0.9778
37
 
38
  ## Model description
39
 
 
22
  metrics:
23
  - name: Accuracy
24
  type: accuracy
25
+ value: 0.978066110596231
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
32
 
33
  This model is a fine-tuned version of [microsoft/swin-tiny-patch4-window7-224](https://huggingface.co/microsoft/swin-tiny-patch4-window7-224) on the imagefolder dataset.
34
  It achieves the following results on the evaluation set:
35
+ - Loss: 0.0662
36
+ - Accuracy: 0.9781
37
 
38
  ## Model description
39
 
all_results.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 9.97,
3
+ "eval_accuracy": 0.978066110596231,
4
+ "eval_loss": 0.0661974847316742,
5
+ "eval_runtime": 6.7556,
6
+ "eval_samples_per_second": 479.158,
7
+ "eval_steps_per_second": 15.099,
8
+ "train_loss": 0.18469989935206946,
9
+ "train_runtime": 1472.4515,
10
+ "train_samples_per_second": 197.82,
11
+ "train_steps_per_second": 1.542
12
+ }
eval_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 9.97,
3
+ "eval_accuracy": 0.978066110596231,
4
+ "eval_loss": 0.0661974847316742,
5
+ "eval_runtime": 6.7556,
6
+ "eval_samples_per_second": 479.158,
7
+ "eval_steps_per_second": 15.099
8
+ }
runs/Mar20_12-19-43_img-srch-kworker2/events.out.tfevents.1710918886.img-srch-kworker2.997692.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:343317654e8ee4f53789ed80fbc39db393c97483cf9fd24524d53f738c724715
3
+ size 411
train_results.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 9.97,
3
+ "train_loss": 0.18469989935206946,
4
+ "train_runtime": 1472.4515,
5
+ "train_samples_per_second": 197.82,
6
+ "train_steps_per_second": 1.542
7
+ }
trainer_state.json ADDED
@@ -0,0 +1,2842 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": 0.978066110596231,
3
+ "best_model_checkpoint": "spa_images_classifier_jd_v1_convnext/checkpoint-1594",
4
+ "epoch": 9.967069154774972,
5
+ "eval_steps": 500,
6
+ "global_step": 2270,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.02,
13
+ "learning_rate": 1.1013215859030839e-06,
14
+ "loss": 1.4923,
15
+ "step": 5
16
+ },
17
+ {
18
+ "epoch": 0.04,
19
+ "learning_rate": 2.2026431718061677e-06,
20
+ "loss": 1.4857,
21
+ "step": 10
22
+ },
23
+ {
24
+ "epoch": 0.07,
25
+ "learning_rate": 3.303964757709251e-06,
26
+ "loss": 1.4597,
27
+ "step": 15
28
+ },
29
+ {
30
+ "epoch": 0.09,
31
+ "learning_rate": 4.4052863436123355e-06,
32
+ "loss": 1.3989,
33
+ "step": 20
34
+ },
35
+ {
36
+ "epoch": 0.11,
37
+ "learning_rate": 5.506607929515419e-06,
38
+ "loss": 1.3587,
39
+ "step": 25
40
+ },
41
+ {
42
+ "epoch": 0.13,
43
+ "learning_rate": 6.607929515418502e-06,
44
+ "loss": 1.2912,
45
+ "step": 30
46
+ },
47
+ {
48
+ "epoch": 0.15,
49
+ "learning_rate": 7.709251101321587e-06,
50
+ "loss": 1.2097,
51
+ "step": 35
52
+ },
53
+ {
54
+ "epoch": 0.18,
55
+ "learning_rate": 8.810572687224671e-06,
56
+ "loss": 1.1577,
57
+ "step": 40
58
+ },
59
+ {
60
+ "epoch": 0.2,
61
+ "learning_rate": 9.911894273127754e-06,
62
+ "loss": 1.0664,
63
+ "step": 45
64
+ },
65
+ {
66
+ "epoch": 0.22,
67
+ "learning_rate": 1.1013215859030838e-05,
68
+ "loss": 0.9747,
69
+ "step": 50
70
+ },
71
+ {
72
+ "epoch": 0.24,
73
+ "learning_rate": 1.211453744493392e-05,
74
+ "loss": 0.8517,
75
+ "step": 55
76
+ },
77
+ {
78
+ "epoch": 0.26,
79
+ "learning_rate": 1.3215859030837005e-05,
80
+ "loss": 0.7492,
81
+ "step": 60
82
+ },
83
+ {
84
+ "epoch": 0.29,
85
+ "learning_rate": 1.4317180616740089e-05,
86
+ "loss": 0.6764,
87
+ "step": 65
88
+ },
89
+ {
90
+ "epoch": 0.31,
91
+ "learning_rate": 1.5418502202643173e-05,
92
+ "loss": 0.6508,
93
+ "step": 70
94
+ },
95
+ {
96
+ "epoch": 0.33,
97
+ "learning_rate": 1.6519823788546258e-05,
98
+ "loss": 0.5314,
99
+ "step": 75
100
+ },
101
+ {
102
+ "epoch": 0.35,
103
+ "learning_rate": 1.7621145374449342e-05,
104
+ "loss": 0.4931,
105
+ "step": 80
106
+ },
107
+ {
108
+ "epoch": 0.37,
109
+ "learning_rate": 1.8722466960352426e-05,
110
+ "loss": 0.4168,
111
+ "step": 85
112
+ },
113
+ {
114
+ "epoch": 0.4,
115
+ "learning_rate": 1.9823788546255507e-05,
116
+ "loss": 0.4433,
117
+ "step": 90
118
+ },
119
+ {
120
+ "epoch": 0.42,
121
+ "learning_rate": 2.092511013215859e-05,
122
+ "loss": 0.3664,
123
+ "step": 95
124
+ },
125
+ {
126
+ "epoch": 0.44,
127
+ "learning_rate": 2.2026431718061676e-05,
128
+ "loss": 0.3411,
129
+ "step": 100
130
+ },
131
+ {
132
+ "epoch": 0.46,
133
+ "learning_rate": 2.3127753303964757e-05,
134
+ "loss": 0.356,
135
+ "step": 105
136
+ },
137
+ {
138
+ "epoch": 0.48,
139
+ "learning_rate": 2.422907488986784e-05,
140
+ "loss": 0.3499,
141
+ "step": 110
142
+ },
143
+ {
144
+ "epoch": 0.5,
145
+ "learning_rate": 2.533039647577093e-05,
146
+ "loss": 0.2877,
147
+ "step": 115
148
+ },
149
+ {
150
+ "epoch": 0.53,
151
+ "learning_rate": 2.643171806167401e-05,
152
+ "loss": 0.3416,
153
+ "step": 120
154
+ },
155
+ {
156
+ "epoch": 0.55,
157
+ "learning_rate": 2.753303964757709e-05,
158
+ "loss": 0.3564,
159
+ "step": 125
160
+ },
161
+ {
162
+ "epoch": 0.57,
163
+ "learning_rate": 2.8634361233480178e-05,
164
+ "loss": 0.363,
165
+ "step": 130
166
+ },
167
+ {
168
+ "epoch": 0.59,
169
+ "learning_rate": 2.973568281938326e-05,
170
+ "loss": 0.3397,
171
+ "step": 135
172
+ },
173
+ {
174
+ "epoch": 0.61,
175
+ "learning_rate": 3.0837004405286347e-05,
176
+ "loss": 0.2825,
177
+ "step": 140
178
+ },
179
+ {
180
+ "epoch": 0.64,
181
+ "learning_rate": 3.1938325991189424e-05,
182
+ "loss": 0.2888,
183
+ "step": 145
184
+ },
185
+ {
186
+ "epoch": 0.66,
187
+ "learning_rate": 3.3039647577092515e-05,
188
+ "loss": 0.2989,
189
+ "step": 150
190
+ },
191
+ {
192
+ "epoch": 0.68,
193
+ "learning_rate": 3.414096916299559e-05,
194
+ "loss": 0.2703,
195
+ "step": 155
196
+ },
197
+ {
198
+ "epoch": 0.7,
199
+ "learning_rate": 3.5242290748898684e-05,
200
+ "loss": 0.3281,
201
+ "step": 160
202
+ },
203
+ {
204
+ "epoch": 0.72,
205
+ "learning_rate": 3.634361233480176e-05,
206
+ "loss": 0.2862,
207
+ "step": 165
208
+ },
209
+ {
210
+ "epoch": 0.75,
211
+ "learning_rate": 3.744493392070485e-05,
212
+ "loss": 0.2819,
213
+ "step": 170
214
+ },
215
+ {
216
+ "epoch": 0.77,
217
+ "learning_rate": 3.854625550660793e-05,
218
+ "loss": 0.2488,
219
+ "step": 175
220
+ },
221
+ {
222
+ "epoch": 0.79,
223
+ "learning_rate": 3.9647577092511014e-05,
224
+ "loss": 0.2569,
225
+ "step": 180
226
+ },
227
+ {
228
+ "epoch": 0.81,
229
+ "learning_rate": 4.07488986784141e-05,
230
+ "loss": 0.2378,
231
+ "step": 185
232
+ },
233
+ {
234
+ "epoch": 0.83,
235
+ "learning_rate": 4.185022026431718e-05,
236
+ "loss": 0.3059,
237
+ "step": 190
238
+ },
239
+ {
240
+ "epoch": 0.86,
241
+ "learning_rate": 4.295154185022027e-05,
242
+ "loss": 0.2922,
243
+ "step": 195
244
+ },
245
+ {
246
+ "epoch": 0.88,
247
+ "learning_rate": 4.405286343612335e-05,
248
+ "loss": 0.2422,
249
+ "step": 200
250
+ },
251
+ {
252
+ "epoch": 0.9,
253
+ "learning_rate": 4.5154185022026436e-05,
254
+ "loss": 0.2781,
255
+ "step": 205
256
+ },
257
+ {
258
+ "epoch": 0.92,
259
+ "learning_rate": 4.625550660792951e-05,
260
+ "loss": 0.2178,
261
+ "step": 210
262
+ },
263
+ {
264
+ "epoch": 0.94,
265
+ "learning_rate": 4.7356828193832604e-05,
266
+ "loss": 0.2647,
267
+ "step": 215
268
+ },
269
+ {
270
+ "epoch": 0.97,
271
+ "learning_rate": 4.845814977973568e-05,
272
+ "loss": 0.2728,
273
+ "step": 220
274
+ },
275
+ {
276
+ "epoch": 0.99,
277
+ "learning_rate": 4.955947136563877e-05,
278
+ "loss": 0.2494,
279
+ "step": 225
280
+ },
281
+ {
282
+ "epoch": 1.0,
283
+ "eval_accuracy": 0.9555143651529193,
284
+ "eval_loss": 0.11944440752267838,
285
+ "eval_runtime": 6.3116,
286
+ "eval_samples_per_second": 512.864,
287
+ "eval_steps_per_second": 16.161,
288
+ "step": 227
289
+ },
290
+ {
291
+ "epoch": 1.01,
292
+ "learning_rate": 4.9926578560939794e-05,
293
+ "loss": 0.2155,
294
+ "step": 230
295
+ },
296
+ {
297
+ "epoch": 1.03,
298
+ "learning_rate": 4.980420949583945e-05,
299
+ "loss": 0.2348,
300
+ "step": 235
301
+ },
302
+ {
303
+ "epoch": 1.05,
304
+ "learning_rate": 4.9681840430739115e-05,
305
+ "loss": 0.2388,
306
+ "step": 240
307
+ },
308
+ {
309
+ "epoch": 1.08,
310
+ "learning_rate": 4.955947136563877e-05,
311
+ "loss": 0.2387,
312
+ "step": 245
313
+ },
314
+ {
315
+ "epoch": 1.1,
316
+ "learning_rate": 4.943710230053842e-05,
317
+ "loss": 0.1989,
318
+ "step": 250
319
+ },
320
+ {
321
+ "epoch": 1.12,
322
+ "learning_rate": 4.931473323543808e-05,
323
+ "loss": 0.2726,
324
+ "step": 255
325
+ },
326
+ {
327
+ "epoch": 1.14,
328
+ "learning_rate": 4.919236417033774e-05,
329
+ "loss": 0.2197,
330
+ "step": 260
331
+ },
332
+ {
333
+ "epoch": 1.16,
334
+ "learning_rate": 4.9069995105237395e-05,
335
+ "loss": 0.1965,
336
+ "step": 265
337
+ },
338
+ {
339
+ "epoch": 1.19,
340
+ "learning_rate": 4.894762604013706e-05,
341
+ "loss": 0.2256,
342
+ "step": 270
343
+ },
344
+ {
345
+ "epoch": 1.21,
346
+ "learning_rate": 4.8825256975036717e-05,
347
+ "loss": 0.2344,
348
+ "step": 275
349
+ },
350
+ {
351
+ "epoch": 1.23,
352
+ "learning_rate": 4.870288790993637e-05,
353
+ "loss": 0.208,
354
+ "step": 280
355
+ },
356
+ {
357
+ "epoch": 1.25,
358
+ "learning_rate": 4.8580518844836024e-05,
359
+ "loss": 0.2337,
360
+ "step": 285
361
+ },
362
+ {
363
+ "epoch": 1.27,
364
+ "learning_rate": 4.845814977973568e-05,
365
+ "loss": 0.2424,
366
+ "step": 290
367
+ },
368
+ {
369
+ "epoch": 1.3,
370
+ "learning_rate": 4.8335780714635346e-05,
371
+ "loss": 0.2248,
372
+ "step": 295
373
+ },
374
+ {
375
+ "epoch": 1.32,
376
+ "learning_rate": 4.8213411649535e-05,
377
+ "loss": 0.1925,
378
+ "step": 300
379
+ },
380
+ {
381
+ "epoch": 1.34,
382
+ "learning_rate": 4.809104258443466e-05,
383
+ "loss": 0.2311,
384
+ "step": 305
385
+ },
386
+ {
387
+ "epoch": 1.36,
388
+ "learning_rate": 4.796867351933432e-05,
389
+ "loss": 0.2306,
390
+ "step": 310
391
+ },
392
+ {
393
+ "epoch": 1.38,
394
+ "learning_rate": 4.784630445423397e-05,
395
+ "loss": 0.2249,
396
+ "step": 315
397
+ },
398
+ {
399
+ "epoch": 1.41,
400
+ "learning_rate": 4.7723935389133625e-05,
401
+ "loss": 0.2014,
402
+ "step": 320
403
+ },
404
+ {
405
+ "epoch": 1.43,
406
+ "learning_rate": 4.760156632403329e-05,
407
+ "loss": 0.213,
408
+ "step": 325
409
+ },
410
+ {
411
+ "epoch": 1.45,
412
+ "learning_rate": 4.747919725893295e-05,
413
+ "loss": 0.2185,
414
+ "step": 330
415
+ },
416
+ {
417
+ "epoch": 1.47,
418
+ "learning_rate": 4.7356828193832604e-05,
419
+ "loss": 0.2365,
420
+ "step": 335
421
+ },
422
+ {
423
+ "epoch": 1.49,
424
+ "learning_rate": 4.723445912873226e-05,
425
+ "loss": 0.2222,
426
+ "step": 340
427
+ },
428
+ {
429
+ "epoch": 1.51,
430
+ "learning_rate": 4.711209006363191e-05,
431
+ "loss": 0.2154,
432
+ "step": 345
433
+ },
434
+ {
435
+ "epoch": 1.54,
436
+ "learning_rate": 4.698972099853157e-05,
437
+ "loss": 0.2211,
438
+ "step": 350
439
+ },
440
+ {
441
+ "epoch": 1.56,
442
+ "learning_rate": 4.686735193343123e-05,
443
+ "loss": 0.1725,
444
+ "step": 355
445
+ },
446
+ {
447
+ "epoch": 1.58,
448
+ "learning_rate": 4.674498286833089e-05,
449
+ "loss": 0.2174,
450
+ "step": 360
451
+ },
452
+ {
453
+ "epoch": 1.6,
454
+ "learning_rate": 4.662261380323055e-05,
455
+ "loss": 0.2446,
456
+ "step": 365
457
+ },
458
+ {
459
+ "epoch": 1.62,
460
+ "learning_rate": 4.6500244738130205e-05,
461
+ "loss": 0.1818,
462
+ "step": 370
463
+ },
464
+ {
465
+ "epoch": 1.65,
466
+ "learning_rate": 4.6377875673029856e-05,
467
+ "loss": 0.214,
468
+ "step": 375
469
+ },
470
+ {
471
+ "epoch": 1.67,
472
+ "learning_rate": 4.625550660792951e-05,
473
+ "loss": 0.2328,
474
+ "step": 380
475
+ },
476
+ {
477
+ "epoch": 1.69,
478
+ "learning_rate": 4.613313754282918e-05,
479
+ "loss": 0.2407,
480
+ "step": 385
481
+ },
482
+ {
483
+ "epoch": 1.71,
484
+ "learning_rate": 4.6010768477728834e-05,
485
+ "loss": 0.1649,
486
+ "step": 390
487
+ },
488
+ {
489
+ "epoch": 1.73,
490
+ "learning_rate": 4.588839941262849e-05,
491
+ "loss": 0.2018,
492
+ "step": 395
493
+ },
494
+ {
495
+ "epoch": 1.76,
496
+ "learning_rate": 4.576603034752815e-05,
497
+ "loss": 0.2064,
498
+ "step": 400
499
+ },
500
+ {
501
+ "epoch": 1.78,
502
+ "learning_rate": 4.56436612824278e-05,
503
+ "loss": 0.1923,
504
+ "step": 405
505
+ },
506
+ {
507
+ "epoch": 1.8,
508
+ "learning_rate": 4.5521292217327464e-05,
509
+ "loss": 0.2148,
510
+ "step": 410
511
+ },
512
+ {
513
+ "epoch": 1.82,
514
+ "learning_rate": 4.539892315222712e-05,
515
+ "loss": 0.1885,
516
+ "step": 415
517
+ },
518
+ {
519
+ "epoch": 1.84,
520
+ "learning_rate": 4.527655408712678e-05,
521
+ "loss": 0.2078,
522
+ "step": 420
523
+ },
524
+ {
525
+ "epoch": 1.87,
526
+ "learning_rate": 4.5154185022026436e-05,
527
+ "loss": 0.2378,
528
+ "step": 425
529
+ },
530
+ {
531
+ "epoch": 1.89,
532
+ "learning_rate": 4.503181595692609e-05,
533
+ "loss": 0.1933,
534
+ "step": 430
535
+ },
536
+ {
537
+ "epoch": 1.91,
538
+ "learning_rate": 4.4909446891825743e-05,
539
+ "loss": 0.1607,
540
+ "step": 435
541
+ },
542
+ {
543
+ "epoch": 1.93,
544
+ "learning_rate": 4.478707782672541e-05,
545
+ "loss": 0.1923,
546
+ "step": 440
547
+ },
548
+ {
549
+ "epoch": 1.95,
550
+ "learning_rate": 4.4664708761625065e-05,
551
+ "loss": 0.1835,
552
+ "step": 445
553
+ },
554
+ {
555
+ "epoch": 1.98,
556
+ "learning_rate": 4.454233969652472e-05,
557
+ "loss": 0.1758,
558
+ "step": 450
559
+ },
560
+ {
561
+ "epoch": 2.0,
562
+ "learning_rate": 4.441997063142438e-05,
563
+ "loss": 0.2333,
564
+ "step": 455
565
+ },
566
+ {
567
+ "epoch": 2.0,
568
+ "eval_accuracy": 0.9635464936669756,
569
+ "eval_loss": 0.10080890357494354,
570
+ "eval_runtime": 6.5201,
571
+ "eval_samples_per_second": 496.466,
572
+ "eval_steps_per_second": 15.644,
573
+ "step": 455
574
+ },
575
+ {
576
+ "epoch": 2.02,
577
+ "learning_rate": 4.429760156632404e-05,
578
+ "loss": 0.1713,
579
+ "step": 460
580
+ },
581
+ {
582
+ "epoch": 2.04,
583
+ "learning_rate": 4.417523250122369e-05,
584
+ "loss": 0.1998,
585
+ "step": 465
586
+ },
587
+ {
588
+ "epoch": 2.06,
589
+ "learning_rate": 4.405286343612335e-05,
590
+ "loss": 0.1998,
591
+ "step": 470
592
+ },
593
+ {
594
+ "epoch": 2.09,
595
+ "learning_rate": 4.393049437102301e-05,
596
+ "loss": 0.1966,
597
+ "step": 475
598
+ },
599
+ {
600
+ "epoch": 2.11,
601
+ "learning_rate": 4.3808125305922666e-05,
602
+ "loss": 0.2189,
603
+ "step": 480
604
+ },
605
+ {
606
+ "epoch": 2.13,
607
+ "learning_rate": 4.368575624082232e-05,
608
+ "loss": 0.1618,
609
+ "step": 485
610
+ },
611
+ {
612
+ "epoch": 2.15,
613
+ "learning_rate": 4.356338717572198e-05,
614
+ "loss": 0.1521,
615
+ "step": 490
616
+ },
617
+ {
618
+ "epoch": 2.17,
619
+ "learning_rate": 4.344101811062164e-05,
620
+ "loss": 0.1753,
621
+ "step": 495
622
+ },
623
+ {
624
+ "epoch": 2.2,
625
+ "learning_rate": 4.3318649045521295e-05,
626
+ "loss": 0.1915,
627
+ "step": 500
628
+ },
629
+ {
630
+ "epoch": 2.22,
631
+ "learning_rate": 4.319627998042095e-05,
632
+ "loss": 0.2248,
633
+ "step": 505
634
+ },
635
+ {
636
+ "epoch": 2.24,
637
+ "learning_rate": 4.307391091532061e-05,
638
+ "loss": 0.1692,
639
+ "step": 510
640
+ },
641
+ {
642
+ "epoch": 2.26,
643
+ "learning_rate": 4.295154185022027e-05,
644
+ "loss": 0.1832,
645
+ "step": 515
646
+ },
647
+ {
648
+ "epoch": 2.28,
649
+ "learning_rate": 4.2829172785119924e-05,
650
+ "loss": 0.2099,
651
+ "step": 520
652
+ },
653
+ {
654
+ "epoch": 2.31,
655
+ "learning_rate": 4.270680372001958e-05,
656
+ "loss": 0.2225,
657
+ "step": 525
658
+ },
659
+ {
660
+ "epoch": 2.33,
661
+ "learning_rate": 4.258443465491924e-05,
662
+ "loss": 0.1982,
663
+ "step": 530
664
+ },
665
+ {
666
+ "epoch": 2.35,
667
+ "learning_rate": 4.2462065589818896e-05,
668
+ "loss": 0.1538,
669
+ "step": 535
670
+ },
671
+ {
672
+ "epoch": 2.37,
673
+ "learning_rate": 4.2339696524718554e-05,
674
+ "loss": 0.2139,
675
+ "step": 540
676
+ },
677
+ {
678
+ "epoch": 2.39,
679
+ "learning_rate": 4.221732745961821e-05,
680
+ "loss": 0.1922,
681
+ "step": 545
682
+ },
683
+ {
684
+ "epoch": 2.41,
685
+ "learning_rate": 4.209495839451787e-05,
686
+ "loss": 0.182,
687
+ "step": 550
688
+ },
689
+ {
690
+ "epoch": 2.44,
691
+ "learning_rate": 4.1972589329417525e-05,
692
+ "loss": 0.197,
693
+ "step": 555
694
+ },
695
+ {
696
+ "epoch": 2.46,
697
+ "learning_rate": 4.185022026431718e-05,
698
+ "loss": 0.2057,
699
+ "step": 560
700
+ },
701
+ {
702
+ "epoch": 2.48,
703
+ "learning_rate": 4.172785119921684e-05,
704
+ "loss": 0.1773,
705
+ "step": 565
706
+ },
707
+ {
708
+ "epoch": 2.5,
709
+ "learning_rate": 4.16054821341165e-05,
710
+ "loss": 0.171,
711
+ "step": 570
712
+ },
713
+ {
714
+ "epoch": 2.52,
715
+ "learning_rate": 4.1483113069016155e-05,
716
+ "loss": 0.1484,
717
+ "step": 575
718
+ },
719
+ {
720
+ "epoch": 2.55,
721
+ "learning_rate": 4.136074400391581e-05,
722
+ "loss": 0.1552,
723
+ "step": 580
724
+ },
725
+ {
726
+ "epoch": 2.57,
727
+ "learning_rate": 4.123837493881547e-05,
728
+ "loss": 0.1449,
729
+ "step": 585
730
+ },
731
+ {
732
+ "epoch": 2.59,
733
+ "learning_rate": 4.1116005873715127e-05,
734
+ "loss": 0.2022,
735
+ "step": 590
736
+ },
737
+ {
738
+ "epoch": 2.61,
739
+ "learning_rate": 4.0993636808614784e-05,
740
+ "loss": 0.1795,
741
+ "step": 595
742
+ },
743
+ {
744
+ "epoch": 2.63,
745
+ "learning_rate": 4.087126774351444e-05,
746
+ "loss": 0.1998,
747
+ "step": 600
748
+ },
749
+ {
750
+ "epoch": 2.66,
751
+ "learning_rate": 4.07488986784141e-05,
752
+ "loss": 0.1796,
753
+ "step": 605
754
+ },
755
+ {
756
+ "epoch": 2.68,
757
+ "learning_rate": 4.0626529613313756e-05,
758
+ "loss": 0.1975,
759
+ "step": 610
760
+ },
761
+ {
762
+ "epoch": 2.7,
763
+ "learning_rate": 4.050416054821341e-05,
764
+ "loss": 0.1638,
765
+ "step": 615
766
+ },
767
+ {
768
+ "epoch": 2.72,
769
+ "learning_rate": 4.038179148311307e-05,
770
+ "loss": 0.2266,
771
+ "step": 620
772
+ },
773
+ {
774
+ "epoch": 2.74,
775
+ "learning_rate": 4.025942241801273e-05,
776
+ "loss": 0.1445,
777
+ "step": 625
778
+ },
779
+ {
780
+ "epoch": 2.77,
781
+ "learning_rate": 4.0137053352912385e-05,
782
+ "loss": 0.1611,
783
+ "step": 630
784
+ },
785
+ {
786
+ "epoch": 2.79,
787
+ "learning_rate": 4.001468428781204e-05,
788
+ "loss": 0.132,
789
+ "step": 635
790
+ },
791
+ {
792
+ "epoch": 2.81,
793
+ "learning_rate": 3.98923152227117e-05,
794
+ "loss": 0.1867,
795
+ "step": 640
796
+ },
797
+ {
798
+ "epoch": 2.83,
799
+ "learning_rate": 3.976994615761136e-05,
800
+ "loss": 0.1607,
801
+ "step": 645
802
+ },
803
+ {
804
+ "epoch": 2.85,
805
+ "learning_rate": 3.9647577092511014e-05,
806
+ "loss": 0.1225,
807
+ "step": 650
808
+ },
809
+ {
810
+ "epoch": 2.88,
811
+ "learning_rate": 3.952520802741067e-05,
812
+ "loss": 0.1748,
813
+ "step": 655
814
+ },
815
+ {
816
+ "epoch": 2.9,
817
+ "learning_rate": 3.940283896231033e-05,
818
+ "loss": 0.1689,
819
+ "step": 660
820
+ },
821
+ {
822
+ "epoch": 2.92,
823
+ "learning_rate": 3.9280469897209986e-05,
824
+ "loss": 0.1475,
825
+ "step": 665
826
+ },
827
+ {
828
+ "epoch": 2.94,
829
+ "learning_rate": 3.915810083210964e-05,
830
+ "loss": 0.1205,
831
+ "step": 670
832
+ },
833
+ {
834
+ "epoch": 2.96,
835
+ "learning_rate": 3.90357317670093e-05,
836
+ "loss": 0.1689,
837
+ "step": 675
838
+ },
839
+ {
840
+ "epoch": 2.99,
841
+ "learning_rate": 3.8913362701908965e-05,
842
+ "loss": 0.1977,
843
+ "step": 680
844
+ },
845
+ {
846
+ "epoch": 3.0,
847
+ "eval_accuracy": 0.9703429101019463,
848
+ "eval_loss": 0.08545960485935211,
849
+ "eval_runtime": 6.4859,
850
+ "eval_samples_per_second": 499.084,
851
+ "eval_steps_per_second": 15.726,
852
+ "step": 683
853
+ },
854
+ {
855
+ "epoch": 3.01,
856
+ "learning_rate": 3.8790993636808615e-05,
857
+ "loss": 0.1616,
858
+ "step": 685
859
+ },
860
+ {
861
+ "epoch": 3.03,
862
+ "learning_rate": 3.866862457170827e-05,
863
+ "loss": 0.1489,
864
+ "step": 690
865
+ },
866
+ {
867
+ "epoch": 3.05,
868
+ "learning_rate": 3.854625550660793e-05,
869
+ "loss": 0.1394,
870
+ "step": 695
871
+ },
872
+ {
873
+ "epoch": 3.07,
874
+ "learning_rate": 3.842388644150759e-05,
875
+ "loss": 0.1451,
876
+ "step": 700
877
+ },
878
+ {
879
+ "epoch": 3.1,
880
+ "learning_rate": 3.8301517376407244e-05,
881
+ "loss": 0.1603,
882
+ "step": 705
883
+ },
884
+ {
885
+ "epoch": 3.12,
886
+ "learning_rate": 3.817914831130691e-05,
887
+ "loss": 0.1511,
888
+ "step": 710
889
+ },
890
+ {
891
+ "epoch": 3.14,
892
+ "learning_rate": 3.805677924620656e-05,
893
+ "loss": 0.1835,
894
+ "step": 715
895
+ },
896
+ {
897
+ "epoch": 3.16,
898
+ "learning_rate": 3.7934410181106216e-05,
899
+ "loss": 0.1328,
900
+ "step": 720
901
+ },
902
+ {
903
+ "epoch": 3.18,
904
+ "learning_rate": 3.7812041116005874e-05,
905
+ "loss": 0.1751,
906
+ "step": 725
907
+ },
908
+ {
909
+ "epoch": 3.21,
910
+ "learning_rate": 3.768967205090553e-05,
911
+ "loss": 0.1914,
912
+ "step": 730
913
+ },
914
+ {
915
+ "epoch": 3.23,
916
+ "learning_rate": 3.7567302985805195e-05,
917
+ "loss": 0.1538,
918
+ "step": 735
919
+ },
920
+ {
921
+ "epoch": 3.25,
922
+ "learning_rate": 3.744493392070485e-05,
923
+ "loss": 0.149,
924
+ "step": 740
925
+ },
926
+ {
927
+ "epoch": 3.27,
928
+ "learning_rate": 3.73225648556045e-05,
929
+ "loss": 0.1764,
930
+ "step": 745
931
+ },
932
+ {
933
+ "epoch": 3.29,
934
+ "learning_rate": 3.720019579050416e-05,
935
+ "loss": 0.2057,
936
+ "step": 750
937
+ },
938
+ {
939
+ "epoch": 3.32,
940
+ "learning_rate": 3.707782672540382e-05,
941
+ "loss": 0.155,
942
+ "step": 755
943
+ },
944
+ {
945
+ "epoch": 3.34,
946
+ "learning_rate": 3.6955457660303475e-05,
947
+ "loss": 0.1523,
948
+ "step": 760
949
+ },
950
+ {
951
+ "epoch": 3.36,
952
+ "learning_rate": 3.683308859520314e-05,
953
+ "loss": 0.1561,
954
+ "step": 765
955
+ },
956
+ {
957
+ "epoch": 3.38,
958
+ "learning_rate": 3.6710719530102796e-05,
959
+ "loss": 0.1758,
960
+ "step": 770
961
+ },
962
+ {
963
+ "epoch": 3.4,
964
+ "learning_rate": 3.658835046500245e-05,
965
+ "loss": 0.1538,
966
+ "step": 775
967
+ },
968
+ {
969
+ "epoch": 3.42,
970
+ "learning_rate": 3.6465981399902104e-05,
971
+ "loss": 0.1882,
972
+ "step": 780
973
+ },
974
+ {
975
+ "epoch": 3.45,
976
+ "learning_rate": 3.634361233480176e-05,
977
+ "loss": 0.1073,
978
+ "step": 785
979
+ },
980
+ {
981
+ "epoch": 3.47,
982
+ "learning_rate": 3.622124326970142e-05,
983
+ "loss": 0.1692,
984
+ "step": 790
985
+ },
986
+ {
987
+ "epoch": 3.49,
988
+ "learning_rate": 3.609887420460108e-05,
989
+ "loss": 0.1762,
990
+ "step": 795
991
+ },
992
+ {
993
+ "epoch": 3.51,
994
+ "learning_rate": 3.597650513950074e-05,
995
+ "loss": 0.1598,
996
+ "step": 800
997
+ },
998
+ {
999
+ "epoch": 3.53,
1000
+ "learning_rate": 3.585413607440039e-05,
1001
+ "loss": 0.1442,
1002
+ "step": 805
1003
+ },
1004
+ {
1005
+ "epoch": 3.56,
1006
+ "learning_rate": 3.573176700930005e-05,
1007
+ "loss": 0.1359,
1008
+ "step": 810
1009
+ },
1010
+ {
1011
+ "epoch": 3.58,
1012
+ "learning_rate": 3.5609397944199705e-05,
1013
+ "loss": 0.1585,
1014
+ "step": 815
1015
+ },
1016
+ {
1017
+ "epoch": 3.6,
1018
+ "learning_rate": 3.548702887909936e-05,
1019
+ "loss": 0.2017,
1020
+ "step": 820
1021
+ },
1022
+ {
1023
+ "epoch": 3.62,
1024
+ "learning_rate": 3.5364659813999026e-05,
1025
+ "loss": 0.1459,
1026
+ "step": 825
1027
+ },
1028
+ {
1029
+ "epoch": 3.64,
1030
+ "learning_rate": 3.5242290748898684e-05,
1031
+ "loss": 0.1096,
1032
+ "step": 830
1033
+ },
1034
+ {
1035
+ "epoch": 3.67,
1036
+ "learning_rate": 3.5119921683798334e-05,
1037
+ "loss": 0.1507,
1038
+ "step": 835
1039
+ },
1040
+ {
1041
+ "epoch": 3.69,
1042
+ "learning_rate": 3.499755261869799e-05,
1043
+ "loss": 0.1366,
1044
+ "step": 840
1045
+ },
1046
+ {
1047
+ "epoch": 3.71,
1048
+ "learning_rate": 3.487518355359765e-05,
1049
+ "loss": 0.1524,
1050
+ "step": 845
1051
+ },
1052
+ {
1053
+ "epoch": 3.73,
1054
+ "learning_rate": 3.4752814488497306e-05,
1055
+ "loss": 0.1505,
1056
+ "step": 850
1057
+ },
1058
+ {
1059
+ "epoch": 3.75,
1060
+ "learning_rate": 3.463044542339697e-05,
1061
+ "loss": 0.1553,
1062
+ "step": 855
1063
+ },
1064
+ {
1065
+ "epoch": 3.78,
1066
+ "learning_rate": 3.450807635829663e-05,
1067
+ "loss": 0.1373,
1068
+ "step": 860
1069
+ },
1070
+ {
1071
+ "epoch": 3.8,
1072
+ "learning_rate": 3.4385707293196285e-05,
1073
+ "loss": 0.139,
1074
+ "step": 865
1075
+ },
1076
+ {
1077
+ "epoch": 3.82,
1078
+ "learning_rate": 3.4263338228095935e-05,
1079
+ "loss": 0.1482,
1080
+ "step": 870
1081
+ },
1082
+ {
1083
+ "epoch": 3.84,
1084
+ "learning_rate": 3.414096916299559e-05,
1085
+ "loss": 0.1684,
1086
+ "step": 875
1087
+ },
1088
+ {
1089
+ "epoch": 3.86,
1090
+ "learning_rate": 3.401860009789526e-05,
1091
+ "loss": 0.2081,
1092
+ "step": 880
1093
+ },
1094
+ {
1095
+ "epoch": 3.89,
1096
+ "learning_rate": 3.3896231032794914e-05,
1097
+ "loss": 0.1652,
1098
+ "step": 885
1099
+ },
1100
+ {
1101
+ "epoch": 3.91,
1102
+ "learning_rate": 3.377386196769457e-05,
1103
+ "loss": 0.1833,
1104
+ "step": 890
1105
+ },
1106
+ {
1107
+ "epoch": 3.93,
1108
+ "learning_rate": 3.365149290259423e-05,
1109
+ "loss": 0.1532,
1110
+ "step": 895
1111
+ },
1112
+ {
1113
+ "epoch": 3.95,
1114
+ "learning_rate": 3.352912383749388e-05,
1115
+ "loss": 0.1541,
1116
+ "step": 900
1117
+ },
1118
+ {
1119
+ "epoch": 3.97,
1120
+ "learning_rate": 3.3406754772393536e-05,
1121
+ "loss": 0.1298,
1122
+ "step": 905
1123
+ },
1124
+ {
1125
+ "epoch": 4.0,
1126
+ "learning_rate": 3.32843857072932e-05,
1127
+ "loss": 0.1405,
1128
+ "step": 910
1129
+ },
1130
+ {
1131
+ "epoch": 4.0,
1132
+ "eval_accuracy": 0.9743589743589743,
1133
+ "eval_loss": 0.07923375070095062,
1134
+ "eval_runtime": 6.6056,
1135
+ "eval_samples_per_second": 490.041,
1136
+ "eval_steps_per_second": 15.442,
1137
+ "step": 911
1138
+ },
1139
+ {
1140
+ "epoch": 4.02,
1141
+ "learning_rate": 3.316201664219286e-05,
1142
+ "loss": 0.1584,
1143
+ "step": 915
1144
+ },
1145
+ {
1146
+ "epoch": 4.04,
1147
+ "learning_rate": 3.3039647577092515e-05,
1148
+ "loss": 0.1504,
1149
+ "step": 920
1150
+ },
1151
+ {
1152
+ "epoch": 4.06,
1153
+ "learning_rate": 3.291727851199217e-05,
1154
+ "loss": 0.1893,
1155
+ "step": 925
1156
+ },
1157
+ {
1158
+ "epoch": 4.08,
1159
+ "learning_rate": 3.279490944689182e-05,
1160
+ "loss": 0.1496,
1161
+ "step": 930
1162
+ },
1163
+ {
1164
+ "epoch": 4.11,
1165
+ "learning_rate": 3.267254038179148e-05,
1166
+ "loss": 0.1576,
1167
+ "step": 935
1168
+ },
1169
+ {
1170
+ "epoch": 4.13,
1171
+ "learning_rate": 3.2550171316691144e-05,
1172
+ "loss": 0.1291,
1173
+ "step": 940
1174
+ },
1175
+ {
1176
+ "epoch": 4.15,
1177
+ "learning_rate": 3.24278022515908e-05,
1178
+ "loss": 0.146,
1179
+ "step": 945
1180
+ },
1181
+ {
1182
+ "epoch": 4.17,
1183
+ "learning_rate": 3.230543318649046e-05,
1184
+ "loss": 0.134,
1185
+ "step": 950
1186
+ },
1187
+ {
1188
+ "epoch": 4.19,
1189
+ "learning_rate": 3.2183064121390116e-05,
1190
+ "loss": 0.1643,
1191
+ "step": 955
1192
+ },
1193
+ {
1194
+ "epoch": 4.22,
1195
+ "learning_rate": 3.206069505628977e-05,
1196
+ "loss": 0.1453,
1197
+ "step": 960
1198
+ },
1199
+ {
1200
+ "epoch": 4.24,
1201
+ "learning_rate": 3.1938325991189424e-05,
1202
+ "loss": 0.1635,
1203
+ "step": 965
1204
+ },
1205
+ {
1206
+ "epoch": 4.26,
1207
+ "learning_rate": 3.181595692608909e-05,
1208
+ "loss": 0.1194,
1209
+ "step": 970
1210
+ },
1211
+ {
1212
+ "epoch": 4.28,
1213
+ "learning_rate": 3.1693587860988745e-05,
1214
+ "loss": 0.1532,
1215
+ "step": 975
1216
+ },
1217
+ {
1218
+ "epoch": 4.3,
1219
+ "learning_rate": 3.15712187958884e-05,
1220
+ "loss": 0.1838,
1221
+ "step": 980
1222
+ },
1223
+ {
1224
+ "epoch": 4.32,
1225
+ "learning_rate": 3.144884973078806e-05,
1226
+ "loss": 0.1468,
1227
+ "step": 985
1228
+ },
1229
+ {
1230
+ "epoch": 4.35,
1231
+ "learning_rate": 3.132648066568771e-05,
1232
+ "loss": 0.1203,
1233
+ "step": 990
1234
+ },
1235
+ {
1236
+ "epoch": 4.37,
1237
+ "learning_rate": 3.120411160058737e-05,
1238
+ "loss": 0.1789,
1239
+ "step": 995
1240
+ },
1241
+ {
1242
+ "epoch": 4.39,
1243
+ "learning_rate": 3.108174253548703e-05,
1244
+ "loss": 0.1781,
1245
+ "step": 1000
1246
+ },
1247
+ {
1248
+ "epoch": 4.41,
1249
+ "learning_rate": 3.095937347038669e-05,
1250
+ "loss": 0.1299,
1251
+ "step": 1005
1252
+ },
1253
+ {
1254
+ "epoch": 4.43,
1255
+ "learning_rate": 3.0837004405286347e-05,
1256
+ "loss": 0.1647,
1257
+ "step": 1010
1258
+ },
1259
+ {
1260
+ "epoch": 4.46,
1261
+ "learning_rate": 3.0714635340186004e-05,
1262
+ "loss": 0.1811,
1263
+ "step": 1015
1264
+ },
1265
+ {
1266
+ "epoch": 4.48,
1267
+ "learning_rate": 3.059226627508566e-05,
1268
+ "loss": 0.1386,
1269
+ "step": 1020
1270
+ },
1271
+ {
1272
+ "epoch": 4.5,
1273
+ "learning_rate": 3.0469897209985315e-05,
1274
+ "loss": 0.1465,
1275
+ "step": 1025
1276
+ },
1277
+ {
1278
+ "epoch": 4.52,
1279
+ "learning_rate": 3.0347528144884972e-05,
1280
+ "loss": 0.1469,
1281
+ "step": 1030
1282
+ },
1283
+ {
1284
+ "epoch": 4.54,
1285
+ "learning_rate": 3.0225159079784633e-05,
1286
+ "loss": 0.1381,
1287
+ "step": 1035
1288
+ },
1289
+ {
1290
+ "epoch": 4.57,
1291
+ "learning_rate": 3.010279001468429e-05,
1292
+ "loss": 0.1184,
1293
+ "step": 1040
1294
+ },
1295
+ {
1296
+ "epoch": 4.59,
1297
+ "learning_rate": 2.9980420949583948e-05,
1298
+ "loss": 0.1596,
1299
+ "step": 1045
1300
+ },
1301
+ {
1302
+ "epoch": 4.61,
1303
+ "learning_rate": 2.9858051884483605e-05,
1304
+ "loss": 0.1305,
1305
+ "step": 1050
1306
+ },
1307
+ {
1308
+ "epoch": 4.63,
1309
+ "learning_rate": 2.973568281938326e-05,
1310
+ "loss": 0.1487,
1311
+ "step": 1055
1312
+ },
1313
+ {
1314
+ "epoch": 4.65,
1315
+ "learning_rate": 2.9613313754282916e-05,
1316
+ "loss": 0.1359,
1317
+ "step": 1060
1318
+ },
1319
+ {
1320
+ "epoch": 4.68,
1321
+ "learning_rate": 2.9490944689182577e-05,
1322
+ "loss": 0.1238,
1323
+ "step": 1065
1324
+ },
1325
+ {
1326
+ "epoch": 4.7,
1327
+ "learning_rate": 2.9368575624082234e-05,
1328
+ "loss": 0.1322,
1329
+ "step": 1070
1330
+ },
1331
+ {
1332
+ "epoch": 4.72,
1333
+ "learning_rate": 2.924620655898189e-05,
1334
+ "loss": 0.1385,
1335
+ "step": 1075
1336
+ },
1337
+ {
1338
+ "epoch": 4.74,
1339
+ "learning_rate": 2.9123837493881552e-05,
1340
+ "loss": 0.1432,
1341
+ "step": 1080
1342
+ },
1343
+ {
1344
+ "epoch": 4.76,
1345
+ "learning_rate": 2.9001468428781203e-05,
1346
+ "loss": 0.1494,
1347
+ "step": 1085
1348
+ },
1349
+ {
1350
+ "epoch": 4.79,
1351
+ "learning_rate": 2.887909936368086e-05,
1352
+ "loss": 0.1475,
1353
+ "step": 1090
1354
+ },
1355
+ {
1356
+ "epoch": 4.81,
1357
+ "learning_rate": 2.875673029858052e-05,
1358
+ "loss": 0.1282,
1359
+ "step": 1095
1360
+ },
1361
+ {
1362
+ "epoch": 4.83,
1363
+ "learning_rate": 2.8634361233480178e-05,
1364
+ "loss": 0.1606,
1365
+ "step": 1100
1366
+ },
1367
+ {
1368
+ "epoch": 4.85,
1369
+ "learning_rate": 2.8511992168379835e-05,
1370
+ "loss": 0.1333,
1371
+ "step": 1105
1372
+ },
1373
+ {
1374
+ "epoch": 4.87,
1375
+ "learning_rate": 2.8389623103279496e-05,
1376
+ "loss": 0.1556,
1377
+ "step": 1110
1378
+ },
1379
+ {
1380
+ "epoch": 4.9,
1381
+ "learning_rate": 2.8267254038179147e-05,
1382
+ "loss": 0.1432,
1383
+ "step": 1115
1384
+ },
1385
+ {
1386
+ "epoch": 4.92,
1387
+ "learning_rate": 2.8144884973078807e-05,
1388
+ "loss": 0.1776,
1389
+ "step": 1120
1390
+ },
1391
+ {
1392
+ "epoch": 4.94,
1393
+ "learning_rate": 2.8022515907978465e-05,
1394
+ "loss": 0.1029,
1395
+ "step": 1125
1396
+ },
1397
+ {
1398
+ "epoch": 4.96,
1399
+ "learning_rate": 2.7900146842878122e-05,
1400
+ "loss": 0.1382,
1401
+ "step": 1130
1402
+ },
1403
+ {
1404
+ "epoch": 4.98,
1405
+ "learning_rate": 2.777777777777778e-05,
1406
+ "loss": 0.1575,
1407
+ "step": 1135
1408
+ },
1409
+ {
1410
+ "epoch": 5.0,
1411
+ "eval_accuracy": 0.9731232622798888,
1412
+ "eval_loss": 0.07335282117128372,
1413
+ "eval_runtime": 6.4806,
1414
+ "eval_samples_per_second": 499.488,
1415
+ "eval_steps_per_second": 15.739,
1416
+ "step": 1138
1417
+ },
1418
+ {
1419
+ "epoch": 5.01,
1420
+ "learning_rate": 2.765540871267744e-05,
1421
+ "loss": 0.1558,
1422
+ "step": 1140
1423
+ },
1424
+ {
1425
+ "epoch": 5.03,
1426
+ "learning_rate": 2.753303964757709e-05,
1427
+ "loss": 0.144,
1428
+ "step": 1145
1429
+ },
1430
+ {
1431
+ "epoch": 5.05,
1432
+ "learning_rate": 2.741067058247675e-05,
1433
+ "loss": 0.1474,
1434
+ "step": 1150
1435
+ },
1436
+ {
1437
+ "epoch": 5.07,
1438
+ "learning_rate": 2.728830151737641e-05,
1439
+ "loss": 0.1373,
1440
+ "step": 1155
1441
+ },
1442
+ {
1443
+ "epoch": 5.09,
1444
+ "learning_rate": 2.7165932452276066e-05,
1445
+ "loss": 0.0985,
1446
+ "step": 1160
1447
+ },
1448
+ {
1449
+ "epoch": 5.12,
1450
+ "learning_rate": 2.7043563387175723e-05,
1451
+ "loss": 0.1163,
1452
+ "step": 1165
1453
+ },
1454
+ {
1455
+ "epoch": 5.14,
1456
+ "learning_rate": 2.6921194322075384e-05,
1457
+ "loss": 0.157,
1458
+ "step": 1170
1459
+ },
1460
+ {
1461
+ "epoch": 5.16,
1462
+ "learning_rate": 2.6798825256975034e-05,
1463
+ "loss": 0.1345,
1464
+ "step": 1175
1465
+ },
1466
+ {
1467
+ "epoch": 5.18,
1468
+ "learning_rate": 2.6676456191874695e-05,
1469
+ "loss": 0.1588,
1470
+ "step": 1180
1471
+ },
1472
+ {
1473
+ "epoch": 5.2,
1474
+ "learning_rate": 2.6554087126774352e-05,
1475
+ "loss": 0.1693,
1476
+ "step": 1185
1477
+ },
1478
+ {
1479
+ "epoch": 5.23,
1480
+ "learning_rate": 2.643171806167401e-05,
1481
+ "loss": 0.1348,
1482
+ "step": 1190
1483
+ },
1484
+ {
1485
+ "epoch": 5.25,
1486
+ "learning_rate": 2.6309348996573667e-05,
1487
+ "loss": 0.1255,
1488
+ "step": 1195
1489
+ },
1490
+ {
1491
+ "epoch": 5.27,
1492
+ "learning_rate": 2.6186979931473327e-05,
1493
+ "loss": 0.1401,
1494
+ "step": 1200
1495
+ },
1496
+ {
1497
+ "epoch": 5.29,
1498
+ "learning_rate": 2.6064610866372985e-05,
1499
+ "loss": 0.1517,
1500
+ "step": 1205
1501
+ },
1502
+ {
1503
+ "epoch": 5.31,
1504
+ "learning_rate": 2.594224180127264e-05,
1505
+ "loss": 0.1031,
1506
+ "step": 1210
1507
+ },
1508
+ {
1509
+ "epoch": 5.33,
1510
+ "learning_rate": 2.5819872736172296e-05,
1511
+ "loss": 0.1127,
1512
+ "step": 1215
1513
+ },
1514
+ {
1515
+ "epoch": 5.36,
1516
+ "learning_rate": 2.5697503671071953e-05,
1517
+ "loss": 0.1389,
1518
+ "step": 1220
1519
+ },
1520
+ {
1521
+ "epoch": 5.38,
1522
+ "learning_rate": 2.5575134605971614e-05,
1523
+ "loss": 0.1207,
1524
+ "step": 1225
1525
+ },
1526
+ {
1527
+ "epoch": 5.4,
1528
+ "learning_rate": 2.545276554087127e-05,
1529
+ "loss": 0.1462,
1530
+ "step": 1230
1531
+ },
1532
+ {
1533
+ "epoch": 5.42,
1534
+ "learning_rate": 2.533039647577093e-05,
1535
+ "loss": 0.13,
1536
+ "step": 1235
1537
+ },
1538
+ {
1539
+ "epoch": 5.44,
1540
+ "learning_rate": 2.5208027410670582e-05,
1541
+ "loss": 0.1039,
1542
+ "step": 1240
1543
+ },
1544
+ {
1545
+ "epoch": 5.47,
1546
+ "learning_rate": 2.508565834557024e-05,
1547
+ "loss": 0.1208,
1548
+ "step": 1245
1549
+ },
1550
+ {
1551
+ "epoch": 5.49,
1552
+ "learning_rate": 2.4963289280469897e-05,
1553
+ "loss": 0.153,
1554
+ "step": 1250
1555
+ },
1556
+ {
1557
+ "epoch": 5.51,
1558
+ "learning_rate": 2.4840920215369558e-05,
1559
+ "loss": 0.17,
1560
+ "step": 1255
1561
+ },
1562
+ {
1563
+ "epoch": 5.53,
1564
+ "learning_rate": 2.471855115026921e-05,
1565
+ "loss": 0.1431,
1566
+ "step": 1260
1567
+ },
1568
+ {
1569
+ "epoch": 5.55,
1570
+ "learning_rate": 2.459618208516887e-05,
1571
+ "loss": 0.1625,
1572
+ "step": 1265
1573
+ },
1574
+ {
1575
+ "epoch": 5.58,
1576
+ "learning_rate": 2.447381302006853e-05,
1577
+ "loss": 0.1591,
1578
+ "step": 1270
1579
+ },
1580
+ {
1581
+ "epoch": 5.6,
1582
+ "learning_rate": 2.4351443954968184e-05,
1583
+ "loss": 0.1123,
1584
+ "step": 1275
1585
+ },
1586
+ {
1587
+ "epoch": 5.62,
1588
+ "learning_rate": 2.422907488986784e-05,
1589
+ "loss": 0.1296,
1590
+ "step": 1280
1591
+ },
1592
+ {
1593
+ "epoch": 5.64,
1594
+ "learning_rate": 2.41067058247675e-05,
1595
+ "loss": 0.0822,
1596
+ "step": 1285
1597
+ },
1598
+ {
1599
+ "epoch": 5.66,
1600
+ "learning_rate": 2.398433675966716e-05,
1601
+ "loss": 0.1461,
1602
+ "step": 1290
1603
+ },
1604
+ {
1605
+ "epoch": 5.69,
1606
+ "learning_rate": 2.3861967694566813e-05,
1607
+ "loss": 0.1157,
1608
+ "step": 1295
1609
+ },
1610
+ {
1611
+ "epoch": 5.71,
1612
+ "learning_rate": 2.3739598629466473e-05,
1613
+ "loss": 0.1121,
1614
+ "step": 1300
1615
+ },
1616
+ {
1617
+ "epoch": 5.73,
1618
+ "learning_rate": 2.361722956436613e-05,
1619
+ "loss": 0.1568,
1620
+ "step": 1305
1621
+ },
1622
+ {
1623
+ "epoch": 5.75,
1624
+ "learning_rate": 2.3494860499265785e-05,
1625
+ "loss": 0.1053,
1626
+ "step": 1310
1627
+ },
1628
+ {
1629
+ "epoch": 5.77,
1630
+ "learning_rate": 2.3372491434165445e-05,
1631
+ "loss": 0.1678,
1632
+ "step": 1315
1633
+ },
1634
+ {
1635
+ "epoch": 5.8,
1636
+ "learning_rate": 2.3250122369065103e-05,
1637
+ "loss": 0.1168,
1638
+ "step": 1320
1639
+ },
1640
+ {
1641
+ "epoch": 5.82,
1642
+ "learning_rate": 2.3127753303964757e-05,
1643
+ "loss": 0.1282,
1644
+ "step": 1325
1645
+ },
1646
+ {
1647
+ "epoch": 5.84,
1648
+ "learning_rate": 2.3005384238864417e-05,
1649
+ "loss": 0.1203,
1650
+ "step": 1330
1651
+ },
1652
+ {
1653
+ "epoch": 5.86,
1654
+ "learning_rate": 2.2883015173764075e-05,
1655
+ "loss": 0.1521,
1656
+ "step": 1335
1657
+ },
1658
+ {
1659
+ "epoch": 5.88,
1660
+ "learning_rate": 2.2760646108663732e-05,
1661
+ "loss": 0.138,
1662
+ "step": 1340
1663
+ },
1664
+ {
1665
+ "epoch": 5.91,
1666
+ "learning_rate": 2.263827704356339e-05,
1667
+ "loss": 0.1253,
1668
+ "step": 1345
1669
+ },
1670
+ {
1671
+ "epoch": 5.93,
1672
+ "learning_rate": 2.2515907978463046e-05,
1673
+ "loss": 0.1716,
1674
+ "step": 1350
1675
+ },
1676
+ {
1677
+ "epoch": 5.95,
1678
+ "learning_rate": 2.2393538913362704e-05,
1679
+ "loss": 0.1308,
1680
+ "step": 1355
1681
+ },
1682
+ {
1683
+ "epoch": 5.97,
1684
+ "learning_rate": 2.227116984826236e-05,
1685
+ "loss": 0.0879,
1686
+ "step": 1360
1687
+ },
1688
+ {
1689
+ "epoch": 5.99,
1690
+ "learning_rate": 2.214880078316202e-05,
1691
+ "loss": 0.0948,
1692
+ "step": 1365
1693
+ },
1694
+ {
1695
+ "epoch": 6.0,
1696
+ "eval_accuracy": 0.9777571825764597,
1697
+ "eval_loss": 0.0665615126490593,
1698
+ "eval_runtime": 6.5547,
1699
+ "eval_samples_per_second": 493.844,
1700
+ "eval_steps_per_second": 15.561,
1701
+ "step": 1366
1702
+ },
1703
+ {
1704
+ "epoch": 6.02,
1705
+ "learning_rate": 2.2026431718061676e-05,
1706
+ "loss": 0.1124,
1707
+ "step": 1370
1708
+ },
1709
+ {
1710
+ "epoch": 6.04,
1711
+ "learning_rate": 2.1904062652961333e-05,
1712
+ "loss": 0.1582,
1713
+ "step": 1375
1714
+ },
1715
+ {
1716
+ "epoch": 6.06,
1717
+ "learning_rate": 2.178169358786099e-05,
1718
+ "loss": 0.1109,
1719
+ "step": 1380
1720
+ },
1721
+ {
1722
+ "epoch": 6.08,
1723
+ "learning_rate": 2.1659324522760648e-05,
1724
+ "loss": 0.1194,
1725
+ "step": 1385
1726
+ },
1727
+ {
1728
+ "epoch": 6.1,
1729
+ "learning_rate": 2.1536955457660305e-05,
1730
+ "loss": 0.1148,
1731
+ "step": 1390
1732
+ },
1733
+ {
1734
+ "epoch": 6.13,
1735
+ "learning_rate": 2.1414586392559962e-05,
1736
+ "loss": 0.1465,
1737
+ "step": 1395
1738
+ },
1739
+ {
1740
+ "epoch": 6.15,
1741
+ "learning_rate": 2.129221732745962e-05,
1742
+ "loss": 0.0916,
1743
+ "step": 1400
1744
+ },
1745
+ {
1746
+ "epoch": 6.17,
1747
+ "learning_rate": 2.1169848262359277e-05,
1748
+ "loss": 0.1426,
1749
+ "step": 1405
1750
+ },
1751
+ {
1752
+ "epoch": 6.19,
1753
+ "learning_rate": 2.1047479197258934e-05,
1754
+ "loss": 0.0786,
1755
+ "step": 1410
1756
+ },
1757
+ {
1758
+ "epoch": 6.21,
1759
+ "learning_rate": 2.092511013215859e-05,
1760
+ "loss": 0.1473,
1761
+ "step": 1415
1762
+ },
1763
+ {
1764
+ "epoch": 6.23,
1765
+ "learning_rate": 2.080274106705825e-05,
1766
+ "loss": 0.1174,
1767
+ "step": 1420
1768
+ },
1769
+ {
1770
+ "epoch": 6.26,
1771
+ "learning_rate": 2.0680372001957906e-05,
1772
+ "loss": 0.0798,
1773
+ "step": 1425
1774
+ },
1775
+ {
1776
+ "epoch": 6.28,
1777
+ "learning_rate": 2.0558002936857563e-05,
1778
+ "loss": 0.1626,
1779
+ "step": 1430
1780
+ },
1781
+ {
1782
+ "epoch": 6.3,
1783
+ "learning_rate": 2.043563387175722e-05,
1784
+ "loss": 0.1045,
1785
+ "step": 1435
1786
+ },
1787
+ {
1788
+ "epoch": 6.32,
1789
+ "learning_rate": 2.0313264806656878e-05,
1790
+ "loss": 0.1391,
1791
+ "step": 1440
1792
+ },
1793
+ {
1794
+ "epoch": 6.34,
1795
+ "learning_rate": 2.0190895741556535e-05,
1796
+ "loss": 0.1505,
1797
+ "step": 1445
1798
+ },
1799
+ {
1800
+ "epoch": 6.37,
1801
+ "learning_rate": 2.0068526676456192e-05,
1802
+ "loss": 0.1366,
1803
+ "step": 1450
1804
+ },
1805
+ {
1806
+ "epoch": 6.39,
1807
+ "learning_rate": 1.994615761135585e-05,
1808
+ "loss": 0.1317,
1809
+ "step": 1455
1810
+ },
1811
+ {
1812
+ "epoch": 6.41,
1813
+ "learning_rate": 1.9823788546255507e-05,
1814
+ "loss": 0.141,
1815
+ "step": 1460
1816
+ },
1817
+ {
1818
+ "epoch": 6.43,
1819
+ "learning_rate": 1.9701419481155164e-05,
1820
+ "loss": 0.1258,
1821
+ "step": 1465
1822
+ },
1823
+ {
1824
+ "epoch": 6.45,
1825
+ "learning_rate": 1.957905041605482e-05,
1826
+ "loss": 0.0975,
1827
+ "step": 1470
1828
+ },
1829
+ {
1830
+ "epoch": 6.48,
1831
+ "learning_rate": 1.9456681350954482e-05,
1832
+ "loss": 0.1543,
1833
+ "step": 1475
1834
+ },
1835
+ {
1836
+ "epoch": 6.5,
1837
+ "learning_rate": 1.9334312285854136e-05,
1838
+ "loss": 0.1097,
1839
+ "step": 1480
1840
+ },
1841
+ {
1842
+ "epoch": 6.52,
1843
+ "learning_rate": 1.9211943220753794e-05,
1844
+ "loss": 0.1185,
1845
+ "step": 1485
1846
+ },
1847
+ {
1848
+ "epoch": 6.54,
1849
+ "learning_rate": 1.9089574155653454e-05,
1850
+ "loss": 0.129,
1851
+ "step": 1490
1852
+ },
1853
+ {
1854
+ "epoch": 6.56,
1855
+ "learning_rate": 1.8967205090553108e-05,
1856
+ "loss": 0.1135,
1857
+ "step": 1495
1858
+ },
1859
+ {
1860
+ "epoch": 6.59,
1861
+ "learning_rate": 1.8844836025452765e-05,
1862
+ "loss": 0.1159,
1863
+ "step": 1500
1864
+ },
1865
+ {
1866
+ "epoch": 6.61,
1867
+ "learning_rate": 1.8722466960352426e-05,
1868
+ "loss": 0.1321,
1869
+ "step": 1505
1870
+ },
1871
+ {
1872
+ "epoch": 6.63,
1873
+ "learning_rate": 1.860009789525208e-05,
1874
+ "loss": 0.138,
1875
+ "step": 1510
1876
+ },
1877
+ {
1878
+ "epoch": 6.65,
1879
+ "learning_rate": 1.8477728830151737e-05,
1880
+ "loss": 0.1002,
1881
+ "step": 1515
1882
+ },
1883
+ {
1884
+ "epoch": 6.67,
1885
+ "learning_rate": 1.8355359765051398e-05,
1886
+ "loss": 0.1541,
1887
+ "step": 1520
1888
+ },
1889
+ {
1890
+ "epoch": 6.7,
1891
+ "learning_rate": 1.8232990699951052e-05,
1892
+ "loss": 0.1175,
1893
+ "step": 1525
1894
+ },
1895
+ {
1896
+ "epoch": 6.72,
1897
+ "learning_rate": 1.811062163485071e-05,
1898
+ "loss": 0.1713,
1899
+ "step": 1530
1900
+ },
1901
+ {
1902
+ "epoch": 6.74,
1903
+ "learning_rate": 1.798825256975037e-05,
1904
+ "loss": 0.1168,
1905
+ "step": 1535
1906
+ },
1907
+ {
1908
+ "epoch": 6.76,
1909
+ "learning_rate": 1.7865883504650024e-05,
1910
+ "loss": 0.1172,
1911
+ "step": 1540
1912
+ },
1913
+ {
1914
+ "epoch": 6.78,
1915
+ "learning_rate": 1.774351443954968e-05,
1916
+ "loss": 0.1219,
1917
+ "step": 1545
1918
+ },
1919
+ {
1920
+ "epoch": 6.81,
1921
+ "learning_rate": 1.7621145374449342e-05,
1922
+ "loss": 0.0906,
1923
+ "step": 1550
1924
+ },
1925
+ {
1926
+ "epoch": 6.83,
1927
+ "learning_rate": 1.7498776309348996e-05,
1928
+ "loss": 0.0864,
1929
+ "step": 1555
1930
+ },
1931
+ {
1932
+ "epoch": 6.85,
1933
+ "learning_rate": 1.7376407244248653e-05,
1934
+ "loss": 0.1334,
1935
+ "step": 1560
1936
+ },
1937
+ {
1938
+ "epoch": 6.87,
1939
+ "learning_rate": 1.7254038179148314e-05,
1940
+ "loss": 0.0803,
1941
+ "step": 1565
1942
+ },
1943
+ {
1944
+ "epoch": 6.89,
1945
+ "learning_rate": 1.7131669114047968e-05,
1946
+ "loss": 0.116,
1947
+ "step": 1570
1948
+ },
1949
+ {
1950
+ "epoch": 6.92,
1951
+ "learning_rate": 1.700930004894763e-05,
1952
+ "loss": 0.1122,
1953
+ "step": 1575
1954
+ },
1955
+ {
1956
+ "epoch": 6.94,
1957
+ "learning_rate": 1.6886930983847286e-05,
1958
+ "loss": 0.1357,
1959
+ "step": 1580
1960
+ },
1961
+ {
1962
+ "epoch": 6.96,
1963
+ "learning_rate": 1.676456191874694e-05,
1964
+ "loss": 0.1193,
1965
+ "step": 1585
1966
+ },
1967
+ {
1968
+ "epoch": 6.98,
1969
+ "learning_rate": 1.66421928536466e-05,
1970
+ "loss": 0.1049,
1971
+ "step": 1590
1972
+ },
1973
+ {
1974
+ "epoch": 7.0,
1975
+ "eval_accuracy": 0.978066110596231,
1976
+ "eval_loss": 0.0661974847316742,
1977
+ "eval_runtime": 6.489,
1978
+ "eval_samples_per_second": 498.843,
1979
+ "eval_steps_per_second": 15.719,
1980
+ "step": 1594
1981
+ },
1982
+ {
1983
+ "epoch": 7.0,
1984
+ "learning_rate": 1.6519823788546258e-05,
1985
+ "loss": 0.128,
1986
+ "step": 1595
1987
+ },
1988
+ {
1989
+ "epoch": 7.03,
1990
+ "learning_rate": 1.639745472344591e-05,
1991
+ "loss": 0.0983,
1992
+ "step": 1600
1993
+ },
1994
+ {
1995
+ "epoch": 7.05,
1996
+ "learning_rate": 1.6275085658345572e-05,
1997
+ "loss": 0.1544,
1998
+ "step": 1605
1999
+ },
2000
+ {
2001
+ "epoch": 7.07,
2002
+ "learning_rate": 1.615271659324523e-05,
2003
+ "loss": 0.1264,
2004
+ "step": 1610
2005
+ },
2006
+ {
2007
+ "epoch": 7.09,
2008
+ "learning_rate": 1.6030347528144883e-05,
2009
+ "loss": 0.1272,
2010
+ "step": 1615
2011
+ },
2012
+ {
2013
+ "epoch": 7.11,
2014
+ "learning_rate": 1.5907978463044544e-05,
2015
+ "loss": 0.1168,
2016
+ "step": 1620
2017
+ },
2018
+ {
2019
+ "epoch": 7.14,
2020
+ "learning_rate": 1.57856093979442e-05,
2021
+ "loss": 0.1087,
2022
+ "step": 1625
2023
+ },
2024
+ {
2025
+ "epoch": 7.16,
2026
+ "learning_rate": 1.5663240332843855e-05,
2027
+ "loss": 0.1234,
2028
+ "step": 1630
2029
+ },
2030
+ {
2031
+ "epoch": 7.18,
2032
+ "learning_rate": 1.5540871267743516e-05,
2033
+ "loss": 0.1147,
2034
+ "step": 1635
2035
+ },
2036
+ {
2037
+ "epoch": 7.2,
2038
+ "learning_rate": 1.5418502202643173e-05,
2039
+ "loss": 0.1111,
2040
+ "step": 1640
2041
+ },
2042
+ {
2043
+ "epoch": 7.22,
2044
+ "learning_rate": 1.529613313754283e-05,
2045
+ "loss": 0.1356,
2046
+ "step": 1645
2047
+ },
2048
+ {
2049
+ "epoch": 7.24,
2050
+ "learning_rate": 1.5173764072442486e-05,
2051
+ "loss": 0.121,
2052
+ "step": 1650
2053
+ },
2054
+ {
2055
+ "epoch": 7.27,
2056
+ "learning_rate": 1.5051395007342145e-05,
2057
+ "loss": 0.0809,
2058
+ "step": 1655
2059
+ },
2060
+ {
2061
+ "epoch": 7.29,
2062
+ "learning_rate": 1.4929025942241802e-05,
2063
+ "loss": 0.1398,
2064
+ "step": 1660
2065
+ },
2066
+ {
2067
+ "epoch": 7.31,
2068
+ "learning_rate": 1.4806656877141458e-05,
2069
+ "loss": 0.111,
2070
+ "step": 1665
2071
+ },
2072
+ {
2073
+ "epoch": 7.33,
2074
+ "learning_rate": 1.4684287812041117e-05,
2075
+ "loss": 0.126,
2076
+ "step": 1670
2077
+ },
2078
+ {
2079
+ "epoch": 7.35,
2080
+ "learning_rate": 1.4561918746940776e-05,
2081
+ "loss": 0.1364,
2082
+ "step": 1675
2083
+ },
2084
+ {
2085
+ "epoch": 7.38,
2086
+ "learning_rate": 1.443954968184043e-05,
2087
+ "loss": 0.1225,
2088
+ "step": 1680
2089
+ },
2090
+ {
2091
+ "epoch": 7.4,
2092
+ "learning_rate": 1.4317180616740089e-05,
2093
+ "loss": 0.126,
2094
+ "step": 1685
2095
+ },
2096
+ {
2097
+ "epoch": 7.42,
2098
+ "learning_rate": 1.4194811551639748e-05,
2099
+ "loss": 0.1036,
2100
+ "step": 1690
2101
+ },
2102
+ {
2103
+ "epoch": 7.44,
2104
+ "learning_rate": 1.4072442486539404e-05,
2105
+ "loss": 0.0925,
2106
+ "step": 1695
2107
+ },
2108
+ {
2109
+ "epoch": 7.46,
2110
+ "learning_rate": 1.3950073421439061e-05,
2111
+ "loss": 0.0956,
2112
+ "step": 1700
2113
+ },
2114
+ {
2115
+ "epoch": 7.49,
2116
+ "learning_rate": 1.382770435633872e-05,
2117
+ "loss": 0.1141,
2118
+ "step": 1705
2119
+ },
2120
+ {
2121
+ "epoch": 7.51,
2122
+ "learning_rate": 1.3705335291238376e-05,
2123
+ "loss": 0.0709,
2124
+ "step": 1710
2125
+ },
2126
+ {
2127
+ "epoch": 7.53,
2128
+ "learning_rate": 1.3582966226138033e-05,
2129
+ "loss": 0.1172,
2130
+ "step": 1715
2131
+ },
2132
+ {
2133
+ "epoch": 7.55,
2134
+ "learning_rate": 1.3460597161037692e-05,
2135
+ "loss": 0.125,
2136
+ "step": 1720
2137
+ },
2138
+ {
2139
+ "epoch": 7.57,
2140
+ "learning_rate": 1.3338228095937347e-05,
2141
+ "loss": 0.1254,
2142
+ "step": 1725
2143
+ },
2144
+ {
2145
+ "epoch": 7.6,
2146
+ "learning_rate": 1.3215859030837005e-05,
2147
+ "loss": 0.0998,
2148
+ "step": 1730
2149
+ },
2150
+ {
2151
+ "epoch": 7.62,
2152
+ "learning_rate": 1.3093489965736664e-05,
2153
+ "loss": 0.104,
2154
+ "step": 1735
2155
+ },
2156
+ {
2157
+ "epoch": 7.64,
2158
+ "learning_rate": 1.297112090063632e-05,
2159
+ "loss": 0.1127,
2160
+ "step": 1740
2161
+ },
2162
+ {
2163
+ "epoch": 7.66,
2164
+ "learning_rate": 1.2848751835535977e-05,
2165
+ "loss": 0.1194,
2166
+ "step": 1745
2167
+ },
2168
+ {
2169
+ "epoch": 7.68,
2170
+ "learning_rate": 1.2726382770435636e-05,
2171
+ "loss": 0.1094,
2172
+ "step": 1750
2173
+ },
2174
+ {
2175
+ "epoch": 7.71,
2176
+ "learning_rate": 1.2604013705335291e-05,
2177
+ "loss": 0.0983,
2178
+ "step": 1755
2179
+ },
2180
+ {
2181
+ "epoch": 7.73,
2182
+ "learning_rate": 1.2481644640234949e-05,
2183
+ "loss": 0.1166,
2184
+ "step": 1760
2185
+ },
2186
+ {
2187
+ "epoch": 7.75,
2188
+ "learning_rate": 1.2359275575134606e-05,
2189
+ "loss": 0.0939,
2190
+ "step": 1765
2191
+ },
2192
+ {
2193
+ "epoch": 7.77,
2194
+ "learning_rate": 1.2236906510034265e-05,
2195
+ "loss": 0.1319,
2196
+ "step": 1770
2197
+ },
2198
+ {
2199
+ "epoch": 7.79,
2200
+ "learning_rate": 1.211453744493392e-05,
2201
+ "loss": 0.0841,
2202
+ "step": 1775
2203
+ },
2204
+ {
2205
+ "epoch": 7.82,
2206
+ "learning_rate": 1.199216837983358e-05,
2207
+ "loss": 0.1166,
2208
+ "step": 1780
2209
+ },
2210
+ {
2211
+ "epoch": 7.84,
2212
+ "learning_rate": 1.1869799314733237e-05,
2213
+ "loss": 0.0854,
2214
+ "step": 1785
2215
+ },
2216
+ {
2217
+ "epoch": 7.86,
2218
+ "learning_rate": 1.1747430249632892e-05,
2219
+ "loss": 0.1122,
2220
+ "step": 1790
2221
+ },
2222
+ {
2223
+ "epoch": 7.88,
2224
+ "learning_rate": 1.1625061184532551e-05,
2225
+ "loss": 0.1287,
2226
+ "step": 1795
2227
+ },
2228
+ {
2229
+ "epoch": 7.9,
2230
+ "learning_rate": 1.1502692119432209e-05,
2231
+ "loss": 0.0982,
2232
+ "step": 1800
2233
+ },
2234
+ {
2235
+ "epoch": 7.93,
2236
+ "learning_rate": 1.1380323054331866e-05,
2237
+ "loss": 0.1172,
2238
+ "step": 1805
2239
+ },
2240
+ {
2241
+ "epoch": 7.95,
2242
+ "learning_rate": 1.1257953989231523e-05,
2243
+ "loss": 0.1236,
2244
+ "step": 1810
2245
+ },
2246
+ {
2247
+ "epoch": 7.97,
2248
+ "learning_rate": 1.113558492413118e-05,
2249
+ "loss": 0.12,
2250
+ "step": 1815
2251
+ },
2252
+ {
2253
+ "epoch": 7.99,
2254
+ "learning_rate": 1.1013215859030838e-05,
2255
+ "loss": 0.0928,
2256
+ "step": 1820
2257
+ },
2258
+ {
2259
+ "epoch": 8.0,
2260
+ "eval_accuracy": 0.9774482545566883,
2261
+ "eval_loss": 0.06933724135160446,
2262
+ "eval_runtime": 6.53,
2263
+ "eval_samples_per_second": 495.714,
2264
+ "eval_steps_per_second": 15.62,
2265
+ "step": 1822
2266
+ },
2267
+ {
2268
+ "epoch": 8.01,
2269
+ "learning_rate": 1.0890846793930495e-05,
2270
+ "loss": 0.0916,
2271
+ "step": 1825
2272
+ },
2273
+ {
2274
+ "epoch": 8.04,
2275
+ "learning_rate": 1.0768477728830152e-05,
2276
+ "loss": 0.0792,
2277
+ "step": 1830
2278
+ },
2279
+ {
2280
+ "epoch": 8.06,
2281
+ "learning_rate": 1.064610866372981e-05,
2282
+ "loss": 0.1122,
2283
+ "step": 1835
2284
+ },
2285
+ {
2286
+ "epoch": 8.08,
2287
+ "learning_rate": 1.0523739598629467e-05,
2288
+ "loss": 0.1373,
2289
+ "step": 1840
2290
+ },
2291
+ {
2292
+ "epoch": 8.1,
2293
+ "learning_rate": 1.0401370533529124e-05,
2294
+ "loss": 0.1101,
2295
+ "step": 1845
2296
+ },
2297
+ {
2298
+ "epoch": 8.12,
2299
+ "learning_rate": 1.0279001468428782e-05,
2300
+ "loss": 0.1064,
2301
+ "step": 1850
2302
+ },
2303
+ {
2304
+ "epoch": 8.14,
2305
+ "learning_rate": 1.0156632403328439e-05,
2306
+ "loss": 0.1187,
2307
+ "step": 1855
2308
+ },
2309
+ {
2310
+ "epoch": 8.17,
2311
+ "learning_rate": 1.0034263338228096e-05,
2312
+ "loss": 0.1155,
2313
+ "step": 1860
2314
+ },
2315
+ {
2316
+ "epoch": 8.19,
2317
+ "learning_rate": 9.911894273127754e-06,
2318
+ "loss": 0.1236,
2319
+ "step": 1865
2320
+ },
2321
+ {
2322
+ "epoch": 8.21,
2323
+ "learning_rate": 9.78952520802741e-06,
2324
+ "loss": 0.1007,
2325
+ "step": 1870
2326
+ },
2327
+ {
2328
+ "epoch": 8.23,
2329
+ "learning_rate": 9.667156142927068e-06,
2330
+ "loss": 0.1158,
2331
+ "step": 1875
2332
+ },
2333
+ {
2334
+ "epoch": 8.25,
2335
+ "learning_rate": 9.544787077826727e-06,
2336
+ "loss": 0.0951,
2337
+ "step": 1880
2338
+ },
2339
+ {
2340
+ "epoch": 8.28,
2341
+ "learning_rate": 9.422418012726383e-06,
2342
+ "loss": 0.1196,
2343
+ "step": 1885
2344
+ },
2345
+ {
2346
+ "epoch": 8.3,
2347
+ "learning_rate": 9.30004894762604e-06,
2348
+ "loss": 0.0829,
2349
+ "step": 1890
2350
+ },
2351
+ {
2352
+ "epoch": 8.32,
2353
+ "learning_rate": 9.177679882525699e-06,
2354
+ "loss": 0.0879,
2355
+ "step": 1895
2356
+ },
2357
+ {
2358
+ "epoch": 8.34,
2359
+ "learning_rate": 9.055310817425355e-06,
2360
+ "loss": 0.1147,
2361
+ "step": 1900
2362
+ },
2363
+ {
2364
+ "epoch": 8.36,
2365
+ "learning_rate": 8.932941752325012e-06,
2366
+ "loss": 0.1241,
2367
+ "step": 1905
2368
+ },
2369
+ {
2370
+ "epoch": 8.39,
2371
+ "learning_rate": 8.810572687224671e-06,
2372
+ "loss": 0.089,
2373
+ "step": 1910
2374
+ },
2375
+ {
2376
+ "epoch": 8.41,
2377
+ "learning_rate": 8.688203622124327e-06,
2378
+ "loss": 0.1278,
2379
+ "step": 1915
2380
+ },
2381
+ {
2382
+ "epoch": 8.43,
2383
+ "learning_rate": 8.565834557023984e-06,
2384
+ "loss": 0.1134,
2385
+ "step": 1920
2386
+ },
2387
+ {
2388
+ "epoch": 8.45,
2389
+ "learning_rate": 8.443465491923643e-06,
2390
+ "loss": 0.1079,
2391
+ "step": 1925
2392
+ },
2393
+ {
2394
+ "epoch": 8.47,
2395
+ "learning_rate": 8.3210964268233e-06,
2396
+ "loss": 0.0967,
2397
+ "step": 1930
2398
+ },
2399
+ {
2400
+ "epoch": 8.5,
2401
+ "learning_rate": 8.198727361722956e-06,
2402
+ "loss": 0.1004,
2403
+ "step": 1935
2404
+ },
2405
+ {
2406
+ "epoch": 8.52,
2407
+ "learning_rate": 8.076358296622615e-06,
2408
+ "loss": 0.1147,
2409
+ "step": 1940
2410
+ },
2411
+ {
2412
+ "epoch": 8.54,
2413
+ "learning_rate": 7.953989231522272e-06,
2414
+ "loss": 0.1276,
2415
+ "step": 1945
2416
+ },
2417
+ {
2418
+ "epoch": 8.56,
2419
+ "learning_rate": 7.831620166421928e-06,
2420
+ "loss": 0.1199,
2421
+ "step": 1950
2422
+ },
2423
+ {
2424
+ "epoch": 8.58,
2425
+ "learning_rate": 7.709251101321587e-06,
2426
+ "loss": 0.1014,
2427
+ "step": 1955
2428
+ },
2429
+ {
2430
+ "epoch": 8.61,
2431
+ "learning_rate": 7.586882036221243e-06,
2432
+ "loss": 0.1082,
2433
+ "step": 1960
2434
+ },
2435
+ {
2436
+ "epoch": 8.63,
2437
+ "learning_rate": 7.464512971120901e-06,
2438
+ "loss": 0.0872,
2439
+ "step": 1965
2440
+ },
2441
+ {
2442
+ "epoch": 8.65,
2443
+ "learning_rate": 7.3421439060205585e-06,
2444
+ "loss": 0.0865,
2445
+ "step": 1970
2446
+ },
2447
+ {
2448
+ "epoch": 8.67,
2449
+ "learning_rate": 7.219774840920215e-06,
2450
+ "loss": 0.1083,
2451
+ "step": 1975
2452
+ },
2453
+ {
2454
+ "epoch": 8.69,
2455
+ "learning_rate": 7.097405775819874e-06,
2456
+ "loss": 0.1053,
2457
+ "step": 1980
2458
+ },
2459
+ {
2460
+ "epoch": 8.72,
2461
+ "learning_rate": 6.9750367107195305e-06,
2462
+ "loss": 0.1408,
2463
+ "step": 1985
2464
+ },
2465
+ {
2466
+ "epoch": 8.74,
2467
+ "learning_rate": 6.852667645619188e-06,
2468
+ "loss": 0.1455,
2469
+ "step": 1990
2470
+ },
2471
+ {
2472
+ "epoch": 8.76,
2473
+ "learning_rate": 6.730298580518846e-06,
2474
+ "loss": 0.0891,
2475
+ "step": 1995
2476
+ },
2477
+ {
2478
+ "epoch": 8.78,
2479
+ "learning_rate": 6.607929515418502e-06,
2480
+ "loss": 0.1112,
2481
+ "step": 2000
2482
+ },
2483
+ {
2484
+ "epoch": 8.8,
2485
+ "learning_rate": 6.48556045031816e-06,
2486
+ "loss": 0.0981,
2487
+ "step": 2005
2488
+ },
2489
+ {
2490
+ "epoch": 8.83,
2491
+ "learning_rate": 6.363191385217818e-06,
2492
+ "loss": 0.1116,
2493
+ "step": 2010
2494
+ },
2495
+ {
2496
+ "epoch": 8.85,
2497
+ "learning_rate": 6.240822320117474e-06,
2498
+ "loss": 0.095,
2499
+ "step": 2015
2500
+ },
2501
+ {
2502
+ "epoch": 8.87,
2503
+ "learning_rate": 6.118453255017132e-06,
2504
+ "loss": 0.1103,
2505
+ "step": 2020
2506
+ },
2507
+ {
2508
+ "epoch": 8.89,
2509
+ "learning_rate": 5.99608418991679e-06,
2510
+ "loss": 0.1162,
2511
+ "step": 2025
2512
+ },
2513
+ {
2514
+ "epoch": 8.91,
2515
+ "learning_rate": 5.873715124816446e-06,
2516
+ "loss": 0.0998,
2517
+ "step": 2030
2518
+ },
2519
+ {
2520
+ "epoch": 8.94,
2521
+ "learning_rate": 5.751346059716104e-06,
2522
+ "loss": 0.094,
2523
+ "step": 2035
2524
+ },
2525
+ {
2526
+ "epoch": 8.96,
2527
+ "learning_rate": 5.628976994615762e-06,
2528
+ "loss": 0.1082,
2529
+ "step": 2040
2530
+ },
2531
+ {
2532
+ "epoch": 8.98,
2533
+ "learning_rate": 5.506607929515419e-06,
2534
+ "loss": 0.0903,
2535
+ "step": 2045
2536
+ },
2537
+ {
2538
+ "epoch": 9.0,
2539
+ "eval_accuracy": 0.9771393265369169,
2540
+ "eval_loss": 0.07044384628534317,
2541
+ "eval_runtime": 6.5312,
2542
+ "eval_samples_per_second": 495.624,
2543
+ "eval_steps_per_second": 15.617,
2544
+ "step": 2049
2545
+ },
2546
+ {
2547
+ "epoch": 9.0,
2548
+ "learning_rate": 5.384238864415076e-06,
2549
+ "loss": 0.1212,
2550
+ "step": 2050
2551
+ },
2552
+ {
2553
+ "epoch": 9.02,
2554
+ "learning_rate": 5.2618697993147335e-06,
2555
+ "loss": 0.1009,
2556
+ "step": 2055
2557
+ },
2558
+ {
2559
+ "epoch": 9.05,
2560
+ "learning_rate": 5.139500734214391e-06,
2561
+ "loss": 0.1079,
2562
+ "step": 2060
2563
+ },
2564
+ {
2565
+ "epoch": 9.07,
2566
+ "learning_rate": 5.017131669114048e-06,
2567
+ "loss": 0.1134,
2568
+ "step": 2065
2569
+ },
2570
+ {
2571
+ "epoch": 9.09,
2572
+ "learning_rate": 4.894762604013705e-06,
2573
+ "loss": 0.092,
2574
+ "step": 2070
2575
+ },
2576
+ {
2577
+ "epoch": 9.11,
2578
+ "learning_rate": 4.7723935389133636e-06,
2579
+ "loss": 0.1126,
2580
+ "step": 2075
2581
+ },
2582
+ {
2583
+ "epoch": 9.13,
2584
+ "learning_rate": 4.65002447381302e-06,
2585
+ "loss": 0.0749,
2586
+ "step": 2080
2587
+ },
2588
+ {
2589
+ "epoch": 9.15,
2590
+ "learning_rate": 4.527655408712677e-06,
2591
+ "loss": 0.1292,
2592
+ "step": 2085
2593
+ },
2594
+ {
2595
+ "epoch": 9.18,
2596
+ "learning_rate": 4.4052863436123355e-06,
2597
+ "loss": 0.1171,
2598
+ "step": 2090
2599
+ },
2600
+ {
2601
+ "epoch": 9.2,
2602
+ "learning_rate": 4.282917278511992e-06,
2603
+ "loss": 0.082,
2604
+ "step": 2095
2605
+ },
2606
+ {
2607
+ "epoch": 9.22,
2608
+ "learning_rate": 4.16054821341165e-06,
2609
+ "loss": 0.1129,
2610
+ "step": 2100
2611
+ },
2612
+ {
2613
+ "epoch": 9.24,
2614
+ "learning_rate": 4.038179148311307e-06,
2615
+ "loss": 0.0779,
2616
+ "step": 2105
2617
+ },
2618
+ {
2619
+ "epoch": 9.26,
2620
+ "learning_rate": 3.915810083210964e-06,
2621
+ "loss": 0.1117,
2622
+ "step": 2110
2623
+ },
2624
+ {
2625
+ "epoch": 9.29,
2626
+ "learning_rate": 3.7934410181106215e-06,
2627
+ "loss": 0.0878,
2628
+ "step": 2115
2629
+ },
2630
+ {
2631
+ "epoch": 9.31,
2632
+ "learning_rate": 3.6710719530102793e-06,
2633
+ "loss": 0.0925,
2634
+ "step": 2120
2635
+ },
2636
+ {
2637
+ "epoch": 9.33,
2638
+ "learning_rate": 3.548702887909937e-06,
2639
+ "loss": 0.1107,
2640
+ "step": 2125
2641
+ },
2642
+ {
2643
+ "epoch": 9.35,
2644
+ "learning_rate": 3.426333822809594e-06,
2645
+ "loss": 0.1063,
2646
+ "step": 2130
2647
+ },
2648
+ {
2649
+ "epoch": 9.37,
2650
+ "learning_rate": 3.303964757709251e-06,
2651
+ "loss": 0.1042,
2652
+ "step": 2135
2653
+ },
2654
+ {
2655
+ "epoch": 9.4,
2656
+ "learning_rate": 3.181595692608909e-06,
2657
+ "loss": 0.1076,
2658
+ "step": 2140
2659
+ },
2660
+ {
2661
+ "epoch": 9.42,
2662
+ "learning_rate": 3.059226627508566e-06,
2663
+ "loss": 0.1014,
2664
+ "step": 2145
2665
+ },
2666
+ {
2667
+ "epoch": 9.44,
2668
+ "learning_rate": 2.936857562408223e-06,
2669
+ "loss": 0.1035,
2670
+ "step": 2150
2671
+ },
2672
+ {
2673
+ "epoch": 9.46,
2674
+ "learning_rate": 2.814488497307881e-06,
2675
+ "loss": 0.1216,
2676
+ "step": 2155
2677
+ },
2678
+ {
2679
+ "epoch": 9.48,
2680
+ "learning_rate": 2.692119432207538e-06,
2681
+ "loss": 0.0988,
2682
+ "step": 2160
2683
+ },
2684
+ {
2685
+ "epoch": 9.51,
2686
+ "learning_rate": 2.5697503671071954e-06,
2687
+ "loss": 0.1094,
2688
+ "step": 2165
2689
+ },
2690
+ {
2691
+ "epoch": 9.53,
2692
+ "learning_rate": 2.4473813020068527e-06,
2693
+ "loss": 0.0732,
2694
+ "step": 2170
2695
+ },
2696
+ {
2697
+ "epoch": 9.55,
2698
+ "learning_rate": 2.32501223690651e-06,
2699
+ "loss": 0.1133,
2700
+ "step": 2175
2701
+ },
2702
+ {
2703
+ "epoch": 9.57,
2704
+ "learning_rate": 2.2026431718061677e-06,
2705
+ "loss": 0.1065,
2706
+ "step": 2180
2707
+ },
2708
+ {
2709
+ "epoch": 9.59,
2710
+ "learning_rate": 2.080274106705825e-06,
2711
+ "loss": 0.0633,
2712
+ "step": 2185
2713
+ },
2714
+ {
2715
+ "epoch": 9.62,
2716
+ "learning_rate": 1.957905041605482e-06,
2717
+ "loss": 0.0959,
2718
+ "step": 2190
2719
+ },
2720
+ {
2721
+ "epoch": 9.64,
2722
+ "learning_rate": 1.8355359765051396e-06,
2723
+ "loss": 0.1422,
2724
+ "step": 2195
2725
+ },
2726
+ {
2727
+ "epoch": 9.66,
2728
+ "learning_rate": 1.713166911404797e-06,
2729
+ "loss": 0.1152,
2730
+ "step": 2200
2731
+ },
2732
+ {
2733
+ "epoch": 9.68,
2734
+ "learning_rate": 1.5907978463044545e-06,
2735
+ "loss": 0.1046,
2736
+ "step": 2205
2737
+ },
2738
+ {
2739
+ "epoch": 9.7,
2740
+ "learning_rate": 1.4684287812041115e-06,
2741
+ "loss": 0.0728,
2742
+ "step": 2210
2743
+ },
2744
+ {
2745
+ "epoch": 9.73,
2746
+ "learning_rate": 1.346059716103769e-06,
2747
+ "loss": 0.1027,
2748
+ "step": 2215
2749
+ },
2750
+ {
2751
+ "epoch": 9.75,
2752
+ "learning_rate": 1.2236906510034264e-06,
2753
+ "loss": 0.0835,
2754
+ "step": 2220
2755
+ },
2756
+ {
2757
+ "epoch": 9.77,
2758
+ "learning_rate": 1.1013215859030839e-06,
2759
+ "loss": 0.1145,
2760
+ "step": 2225
2761
+ },
2762
+ {
2763
+ "epoch": 9.79,
2764
+ "learning_rate": 9.78952520802741e-07,
2765
+ "loss": 0.1031,
2766
+ "step": 2230
2767
+ },
2768
+ {
2769
+ "epoch": 9.81,
2770
+ "learning_rate": 8.565834557023985e-07,
2771
+ "loss": 0.0955,
2772
+ "step": 2235
2773
+ },
2774
+ {
2775
+ "epoch": 9.84,
2776
+ "learning_rate": 7.342143906020558e-07,
2777
+ "loss": 0.0845,
2778
+ "step": 2240
2779
+ },
2780
+ {
2781
+ "epoch": 9.86,
2782
+ "learning_rate": 6.118453255017132e-07,
2783
+ "loss": 0.1065,
2784
+ "step": 2245
2785
+ },
2786
+ {
2787
+ "epoch": 9.88,
2788
+ "learning_rate": 4.894762604013705e-07,
2789
+ "loss": 0.1896,
2790
+ "step": 2250
2791
+ },
2792
+ {
2793
+ "epoch": 9.9,
2794
+ "learning_rate": 3.671071953010279e-07,
2795
+ "loss": 0.1049,
2796
+ "step": 2255
2797
+ },
2798
+ {
2799
+ "epoch": 9.92,
2800
+ "learning_rate": 2.4473813020068524e-07,
2801
+ "loss": 0.1212,
2802
+ "step": 2260
2803
+ },
2804
+ {
2805
+ "epoch": 9.95,
2806
+ "learning_rate": 1.2236906510034262e-07,
2807
+ "loss": 0.1173,
2808
+ "step": 2265
2809
+ },
2810
+ {
2811
+ "epoch": 9.97,
2812
+ "learning_rate": 0.0,
2813
+ "loss": 0.0759,
2814
+ "step": 2270
2815
+ },
2816
+ {
2817
+ "epoch": 9.97,
2818
+ "eval_accuracy": 0.9777571825764597,
2819
+ "eval_loss": 0.06519713997840881,
2820
+ "eval_runtime": 6.5757,
2821
+ "eval_samples_per_second": 492.27,
2822
+ "eval_steps_per_second": 15.512,
2823
+ "step": 2270
2824
+ },
2825
+ {
2826
+ "epoch": 9.97,
2827
+ "step": 2270,
2828
+ "total_flos": 7.217190574941635e+18,
2829
+ "train_loss": 0.18469989935206946,
2830
+ "train_runtime": 1472.4515,
2831
+ "train_samples_per_second": 197.82,
2832
+ "train_steps_per_second": 1.542
2833
+ }
2834
+ ],
2835
+ "logging_steps": 5,
2836
+ "max_steps": 2270,
2837
+ "num_train_epochs": 10,
2838
+ "save_steps": 500,
2839
+ "total_flos": 7.217190574941635e+18,
2840
+ "trial_name": null,
2841
+ "trial_params": null
2842
+ }