PEFT
cella110n commited on
Commit
116c2d5
1 Parent(s): 140d176

Upload 9 files

Browse files
LICENSE ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Tongyi Qianwen LICENSE AGREEMENT
2
+
3
+ Tongyi Qianwen Release Date: August 23, 2023
4
+
5
+ By clicking to agree or by using or distributing any portion or element of the Tongyi Qianwen Materials, you will be deemed to have recognized and accepted the content of this Agreement, which is effective immediately.
6
+
7
+ 1. Definitions
8
+ a. This Tongyi Qianwen LICENSE AGREEMENT (this "Agreement") shall mean the terms and conditions for use, reproduction, distribution and modification of the Materials as defined by this Agreement.
9
+ b. "We"(or "Us") shall mean Alibaba Cloud.
10
+ c. "You" (or "Your") shall mean a natural person or legal entity exercising the rights granted by this Agreement and/or using the Materials for any purpose and in any field of use.
11
+ d. "Third Parties" shall mean individuals or legal entities that are not under common control with Us or You.
12
+ e. "Tongyi Qianwen" shall mean the large language models (including Qwen-VL model and Qwen-VL-Chat model), and software and algorithms, consisting of trained model weights, parameters (including optimizer states), machine-learning model code, inference-enabling code, training-enabling code, fine-tuning enabling code and other elements of the foregoing distributed by Us.
13
+ f. "Materials" shall mean, collectively, Alibaba Cloud's proprietary Tongyi Qianwen and Documentation (and any portion thereof) made available under this Agreement.
14
+ g. "Source" form shall mean the preferred form for making modifications, including but not limited to model source code, documentation source, and configuration files.
15
+ h. "Object" form shall mean any form resulting from mechanical transformation or translation of a Source form, including but not limited to compiled object code, generated documentation,
16
+ and conversions to other media types.
17
+
18
+ 2. Grant of Rights
19
+ You are granted a non-exclusive, worldwide, non-transferable and royalty-free limited license under Alibaba Cloud's intellectual property or other rights owned by Us embodied in the Materials to use, reproduce, distribute, copy, create derivative works of, and make modifications to the Materials.
20
+
21
+ 3. Redistribution
22
+ You may reproduce and distribute copies of the Materials or derivative works thereof in any medium, with or without modifications, and in Source or Object form, provided that You meet the following conditions:
23
+ a. You shall give any other recipients of the Materials or derivative works a copy of this Agreement;
24
+ b. You shall cause any modified files to carry prominent notices stating that You changed the files;
25
+ c. You shall retain in all copies of the Materials that You distribute the following attribution notices within a "Notice" text file distributed as a part of such copies: "Tongyi Qianwen is licensed under the Tongyi Qianwen LICENSE AGREEMENT, Copyright (c) Alibaba Cloud. All Rights Reserved."; and
26
+ d. You may add Your own copyright statement to Your modifications and may provide additional or different license terms and conditions for use, reproduction, or distribution of Your modifications, or for any such derivative works as a whole, provided Your use, reproduction, and distribution of the work otherwise complies with the terms and conditions of this Agreement.
27
+
28
+ 4. Restrictions
29
+ If you are commercially using the Materials, and your product or service has more than 100 million monthly active users, You shall request a license from Us. You cannot exercise your rights under this Agreement without our express authorization.
30
+
31
+ 5. Rules of use
32
+ a. The Materials may be subject to export controls or restrictions in China, the United States or other countries or regions. You shall comply with applicable laws and regulations in your use of the Materials.
33
+ b. You can not use the Materials or any output therefrom to improve any other large language model (excluding Tongyi Qianwen or derivative works thereof).
34
+
35
+ 6. Intellectual Property
36
+ a. We retain ownership of all intellectual property rights in and to the Materials and derivatives made by or for Us. Conditioned upon compliance with the terms and conditions of this Agreement, with respect to any derivative works and modifications of the Materials that are made by you, you are and will be the owner of such derivative works and modifications.
37
+ b. No trademark license is granted to use the trade names, trademarks, service marks, or product names of Us, except as required to fulfill notice requirements under this Agreement or as required for reasonable and customary use in describing and redistributing the Materials.
38
+ c. If you commence a lawsuit or other proceedings (including a cross-claim or counterclaim in a lawsuit) against Us or any entity alleging that the Materials or any output therefrom, or any part of the foregoing, infringe any intellectual property or other right owned or licensable by you, then all licences granted to you under this Agreement shall terminate as of the date such lawsuit or other proceeding is commenced or brought.
39
+
40
+ 7. Disclaimer of Warranty and Limitation of Liability
41
+
42
+ a. We are not obligated to support, update, provide training for, or develop any further version of the Tongyi Qianwen Materials or to grant any license thereto.
43
+ b. THE MATERIALS ARE PROVIDED "AS IS" WITHOUT ANY EXPRESS OR IMPLIED WARRANTY OF ANY KIND INCLUDING WARRANTIES OF MERCHANTABILITY, NONINFRINGEMENT, OR FITNESS FOR A PARTICULAR PURPOSE. WE MAKE NO WARRANTY AND ASSUME NO RESPONSIBILITY FOR THE SAFETY OR STABILITY OF THE MATERIALS AND ANY OUTPUT THEREFROM.
44
+ c. IN NO EVENT SHALL WE BE LIABLE TO YOU FOR ANY DAMAGES, INCLUDING, BUT NOT LIMITED TO ANY DIRECT, OR INDIRECT, SPECIAL OR CONSEQUENTIAL DAMAGES ARISING FROM YOUR USE OR INABILITY TO USE THE MATERIALS OR ANY OUTPUT OF IT, NO MATTER HOW IT’S CAUSED.
45
+ d. You will defend, indemnify and hold harmless Us from and against any claim by any third party arising out of or related to your use or distribution of the Materials.
46
+
47
+ 8. Survival and Termination.
48
+ a. The term of this Agreement shall commence upon your acceptance of this Agreement or access to the Materials and will continue in full force and effect until terminated in accordance with the terms and conditions herein.
49
+ b. We may terminate this Agreement if you breach any of the terms or conditions of this Agreement. Upon termination of this Agreement, you must delete and cease use of the Materials. Sections 7 and 9 shall survive the termination of this Agreement.
50
+
51
+ 9. Governing Law and Jurisdiction.
52
+ a. This Agreement and any dispute arising out of or relating to it will be governed by the laws of China, without regard to conflict of law principles, and the UN Convention on Contracts for the International Sale of Goods does not apply to this Agreement.
53
+ b. The People's Courts in Hangzhou City shall have exclusive jurisdiction over any dispute arising out of this Agreement.
README.md CHANGED
@@ -1,3 +1,204 @@
1
  ---
2
- license: unknown
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: peft
3
+ base_model: Qwen/Qwen-VL-Chat
4
  ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+
201
+
202
+ ### Framework versions
203
+
204
+ - PEFT 0.7.1
adapter_config.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "Qwen/Qwen-VL-Chat",
5
+ "bias": "none",
6
+ "fan_in_fan_out": false,
7
+ "inference_mode": true,
8
+ "init_lora_weights": true,
9
+ "layers_pattern": null,
10
+ "layers_to_transform": null,
11
+ "loftq_config": {},
12
+ "lora_alpha": 16,
13
+ "lora_dropout": 0.05,
14
+ "megatron_config": null,
15
+ "megatron_core": "megatron.core",
16
+ "modules_to_save": null,
17
+ "peft_type": "LORA",
18
+ "r": 64,
19
+ "rank_pattern": {},
20
+ "revision": null,
21
+ "target_modules": [
22
+ "c_attn",
23
+ "w1",
24
+ "attn.c_proj",
25
+ "w2"
26
+ ],
27
+ "task_type": "CAUSAL_LM"
28
+ }
adapter_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ce4a92f38ca4af0b0b970251cc218a9f818524454205a4c4d976ac47756099e
3
+ size 224483018
qwen.tiktoken ADDED
The diff for this file is too large to render. See raw diff
 
special_tokens_map.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ {
2
+ "pad_token": "<|endoftext|>"
3
+ }
tokenizer_config.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "auto_map": {
3
+ "AutoTokenizer": [
4
+ "Qwen/Qwen-VL-Chat--tokenization_qwen.QWenTokenizer",
5
+ null
6
+ ]
7
+ },
8
+ "clean_up_tokenization_spaces": true,
9
+ "model_max_length": 2048,
10
+ "padding_side": "right",
11
+ "tokenizer_class": "QWenTokenizer"
12
+ }
trainer_state.json ADDED
@@ -0,0 +1,2938 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": null,
3
+ "best_model_checkpoint": null,
4
+ "epoch": 4.980744544287548,
5
+ "eval_steps": 500,
6
+ "global_step": 485,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.01,
13
+ "learning_rate": 2.0000000000000003e-06,
14
+ "loss": 2.6114,
15
+ "step": 1
16
+ },
17
+ {
18
+ "epoch": 0.02,
19
+ "learning_rate": 4.000000000000001e-06,
20
+ "loss": 2.5742,
21
+ "step": 2
22
+ },
23
+ {
24
+ "epoch": 0.03,
25
+ "learning_rate": 6e-06,
26
+ "loss": 2.4717,
27
+ "step": 3
28
+ },
29
+ {
30
+ "epoch": 0.04,
31
+ "learning_rate": 8.000000000000001e-06,
32
+ "loss": 2.3307,
33
+ "step": 4
34
+ },
35
+ {
36
+ "epoch": 0.05,
37
+ "learning_rate": 1e-05,
38
+ "loss": 2.5579,
39
+ "step": 5
40
+ },
41
+ {
42
+ "epoch": 0.06,
43
+ "learning_rate": 9.999892908320647e-06,
44
+ "loss": 2.1376,
45
+ "step": 6
46
+ },
47
+ {
48
+ "epoch": 0.07,
49
+ "learning_rate": 9.999571637870035e-06,
50
+ "loss": 2.5183,
51
+ "step": 7
52
+ },
53
+ {
54
+ "epoch": 0.08,
55
+ "learning_rate": 9.999036202410324e-06,
56
+ "loss": 2.6324,
57
+ "step": 8
58
+ },
59
+ {
60
+ "epoch": 0.09,
61
+ "learning_rate": 9.998286624877786e-06,
62
+ "loss": 2.6522,
63
+ "step": 9
64
+ },
65
+ {
66
+ "epoch": 0.1,
67
+ "learning_rate": 9.997322937381829e-06,
68
+ "loss": 2.8157,
69
+ "step": 10
70
+ },
71
+ {
72
+ "epoch": 0.11,
73
+ "learning_rate": 9.996145181203616e-06,
74
+ "loss": 2.2681,
75
+ "step": 11
76
+ },
77
+ {
78
+ "epoch": 0.12,
79
+ "learning_rate": 9.994753406794303e-06,
80
+ "loss": 2.4257,
81
+ "step": 12
82
+ },
83
+ {
84
+ "epoch": 0.13,
85
+ "learning_rate": 9.993147673772869e-06,
86
+ "loss": 2.9611,
87
+ "step": 13
88
+ },
89
+ {
90
+ "epoch": 0.14,
91
+ "learning_rate": 9.99132805092358e-06,
92
+ "loss": 2.6448,
93
+ "step": 14
94
+ },
95
+ {
96
+ "epoch": 0.15,
97
+ "learning_rate": 9.989294616193018e-06,
98
+ "loss": 2.1739,
99
+ "step": 15
100
+ },
101
+ {
102
+ "epoch": 0.16,
103
+ "learning_rate": 9.98704745668676e-06,
104
+ "loss": 2.3803,
105
+ "step": 16
106
+ },
107
+ {
108
+ "epoch": 0.17,
109
+ "learning_rate": 9.984586668665641e-06,
110
+ "loss": 3.0124,
111
+ "step": 17
112
+ },
113
+ {
114
+ "epoch": 0.18,
115
+ "learning_rate": 9.981912357541628e-06,
116
+ "loss": 1.8866,
117
+ "step": 18
118
+ },
119
+ {
120
+ "epoch": 0.2,
121
+ "learning_rate": 9.979024637873309e-06,
122
+ "loss": 2.8247,
123
+ "step": 19
124
+ },
125
+ {
126
+ "epoch": 0.21,
127
+ "learning_rate": 9.975923633360985e-06,
128
+ "loss": 2.3442,
129
+ "step": 20
130
+ },
131
+ {
132
+ "epoch": 0.22,
133
+ "learning_rate": 9.972609476841368e-06,
134
+ "loss": 2.2966,
135
+ "step": 21
136
+ },
137
+ {
138
+ "epoch": 0.23,
139
+ "learning_rate": 9.96908231028189e-06,
140
+ "loss": 2.5517,
141
+ "step": 22
142
+ },
143
+ {
144
+ "epoch": 0.24,
145
+ "learning_rate": 9.965342284774633e-06,
146
+ "loss": 1.9759,
147
+ "step": 23
148
+ },
149
+ {
150
+ "epoch": 0.25,
151
+ "learning_rate": 9.961389560529835e-06,
152
+ "loss": 2.2761,
153
+ "step": 24
154
+ },
155
+ {
156
+ "epoch": 0.26,
157
+ "learning_rate": 9.957224306869053e-06,
158
+ "loss": 2.3277,
159
+ "step": 25
160
+ },
161
+ {
162
+ "epoch": 0.27,
163
+ "learning_rate": 9.952846702217886e-06,
164
+ "loss": 2.5624,
165
+ "step": 26
166
+ },
167
+ {
168
+ "epoch": 0.28,
169
+ "learning_rate": 9.948256934098353e-06,
170
+ "loss": 2.379,
171
+ "step": 27
172
+ },
173
+ {
174
+ "epoch": 0.29,
175
+ "learning_rate": 9.943455199120836e-06,
176
+ "loss": 2.3016,
177
+ "step": 28
178
+ },
179
+ {
180
+ "epoch": 0.3,
181
+ "learning_rate": 9.938441702975689e-06,
182
+ "loss": 2.2362,
183
+ "step": 29
184
+ },
185
+ {
186
+ "epoch": 0.31,
187
+ "learning_rate": 9.933216660424396e-06,
188
+ "loss": 2.0744,
189
+ "step": 30
190
+ },
191
+ {
192
+ "epoch": 0.32,
193
+ "learning_rate": 9.92778029529039e-06,
194
+ "loss": 2.6486,
195
+ "step": 31
196
+ },
197
+ {
198
+ "epoch": 0.33,
199
+ "learning_rate": 9.922132840449459e-06,
200
+ "loss": 2.2122,
201
+ "step": 32
202
+ },
203
+ {
204
+ "epoch": 0.34,
205
+ "learning_rate": 9.916274537819774e-06,
206
+ "loss": 2.3736,
207
+ "step": 33
208
+ },
209
+ {
210
+ "epoch": 0.35,
211
+ "learning_rate": 9.91020563835152e-06,
212
+ "loss": 2.0414,
213
+ "step": 34
214
+ },
215
+ {
216
+ "epoch": 0.36,
217
+ "learning_rate": 9.903926402016153e-06,
218
+ "loss": 2.222,
219
+ "step": 35
220
+ },
221
+ {
222
+ "epoch": 0.37,
223
+ "learning_rate": 9.897437097795257e-06,
224
+ "loss": 2.6075,
225
+ "step": 36
226
+ },
227
+ {
228
+ "epoch": 0.38,
229
+ "learning_rate": 9.890738003669029e-06,
230
+ "loss": 2.3274,
231
+ "step": 37
232
+ },
233
+ {
234
+ "epoch": 0.39,
235
+ "learning_rate": 9.883829406604363e-06,
236
+ "loss": 2.3744,
237
+ "step": 38
238
+ },
239
+ {
240
+ "epoch": 0.4,
241
+ "learning_rate": 9.876711602542564e-06,
242
+ "loss": 2.7945,
243
+ "step": 39
244
+ },
245
+ {
246
+ "epoch": 0.41,
247
+ "learning_rate": 9.869384896386669e-06,
248
+ "loss": 2.3775,
249
+ "step": 40
250
+ },
251
+ {
252
+ "epoch": 0.42,
253
+ "learning_rate": 9.861849601988384e-06,
254
+ "loss": 1.9743,
255
+ "step": 41
256
+ },
257
+ {
258
+ "epoch": 0.43,
259
+ "learning_rate": 9.854106042134642e-06,
260
+ "loss": 2.6625,
261
+ "step": 42
262
+ },
263
+ {
264
+ "epoch": 0.44,
265
+ "learning_rate": 9.846154548533773e-06,
266
+ "loss": 2.3661,
267
+ "step": 43
268
+ },
269
+ {
270
+ "epoch": 0.45,
271
+ "learning_rate": 9.8379954618013e-06,
272
+ "loss": 2.2979,
273
+ "step": 44
274
+ },
275
+ {
276
+ "epoch": 0.46,
277
+ "learning_rate": 9.829629131445342e-06,
278
+ "loss": 2.3176,
279
+ "step": 45
280
+ },
281
+ {
282
+ "epoch": 0.47,
283
+ "learning_rate": 9.821055915851647e-06,
284
+ "loss": 2.2117,
285
+ "step": 46
286
+ },
287
+ {
288
+ "epoch": 0.48,
289
+ "learning_rate": 9.812276182268236e-06,
290
+ "loss": 1.9806,
291
+ "step": 47
292
+ },
293
+ {
294
+ "epoch": 0.49,
295
+ "learning_rate": 9.803290306789676e-06,
296
+ "loss": 2.2496,
297
+ "step": 48
298
+ },
299
+ {
300
+ "epoch": 0.5,
301
+ "learning_rate": 9.794098674340966e-06,
302
+ "loss": 2.3943,
303
+ "step": 49
304
+ },
305
+ {
306
+ "epoch": 0.51,
307
+ "learning_rate": 9.784701678661045e-06,
308
+ "loss": 2.0787,
309
+ "step": 50
310
+ },
311
+ {
312
+ "epoch": 0.52,
313
+ "learning_rate": 9.775099722285934e-06,
314
+ "loss": 2.1421,
315
+ "step": 51
316
+ },
317
+ {
318
+ "epoch": 0.53,
319
+ "learning_rate": 9.765293216531486e-06,
320
+ "loss": 2.4088,
321
+ "step": 52
322
+ },
323
+ {
324
+ "epoch": 0.54,
325
+ "learning_rate": 9.755282581475769e-06,
326
+ "loss": 2.1875,
327
+ "step": 53
328
+ },
329
+ {
330
+ "epoch": 0.55,
331
+ "learning_rate": 9.745068245941071e-06,
332
+ "loss": 2.0356,
333
+ "step": 54
334
+ },
335
+ {
336
+ "epoch": 0.56,
337
+ "learning_rate": 9.73465064747553e-06,
338
+ "loss": 2.0821,
339
+ "step": 55
340
+ },
341
+ {
342
+ "epoch": 0.58,
343
+ "learning_rate": 9.72403023233439e-06,
344
+ "loss": 1.8047,
345
+ "step": 56
346
+ },
347
+ {
348
+ "epoch": 0.59,
349
+ "learning_rate": 9.713207455460893e-06,
350
+ "loss": 2.3556,
351
+ "step": 57
352
+ },
353
+ {
354
+ "epoch": 0.6,
355
+ "learning_rate": 9.702182780466775e-06,
356
+ "loss": 2.2028,
357
+ "step": 58
358
+ },
359
+ {
360
+ "epoch": 0.61,
361
+ "learning_rate": 9.690956679612422e-06,
362
+ "loss": 2.5292,
363
+ "step": 59
364
+ },
365
+ {
366
+ "epoch": 0.62,
367
+ "learning_rate": 9.67952963378663e-06,
368
+ "loss": 2.0529,
369
+ "step": 60
370
+ },
371
+ {
372
+ "epoch": 0.63,
373
+ "learning_rate": 9.667902132486009e-06,
374
+ "loss": 2.3667,
375
+ "step": 61
376
+ },
377
+ {
378
+ "epoch": 0.64,
379
+ "learning_rate": 9.656074673794018e-06,
380
+ "loss": 2.2068,
381
+ "step": 62
382
+ },
383
+ {
384
+ "epoch": 0.65,
385
+ "learning_rate": 9.644047764359623e-06,
386
+ "loss": 2.3572,
387
+ "step": 63
388
+ },
389
+ {
390
+ "epoch": 0.66,
391
+ "learning_rate": 9.63182191937559e-06,
392
+ "loss": 1.9575,
393
+ "step": 64
394
+ },
395
+ {
396
+ "epoch": 0.67,
397
+ "learning_rate": 9.619397662556434e-06,
398
+ "loss": 2.1685,
399
+ "step": 65
400
+ },
401
+ {
402
+ "epoch": 0.68,
403
+ "learning_rate": 9.606775526115963e-06,
404
+ "loss": 2.2896,
405
+ "step": 66
406
+ },
407
+ {
408
+ "epoch": 0.69,
409
+ "learning_rate": 9.593956050744493e-06,
410
+ "loss": 2.3626,
411
+ "step": 67
412
+ },
413
+ {
414
+ "epoch": 0.7,
415
+ "learning_rate": 9.58093978558568e-06,
416
+ "loss": 2.0103,
417
+ "step": 68
418
+ },
419
+ {
420
+ "epoch": 0.71,
421
+ "learning_rate": 9.567727288213005e-06,
422
+ "loss": 2.1916,
423
+ "step": 69
424
+ },
425
+ {
426
+ "epoch": 0.72,
427
+ "learning_rate": 9.55431912460588e-06,
428
+ "loss": 2.2239,
429
+ "step": 70
430
+ },
431
+ {
432
+ "epoch": 0.73,
433
+ "learning_rate": 9.540715869125407e-06,
434
+ "loss": 1.8908,
435
+ "step": 71
436
+ },
437
+ {
438
+ "epoch": 0.74,
439
+ "learning_rate": 9.526918104489777e-06,
440
+ "loss": 2.2892,
441
+ "step": 72
442
+ },
443
+ {
444
+ "epoch": 0.75,
445
+ "learning_rate": 9.512926421749305e-06,
446
+ "loss": 1.9166,
447
+ "step": 73
448
+ },
449
+ {
450
+ "epoch": 0.76,
451
+ "learning_rate": 9.498741420261109e-06,
452
+ "loss": 2.0043,
453
+ "step": 74
454
+ },
455
+ {
456
+ "epoch": 0.77,
457
+ "learning_rate": 9.484363707663443e-06,
458
+ "loss": 2.3196,
459
+ "step": 75
460
+ },
461
+ {
462
+ "epoch": 0.78,
463
+ "learning_rate": 9.469793899849663e-06,
464
+ "loss": 2.2653,
465
+ "step": 76
466
+ },
467
+ {
468
+ "epoch": 0.79,
469
+ "learning_rate": 9.45503262094184e-06,
470
+ "loss": 2.034,
471
+ "step": 77
472
+ },
473
+ {
474
+ "epoch": 0.8,
475
+ "learning_rate": 9.440080503264038e-06,
476
+ "loss": 2.1738,
477
+ "step": 78
478
+ },
479
+ {
480
+ "epoch": 0.81,
481
+ "learning_rate": 9.42493818731521e-06,
482
+ "loss": 2.1786,
483
+ "step": 79
484
+ },
485
+ {
486
+ "epoch": 0.82,
487
+ "learning_rate": 9.409606321741776e-06,
488
+ "loss": 1.896,
489
+ "step": 80
490
+ },
491
+ {
492
+ "epoch": 0.83,
493
+ "learning_rate": 9.394085563309827e-06,
494
+ "loss": 2.1103,
495
+ "step": 81
496
+ },
497
+ {
498
+ "epoch": 0.84,
499
+ "learning_rate": 9.378376576876999e-06,
500
+ "loss": 1.8544,
501
+ "step": 82
502
+ },
503
+ {
504
+ "epoch": 0.85,
505
+ "learning_rate": 9.362480035363987e-06,
506
+ "loss": 1.9015,
507
+ "step": 83
508
+ },
509
+ {
510
+ "epoch": 0.86,
511
+ "learning_rate": 9.34639661972572e-06,
512
+ "loss": 2.3878,
513
+ "step": 84
514
+ },
515
+ {
516
+ "epoch": 0.87,
517
+ "learning_rate": 9.330127018922195e-06,
518
+ "loss": 1.9042,
519
+ "step": 85
520
+ },
521
+ {
522
+ "epoch": 0.88,
523
+ "learning_rate": 9.31367192988896e-06,
524
+ "loss": 2.297,
525
+ "step": 86
526
+ },
527
+ {
528
+ "epoch": 0.89,
529
+ "learning_rate": 9.297032057507264e-06,
530
+ "loss": 2.1189,
531
+ "step": 87
532
+ },
533
+ {
534
+ "epoch": 0.9,
535
+ "learning_rate": 9.280208114573859e-06,
536
+ "loss": 2.156,
537
+ "step": 88
538
+ },
539
+ {
540
+ "epoch": 0.91,
541
+ "learning_rate": 9.263200821770462e-06,
542
+ "loss": 2.0641,
543
+ "step": 89
544
+ },
545
+ {
546
+ "epoch": 0.92,
547
+ "learning_rate": 9.246010907632894e-06,
548
+ "loss": 2.3262,
549
+ "step": 90
550
+ },
551
+ {
552
+ "epoch": 0.93,
553
+ "learning_rate": 9.228639108519867e-06,
554
+ "loss": 2.0385,
555
+ "step": 91
556
+ },
557
+ {
558
+ "epoch": 0.94,
559
+ "learning_rate": 9.211086168581433e-06,
560
+ "loss": 2.0262,
561
+ "step": 92
562
+ },
563
+ {
564
+ "epoch": 0.96,
565
+ "learning_rate": 9.193352839727122e-06,
566
+ "loss": 2.4263,
567
+ "step": 93
568
+ },
569
+ {
570
+ "epoch": 0.97,
571
+ "learning_rate": 9.175439881593716e-06,
572
+ "loss": 1.9041,
573
+ "step": 94
574
+ },
575
+ {
576
+ "epoch": 0.98,
577
+ "learning_rate": 9.157348061512728e-06,
578
+ "loss": 2.1657,
579
+ "step": 95
580
+ },
581
+ {
582
+ "epoch": 0.99,
583
+ "learning_rate": 9.139078154477512e-06,
584
+ "loss": 2.2347,
585
+ "step": 96
586
+ },
587
+ {
588
+ "epoch": 1.0,
589
+ "learning_rate": 9.120630943110078e-06,
590
+ "loss": 2.1755,
591
+ "step": 97
592
+ },
593
+ {
594
+ "epoch": 1.01,
595
+ "learning_rate": 9.102007217627568e-06,
596
+ "loss": 2.0328,
597
+ "step": 98
598
+ },
599
+ {
600
+ "epoch": 1.02,
601
+ "learning_rate": 9.083207775808395e-06,
602
+ "loss": 2.149,
603
+ "step": 99
604
+ },
605
+ {
606
+ "epoch": 1.03,
607
+ "learning_rate": 9.064233422958078e-06,
608
+ "loss": 2.1247,
609
+ "step": 100
610
+ },
611
+ {
612
+ "epoch": 1.04,
613
+ "learning_rate": 9.045084971874738e-06,
614
+ "loss": 1.9357,
615
+ "step": 101
616
+ },
617
+ {
618
+ "epoch": 1.05,
619
+ "learning_rate": 9.025763242814291e-06,
620
+ "loss": 1.8592,
621
+ "step": 102
622
+ },
623
+ {
624
+ "epoch": 1.06,
625
+ "learning_rate": 9.006269063455305e-06,
626
+ "loss": 2.0261,
627
+ "step": 103
628
+ },
629
+ {
630
+ "epoch": 1.07,
631
+ "learning_rate": 8.986603268863536e-06,
632
+ "loss": 1.9487,
633
+ "step": 104
634
+ },
635
+ {
636
+ "epoch": 1.08,
637
+ "learning_rate": 8.966766701456177e-06,
638
+ "loss": 2.1715,
639
+ "step": 105
640
+ },
641
+ {
642
+ "epoch": 1.09,
643
+ "learning_rate": 8.94676021096575e-06,
644
+ "loss": 2.1337,
645
+ "step": 106
646
+ },
647
+ {
648
+ "epoch": 1.1,
649
+ "learning_rate": 8.926584654403725e-06,
650
+ "loss": 2.3317,
651
+ "step": 107
652
+ },
653
+ {
654
+ "epoch": 1.11,
655
+ "learning_rate": 8.906240896023794e-06,
656
+ "loss": 2.0257,
657
+ "step": 108
658
+ },
659
+ {
660
+ "epoch": 1.12,
661
+ "learning_rate": 8.885729807284855e-06,
662
+ "loss": 2.0842,
663
+ "step": 109
664
+ },
665
+ {
666
+ "epoch": 1.13,
667
+ "learning_rate": 8.865052266813686e-06,
668
+ "loss": 2.2196,
669
+ "step": 110
670
+ },
671
+ {
672
+ "epoch": 1.14,
673
+ "learning_rate": 8.844209160367298e-06,
674
+ "loss": 2.0957,
675
+ "step": 111
676
+ },
677
+ {
678
+ "epoch": 1.15,
679
+ "learning_rate": 8.823201380795003e-06,
680
+ "loss": 2.1453,
681
+ "step": 112
682
+ },
683
+ {
684
+ "epoch": 1.16,
685
+ "learning_rate": 8.802029828000157e-06,
686
+ "loss": 2.1887,
687
+ "step": 113
688
+ },
689
+ {
690
+ "epoch": 1.17,
691
+ "learning_rate": 8.780695408901613e-06,
692
+ "loss": 2.032,
693
+ "step": 114
694
+ },
695
+ {
696
+ "epoch": 1.18,
697
+ "learning_rate": 8.759199037394888e-06,
698
+ "loss": 2.2083,
699
+ "step": 115
700
+ },
701
+ {
702
+ "epoch": 1.19,
703
+ "learning_rate": 8.737541634312985e-06,
704
+ "loss": 2.3168,
705
+ "step": 116
706
+ },
707
+ {
708
+ "epoch": 1.2,
709
+ "learning_rate": 8.715724127386971e-06,
710
+ "loss": 1.9182,
711
+ "step": 117
712
+ },
713
+ {
714
+ "epoch": 1.21,
715
+ "learning_rate": 8.693747451206231e-06,
716
+ "loss": 1.8499,
717
+ "step": 118
718
+ },
719
+ {
720
+ "epoch": 1.22,
721
+ "learning_rate": 8.671612547178428e-06,
722
+ "loss": 2.1667,
723
+ "step": 119
724
+ },
725
+ {
726
+ "epoch": 1.23,
727
+ "learning_rate": 8.649320363489178e-06,
728
+ "loss": 1.9357,
729
+ "step": 120
730
+ },
731
+ {
732
+ "epoch": 1.24,
733
+ "learning_rate": 8.626871855061438e-06,
734
+ "loss": 2.0429,
735
+ "step": 121
736
+ },
737
+ {
738
+ "epoch": 1.25,
739
+ "learning_rate": 8.604267983514595e-06,
740
+ "loss": 1.8081,
741
+ "step": 122
742
+ },
743
+ {
744
+ "epoch": 1.26,
745
+ "learning_rate": 8.581509717123272e-06,
746
+ "loss": 1.6956,
747
+ "step": 123
748
+ },
749
+ {
750
+ "epoch": 1.27,
751
+ "learning_rate": 8.558598030775857e-06,
752
+ "loss": 2.2946,
753
+ "step": 124
754
+ },
755
+ {
756
+ "epoch": 1.28,
757
+ "learning_rate": 8.535533905932739e-06,
758
+ "loss": 2.1193,
759
+ "step": 125
760
+ },
761
+ {
762
+ "epoch": 1.29,
763
+ "learning_rate": 8.51231833058426e-06,
764
+ "loss": 2.327,
765
+ "step": 126
766
+ },
767
+ {
768
+ "epoch": 1.3,
769
+ "learning_rate": 8.488952299208402e-06,
770
+ "loss": 1.911,
771
+ "step": 127
772
+ },
773
+ {
774
+ "epoch": 1.31,
775
+ "learning_rate": 8.465436812728181e-06,
776
+ "loss": 2.2266,
777
+ "step": 128
778
+ },
779
+ {
780
+ "epoch": 1.32,
781
+ "learning_rate": 8.44177287846877e-06,
782
+ "loss": 2.1731,
783
+ "step": 129
784
+ },
785
+ {
786
+ "epoch": 1.34,
787
+ "learning_rate": 8.417961510114357e-06,
788
+ "loss": 2.2541,
789
+ "step": 130
790
+ },
791
+ {
792
+ "epoch": 1.35,
793
+ "learning_rate": 8.39400372766471e-06,
794
+ "loss": 2.0563,
795
+ "step": 131
796
+ },
797
+ {
798
+ "epoch": 1.36,
799
+ "learning_rate": 8.36990055739149e-06,
800
+ "loss": 1.8764,
801
+ "step": 132
802
+ },
803
+ {
804
+ "epoch": 1.37,
805
+ "learning_rate": 8.345653031794292e-06,
806
+ "loss": 2.3466,
807
+ "step": 133
808
+ },
809
+ {
810
+ "epoch": 1.38,
811
+ "learning_rate": 8.32126218955641e-06,
812
+ "loss": 2.2691,
813
+ "step": 134
814
+ },
815
+ {
816
+ "epoch": 1.39,
817
+ "learning_rate": 8.296729075500345e-06,
818
+ "loss": 2.1656,
819
+ "step": 135
820
+ },
821
+ {
822
+ "epoch": 1.4,
823
+ "learning_rate": 8.272054740543053e-06,
824
+ "loss": 2.2326,
825
+ "step": 136
826
+ },
827
+ {
828
+ "epoch": 1.41,
829
+ "learning_rate": 8.247240241650918e-06,
830
+ "loss": 1.8526,
831
+ "step": 137
832
+ },
833
+ {
834
+ "epoch": 1.42,
835
+ "learning_rate": 8.222286641794488e-06,
836
+ "loss": 1.6012,
837
+ "step": 138
838
+ },
839
+ {
840
+ "epoch": 1.43,
841
+ "learning_rate": 8.197195009902924e-06,
842
+ "loss": 1.947,
843
+ "step": 139
844
+ },
845
+ {
846
+ "epoch": 1.44,
847
+ "learning_rate": 8.171966420818227e-06,
848
+ "loss": 1.8734,
849
+ "step": 140
850
+ },
851
+ {
852
+ "epoch": 1.45,
853
+ "learning_rate": 8.146601955249187e-06,
854
+ "loss": 1.756,
855
+ "step": 141
856
+ },
857
+ {
858
+ "epoch": 1.46,
859
+ "learning_rate": 8.12110269972509e-06,
860
+ "loss": 1.7878,
861
+ "step": 142
862
+ },
863
+ {
864
+ "epoch": 1.47,
865
+ "learning_rate": 8.095469746549172e-06,
866
+ "loss": 2.0159,
867
+ "step": 143
868
+ },
869
+ {
870
+ "epoch": 1.48,
871
+ "learning_rate": 8.069704193751834e-06,
872
+ "loss": 2.1754,
873
+ "step": 144
874
+ },
875
+ {
876
+ "epoch": 1.49,
877
+ "learning_rate": 8.043807145043604e-06,
878
+ "loss": 2.0156,
879
+ "step": 145
880
+ },
881
+ {
882
+ "epoch": 1.5,
883
+ "learning_rate": 8.017779709767857e-06,
884
+ "loss": 1.938,
885
+ "step": 146
886
+ },
887
+ {
888
+ "epoch": 1.51,
889
+ "learning_rate": 7.991623002853296e-06,
890
+ "loss": 1.9589,
891
+ "step": 147
892
+ },
893
+ {
894
+ "epoch": 1.52,
895
+ "learning_rate": 7.965338144766186e-06,
896
+ "loss": 2.0535,
897
+ "step": 148
898
+ },
899
+ {
900
+ "epoch": 1.53,
901
+ "learning_rate": 7.938926261462366e-06,
902
+ "loss": 2.0857,
903
+ "step": 149
904
+ },
905
+ {
906
+ "epoch": 1.54,
907
+ "learning_rate": 7.912388484339012e-06,
908
+ "loss": 2.2401,
909
+ "step": 150
910
+ },
911
+ {
912
+ "epoch": 1.55,
913
+ "learning_rate": 7.88572595018617e-06,
914
+ "loss": 1.9925,
915
+ "step": 151
916
+ },
917
+ {
918
+ "epoch": 1.56,
919
+ "learning_rate": 7.858939801138061e-06,
920
+ "loss": 2.2118,
921
+ "step": 152
922
+ },
923
+ {
924
+ "epoch": 1.57,
925
+ "learning_rate": 7.832031184624165e-06,
926
+ "loss": 1.8856,
927
+ "step": 153
928
+ },
929
+ {
930
+ "epoch": 1.58,
931
+ "learning_rate": 7.80500125332005e-06,
932
+ "loss": 1.8032,
933
+ "step": 154
934
+ },
935
+ {
936
+ "epoch": 1.59,
937
+ "learning_rate": 7.777851165098012e-06,
938
+ "loss": 2.0556,
939
+ "step": 155
940
+ },
941
+ {
942
+ "epoch": 1.6,
943
+ "learning_rate": 7.750582082977468e-06,
944
+ "loss": 2.1473,
945
+ "step": 156
946
+ },
947
+ {
948
+ "epoch": 1.61,
949
+ "learning_rate": 7.723195175075136e-06,
950
+ "loss": 1.767,
951
+ "step": 157
952
+ },
953
+ {
954
+ "epoch": 1.62,
955
+ "learning_rate": 7.695691614555002e-06,
956
+ "loss": 1.8623,
957
+ "step": 158
958
+ },
959
+ {
960
+ "epoch": 1.63,
961
+ "learning_rate": 7.66807257957806e-06,
962
+ "loss": 1.9875,
963
+ "step": 159
964
+ },
965
+ {
966
+ "epoch": 1.64,
967
+ "learning_rate": 7.64033925325184e-06,
968
+ "loss": 2.0664,
969
+ "step": 160
970
+ },
971
+ {
972
+ "epoch": 1.65,
973
+ "learning_rate": 7.612492823579744e-06,
974
+ "loss": 1.9954,
975
+ "step": 161
976
+ },
977
+ {
978
+ "epoch": 1.66,
979
+ "learning_rate": 7.584534483410137e-06,
980
+ "loss": 1.7128,
981
+ "step": 162
982
+ },
983
+ {
984
+ "epoch": 1.67,
985
+ "learning_rate": 7.55646543038526e-06,
986
+ "loss": 2.4184,
987
+ "step": 163
988
+ },
989
+ {
990
+ "epoch": 1.68,
991
+ "learning_rate": 7.528286866889924e-06,
992
+ "loss": 2.2349,
993
+ "step": 164
994
+ },
995
+ {
996
+ "epoch": 1.69,
997
+ "learning_rate": 7.500000000000001e-06,
998
+ "loss": 1.9001,
999
+ "step": 165
1000
+ },
1001
+ {
1002
+ "epoch": 1.7,
1003
+ "learning_rate": 7.471606041430724e-06,
1004
+ "loss": 1.8973,
1005
+ "step": 166
1006
+ },
1007
+ {
1008
+ "epoch": 1.72,
1009
+ "learning_rate": 7.443106207484776e-06,
1010
+ "loss": 2.0085,
1011
+ "step": 167
1012
+ },
1013
+ {
1014
+ "epoch": 1.73,
1015
+ "learning_rate": 7.414501719000187e-06,
1016
+ "loss": 1.5986,
1017
+ "step": 168
1018
+ },
1019
+ {
1020
+ "epoch": 1.74,
1021
+ "learning_rate": 7.3857938012980425e-06,
1022
+ "loss": 2.2827,
1023
+ "step": 169
1024
+ },
1025
+ {
1026
+ "epoch": 1.75,
1027
+ "learning_rate": 7.3569836841299905e-06,
1028
+ "loss": 1.8377,
1029
+ "step": 170
1030
+ },
1031
+ {
1032
+ "epoch": 1.76,
1033
+ "learning_rate": 7.328072601625558e-06,
1034
+ "loss": 1.9012,
1035
+ "step": 171
1036
+ },
1037
+ {
1038
+ "epoch": 1.77,
1039
+ "learning_rate": 7.2990617922393e-06,
1040
+ "loss": 1.8906,
1041
+ "step": 172
1042
+ },
1043
+ {
1044
+ "epoch": 1.78,
1045
+ "learning_rate": 7.269952498697734e-06,
1046
+ "loss": 2.0498,
1047
+ "step": 173
1048
+ },
1049
+ {
1050
+ "epoch": 1.79,
1051
+ "learning_rate": 7.240745967946113e-06,
1052
+ "loss": 2.1313,
1053
+ "step": 174
1054
+ },
1055
+ {
1056
+ "epoch": 1.8,
1057
+ "learning_rate": 7.211443451095007e-06,
1058
+ "loss": 1.8483,
1059
+ "step": 175
1060
+ },
1061
+ {
1062
+ "epoch": 1.81,
1063
+ "learning_rate": 7.18204620336671e-06,
1064
+ "loss": 2.0565,
1065
+ "step": 176
1066
+ },
1067
+ {
1068
+ "epoch": 1.82,
1069
+ "learning_rate": 7.1525554840414765e-06,
1070
+ "loss": 1.8597,
1071
+ "step": 177
1072
+ },
1073
+ {
1074
+ "epoch": 1.83,
1075
+ "learning_rate": 7.1229725564035665e-06,
1076
+ "loss": 2.0648,
1077
+ "step": 178
1078
+ },
1079
+ {
1080
+ "epoch": 1.84,
1081
+ "learning_rate": 7.093298687687141e-06,
1082
+ "loss": 2.0188,
1083
+ "step": 179
1084
+ },
1085
+ {
1086
+ "epoch": 1.85,
1087
+ "learning_rate": 7.063535149021974e-06,
1088
+ "loss": 1.8016,
1089
+ "step": 180
1090
+ },
1091
+ {
1092
+ "epoch": 1.86,
1093
+ "learning_rate": 7.033683215379002e-06,
1094
+ "loss": 2.2722,
1095
+ "step": 181
1096
+ },
1097
+ {
1098
+ "epoch": 1.87,
1099
+ "learning_rate": 7.0037441655157045e-06,
1100
+ "loss": 2.044,
1101
+ "step": 182
1102
+ },
1103
+ {
1104
+ "epoch": 1.88,
1105
+ "learning_rate": 6.973719281921336e-06,
1106
+ "loss": 2.0889,
1107
+ "step": 183
1108
+ },
1109
+ {
1110
+ "epoch": 1.89,
1111
+ "learning_rate": 6.943609850761979e-06,
1112
+ "loss": 1.9273,
1113
+ "step": 184
1114
+ },
1115
+ {
1116
+ "epoch": 1.9,
1117
+ "learning_rate": 6.913417161825449e-06,
1118
+ "loss": 1.8093,
1119
+ "step": 185
1120
+ },
1121
+ {
1122
+ "epoch": 1.91,
1123
+ "learning_rate": 6.883142508466054e-06,
1124
+ "loss": 1.8979,
1125
+ "step": 186
1126
+ },
1127
+ {
1128
+ "epoch": 1.92,
1129
+ "learning_rate": 6.852787187549182e-06,
1130
+ "loss": 1.5268,
1131
+ "step": 187
1132
+ },
1133
+ {
1134
+ "epoch": 1.93,
1135
+ "learning_rate": 6.822352499395751e-06,
1136
+ "loss": 2.2526,
1137
+ "step": 188
1138
+ },
1139
+ {
1140
+ "epoch": 1.94,
1141
+ "learning_rate": 6.7918397477265e-06,
1142
+ "loss": 2.0474,
1143
+ "step": 189
1144
+ },
1145
+ {
1146
+ "epoch": 1.95,
1147
+ "learning_rate": 6.7612502396061685e-06,
1148
+ "loss": 2.0026,
1149
+ "step": 190
1150
+ },
1151
+ {
1152
+ "epoch": 1.96,
1153
+ "learning_rate": 6.730585285387465e-06,
1154
+ "loss": 2.0033,
1155
+ "step": 191
1156
+ },
1157
+ {
1158
+ "epoch": 1.97,
1159
+ "learning_rate": 6.6998461986549715e-06,
1160
+ "loss": 1.719,
1161
+ "step": 192
1162
+ },
1163
+ {
1164
+ "epoch": 1.98,
1165
+ "learning_rate": 6.669034296168855e-06,
1166
+ "loss": 1.829,
1167
+ "step": 193
1168
+ },
1169
+ {
1170
+ "epoch": 1.99,
1171
+ "learning_rate": 6.638150897808469e-06,
1172
+ "loss": 2.0211,
1173
+ "step": 194
1174
+ },
1175
+ {
1176
+ "epoch": 2.0,
1177
+ "learning_rate": 6.607197326515808e-06,
1178
+ "loss": 2.052,
1179
+ "step": 195
1180
+ },
1181
+ {
1182
+ "epoch": 2.01,
1183
+ "learning_rate": 6.57617490823885e-06,
1184
+ "loss": 1.9236,
1185
+ "step": 196
1186
+ },
1187
+ {
1188
+ "epoch": 2.02,
1189
+ "learning_rate": 6.545084971874738e-06,
1190
+ "loss": 1.989,
1191
+ "step": 197
1192
+ },
1193
+ {
1194
+ "epoch": 2.03,
1195
+ "learning_rate": 6.513928849212874e-06,
1196
+ "loss": 1.7597,
1197
+ "step": 198
1198
+ },
1199
+ {
1200
+ "epoch": 2.04,
1201
+ "learning_rate": 6.482707874877855e-06,
1202
+ "loss": 2.0161,
1203
+ "step": 199
1204
+ },
1205
+ {
1206
+ "epoch": 2.05,
1207
+ "learning_rate": 6.451423386272312e-06,
1208
+ "loss": 2.167,
1209
+ "step": 200
1210
+ },
1211
+ {
1212
+ "epoch": 2.06,
1213
+ "learning_rate": 6.420076723519615e-06,
1214
+ "loss": 2.1043,
1215
+ "step": 201
1216
+ },
1217
+ {
1218
+ "epoch": 2.07,
1219
+ "learning_rate": 6.388669229406462e-06,
1220
+ "loss": 1.7945,
1221
+ "step": 202
1222
+ },
1223
+ {
1224
+ "epoch": 2.08,
1225
+ "learning_rate": 6.3572022493253715e-06,
1226
+ "loss": 1.8759,
1227
+ "step": 203
1228
+ },
1229
+ {
1230
+ "epoch": 2.09,
1231
+ "learning_rate": 6.325677131217041e-06,
1232
+ "loss": 1.9408,
1233
+ "step": 204
1234
+ },
1235
+ {
1236
+ "epoch": 2.11,
1237
+ "learning_rate": 6.294095225512604e-06,
1238
+ "loss": 1.9382,
1239
+ "step": 205
1240
+ },
1241
+ {
1242
+ "epoch": 2.12,
1243
+ "learning_rate": 6.26245788507579e-06,
1244
+ "loss": 1.953,
1245
+ "step": 206
1246
+ },
1247
+ {
1248
+ "epoch": 2.13,
1249
+ "learning_rate": 6.230766465144966e-06,
1250
+ "loss": 1.9079,
1251
+ "step": 207
1252
+ },
1253
+ {
1254
+ "epoch": 2.14,
1255
+ "learning_rate": 6.199022323275083e-06,
1256
+ "loss": 2.141,
1257
+ "step": 208
1258
+ },
1259
+ {
1260
+ "epoch": 2.15,
1261
+ "learning_rate": 6.1672268192795285e-06,
1262
+ "loss": 1.7766,
1263
+ "step": 209
1264
+ },
1265
+ {
1266
+ "epoch": 2.16,
1267
+ "learning_rate": 6.135381315171867e-06,
1268
+ "loss": 1.8225,
1269
+ "step": 210
1270
+ },
1271
+ {
1272
+ "epoch": 2.17,
1273
+ "learning_rate": 6.103487175107508e-06,
1274
+ "loss": 1.9764,
1275
+ "step": 211
1276
+ },
1277
+ {
1278
+ "epoch": 2.18,
1279
+ "learning_rate": 6.071545765325254e-06,
1280
+ "loss": 1.815,
1281
+ "step": 212
1282
+ },
1283
+ {
1284
+ "epoch": 2.19,
1285
+ "learning_rate": 6.039558454088796e-06,
1286
+ "loss": 2.0872,
1287
+ "step": 213
1288
+ },
1289
+ {
1290
+ "epoch": 2.2,
1291
+ "learning_rate": 6.0075266116280865e-06,
1292
+ "loss": 2.0516,
1293
+ "step": 214
1294
+ },
1295
+ {
1296
+ "epoch": 2.21,
1297
+ "learning_rate": 5.975451610080643e-06,
1298
+ "loss": 1.9711,
1299
+ "step": 215
1300
+ },
1301
+ {
1302
+ "epoch": 2.22,
1303
+ "learning_rate": 5.943334823432777e-06,
1304
+ "loss": 2.0024,
1305
+ "step": 216
1306
+ },
1307
+ {
1308
+ "epoch": 2.23,
1309
+ "learning_rate": 5.911177627460739e-06,
1310
+ "loss": 2.0042,
1311
+ "step": 217
1312
+ },
1313
+ {
1314
+ "epoch": 2.24,
1315
+ "learning_rate": 5.878981399671774e-06,
1316
+ "loss": 1.7748,
1317
+ "step": 218
1318
+ },
1319
+ {
1320
+ "epoch": 2.25,
1321
+ "learning_rate": 5.846747519245123e-06,
1322
+ "loss": 2.0583,
1323
+ "step": 219
1324
+ },
1325
+ {
1326
+ "epoch": 2.26,
1327
+ "learning_rate": 5.814477366972945e-06,
1328
+ "loss": 2.1047,
1329
+ "step": 220
1330
+ },
1331
+ {
1332
+ "epoch": 2.27,
1333
+ "learning_rate": 5.782172325201155e-06,
1334
+ "loss": 1.9893,
1335
+ "step": 221
1336
+ },
1337
+ {
1338
+ "epoch": 2.28,
1339
+ "learning_rate": 5.749833777770225e-06,
1340
+ "loss": 1.8167,
1341
+ "step": 222
1342
+ },
1343
+ {
1344
+ "epoch": 2.29,
1345
+ "learning_rate": 5.717463109955896e-06,
1346
+ "loss": 1.8661,
1347
+ "step": 223
1348
+ },
1349
+ {
1350
+ "epoch": 2.3,
1351
+ "learning_rate": 5.6850617084098416e-06,
1352
+ "loss": 2.0974,
1353
+ "step": 224
1354
+ },
1355
+ {
1356
+ "epoch": 2.31,
1357
+ "learning_rate": 5.65263096110026e-06,
1358
+ "loss": 1.8873,
1359
+ "step": 225
1360
+ },
1361
+ {
1362
+ "epoch": 2.32,
1363
+ "learning_rate": 5.620172257252427e-06,
1364
+ "loss": 1.7506,
1365
+ "step": 226
1366
+ },
1367
+ {
1368
+ "epoch": 2.33,
1369
+ "learning_rate": 5.587686987289189e-06,
1370
+ "loss": 1.9003,
1371
+ "step": 227
1372
+ },
1373
+ {
1374
+ "epoch": 2.34,
1375
+ "learning_rate": 5.555176542771389e-06,
1376
+ "loss": 1.906,
1377
+ "step": 228
1378
+ },
1379
+ {
1380
+ "epoch": 2.35,
1381
+ "learning_rate": 5.522642316338268e-06,
1382
+ "loss": 1.935,
1383
+ "step": 229
1384
+ },
1385
+ {
1386
+ "epoch": 2.36,
1387
+ "learning_rate": 5.490085701647805e-06,
1388
+ "loss": 1.7954,
1389
+ "step": 230
1390
+ },
1391
+ {
1392
+ "epoch": 2.37,
1393
+ "learning_rate": 5.457508093317013e-06,
1394
+ "loss": 1.9815,
1395
+ "step": 231
1396
+ },
1397
+ {
1398
+ "epoch": 2.38,
1399
+ "learning_rate": 5.4249108868622095e-06,
1400
+ "loss": 1.6584,
1401
+ "step": 232
1402
+ },
1403
+ {
1404
+ "epoch": 2.39,
1405
+ "learning_rate": 5.392295478639226e-06,
1406
+ "loss": 1.8019,
1407
+ "step": 233
1408
+ },
1409
+ {
1410
+ "epoch": 2.4,
1411
+ "learning_rate": 5.3596632657835975e-06,
1412
+ "loss": 2.1204,
1413
+ "step": 234
1414
+ },
1415
+ {
1416
+ "epoch": 2.41,
1417
+ "learning_rate": 5.327015646150716e-06,
1418
+ "loss": 2.1109,
1419
+ "step": 235
1420
+ },
1421
+ {
1422
+ "epoch": 2.42,
1423
+ "learning_rate": 5.294354018255945e-06,
1424
+ "loss": 1.9626,
1425
+ "step": 236
1426
+ },
1427
+ {
1428
+ "epoch": 2.43,
1429
+ "learning_rate": 5.2616797812147205e-06,
1430
+ "loss": 1.8431,
1431
+ "step": 237
1432
+ },
1433
+ {
1434
+ "epoch": 2.44,
1435
+ "learning_rate": 5.228994334682605e-06,
1436
+ "loss": 1.818,
1437
+ "step": 238
1438
+ },
1439
+ {
1440
+ "epoch": 2.45,
1441
+ "learning_rate": 5.1962990787953436e-06,
1442
+ "loss": 1.8086,
1443
+ "step": 239
1444
+ },
1445
+ {
1446
+ "epoch": 2.46,
1447
+ "learning_rate": 5.1635954141088815e-06,
1448
+ "loss": 1.8096,
1449
+ "step": 240
1450
+ },
1451
+ {
1452
+ "epoch": 2.47,
1453
+ "learning_rate": 5.130884741539367e-06,
1454
+ "loss": 1.9406,
1455
+ "step": 241
1456
+ },
1457
+ {
1458
+ "epoch": 2.49,
1459
+ "learning_rate": 5.098168462303141e-06,
1460
+ "loss": 2.0109,
1461
+ "step": 242
1462
+ },
1463
+ {
1464
+ "epoch": 2.5,
1465
+ "learning_rate": 5.065447977856723e-06,
1466
+ "loss": 1.8903,
1467
+ "step": 243
1468
+ },
1469
+ {
1470
+ "epoch": 2.51,
1471
+ "learning_rate": 5.0327246898367595e-06,
1472
+ "loss": 1.9648,
1473
+ "step": 244
1474
+ },
1475
+ {
1476
+ "epoch": 2.52,
1477
+ "learning_rate": 5e-06,
1478
+ "loss": 1.9892,
1479
+ "step": 245
1480
+ },
1481
+ {
1482
+ "epoch": 2.53,
1483
+ "learning_rate": 4.967275310163241e-06,
1484
+ "loss": 2.0007,
1485
+ "step": 246
1486
+ },
1487
+ {
1488
+ "epoch": 2.54,
1489
+ "learning_rate": 4.934552022143279e-06,
1490
+ "loss": 1.7414,
1491
+ "step": 247
1492
+ },
1493
+ {
1494
+ "epoch": 2.55,
1495
+ "learning_rate": 4.90183153769686e-06,
1496
+ "loss": 1.701,
1497
+ "step": 248
1498
+ },
1499
+ {
1500
+ "epoch": 2.56,
1501
+ "learning_rate": 4.869115258460636e-06,
1502
+ "loss": 2.3587,
1503
+ "step": 249
1504
+ },
1505
+ {
1506
+ "epoch": 2.57,
1507
+ "learning_rate": 4.83640458589112e-06,
1508
+ "loss": 1.8817,
1509
+ "step": 250
1510
+ },
1511
+ {
1512
+ "epoch": 2.58,
1513
+ "learning_rate": 4.803700921204659e-06,
1514
+ "loss": 1.9942,
1515
+ "step": 251
1516
+ },
1517
+ {
1518
+ "epoch": 2.59,
1519
+ "learning_rate": 4.771005665317398e-06,
1520
+ "loss": 2.2835,
1521
+ "step": 252
1522
+ },
1523
+ {
1524
+ "epoch": 2.6,
1525
+ "learning_rate": 4.738320218785281e-06,
1526
+ "loss": 1.4821,
1527
+ "step": 253
1528
+ },
1529
+ {
1530
+ "epoch": 2.61,
1531
+ "learning_rate": 4.705645981744055e-06,
1532
+ "loss": 1.8867,
1533
+ "step": 254
1534
+ },
1535
+ {
1536
+ "epoch": 2.62,
1537
+ "learning_rate": 4.672984353849285e-06,
1538
+ "loss": 2.2334,
1539
+ "step": 255
1540
+ },
1541
+ {
1542
+ "epoch": 2.63,
1543
+ "learning_rate": 4.640336734216403e-06,
1544
+ "loss": 1.8587,
1545
+ "step": 256
1546
+ },
1547
+ {
1548
+ "epoch": 2.64,
1549
+ "learning_rate": 4.6077045213607765e-06,
1550
+ "loss": 1.8544,
1551
+ "step": 257
1552
+ },
1553
+ {
1554
+ "epoch": 2.65,
1555
+ "learning_rate": 4.575089113137792e-06,
1556
+ "loss": 2.0754,
1557
+ "step": 258
1558
+ },
1559
+ {
1560
+ "epoch": 2.66,
1561
+ "learning_rate": 4.542491906682988e-06,
1562
+ "loss": 2.0149,
1563
+ "step": 259
1564
+ },
1565
+ {
1566
+ "epoch": 2.67,
1567
+ "learning_rate": 4.509914298352197e-06,
1568
+ "loss": 1.9791,
1569
+ "step": 260
1570
+ },
1571
+ {
1572
+ "epoch": 2.68,
1573
+ "learning_rate": 4.477357683661734e-06,
1574
+ "loss": 1.6395,
1575
+ "step": 261
1576
+ },
1577
+ {
1578
+ "epoch": 2.69,
1579
+ "learning_rate": 4.4448234572286126e-06,
1580
+ "loss": 2.11,
1581
+ "step": 262
1582
+ },
1583
+ {
1584
+ "epoch": 2.7,
1585
+ "learning_rate": 4.4123130127108125e-06,
1586
+ "loss": 2.041,
1587
+ "step": 263
1588
+ },
1589
+ {
1590
+ "epoch": 2.71,
1591
+ "learning_rate": 4.379827742747575e-06,
1592
+ "loss": 2.2184,
1593
+ "step": 264
1594
+ },
1595
+ {
1596
+ "epoch": 2.72,
1597
+ "learning_rate": 4.347369038899744e-06,
1598
+ "loss": 1.7426,
1599
+ "step": 265
1600
+ },
1601
+ {
1602
+ "epoch": 2.73,
1603
+ "learning_rate": 4.314938291590161e-06,
1604
+ "loss": 1.9714,
1605
+ "step": 266
1606
+ },
1607
+ {
1608
+ "epoch": 2.74,
1609
+ "learning_rate": 4.282536890044105e-06,
1610
+ "loss": 2.0392,
1611
+ "step": 267
1612
+ },
1613
+ {
1614
+ "epoch": 2.75,
1615
+ "learning_rate": 4.250166222229775e-06,
1616
+ "loss": 2.2633,
1617
+ "step": 268
1618
+ },
1619
+ {
1620
+ "epoch": 2.76,
1621
+ "learning_rate": 4.217827674798845e-06,
1622
+ "loss": 2.0275,
1623
+ "step": 269
1624
+ },
1625
+ {
1626
+ "epoch": 2.77,
1627
+ "learning_rate": 4.185522633027057e-06,
1628
+ "loss": 1.8916,
1629
+ "step": 270
1630
+ },
1631
+ {
1632
+ "epoch": 2.78,
1633
+ "learning_rate": 4.1532524807548776e-06,
1634
+ "loss": 1.7847,
1635
+ "step": 271
1636
+ },
1637
+ {
1638
+ "epoch": 2.79,
1639
+ "learning_rate": 4.1210186003282275e-06,
1640
+ "loss": 1.9785,
1641
+ "step": 272
1642
+ },
1643
+ {
1644
+ "epoch": 2.8,
1645
+ "learning_rate": 4.088822372539263e-06,
1646
+ "loss": 1.858,
1647
+ "step": 273
1648
+ },
1649
+ {
1650
+ "epoch": 2.81,
1651
+ "learning_rate": 4.056665176567225e-06,
1652
+ "loss": 2.0106,
1653
+ "step": 274
1654
+ },
1655
+ {
1656
+ "epoch": 2.82,
1657
+ "learning_rate": 4.02454838991936e-06,
1658
+ "loss": 1.9469,
1659
+ "step": 275
1660
+ },
1661
+ {
1662
+ "epoch": 2.83,
1663
+ "learning_rate": 3.992473388371914e-06,
1664
+ "loss": 2.327,
1665
+ "step": 276
1666
+ },
1667
+ {
1668
+ "epoch": 2.84,
1669
+ "learning_rate": 3.960441545911205e-06,
1670
+ "loss": 1.9751,
1671
+ "step": 277
1672
+ },
1673
+ {
1674
+ "epoch": 2.85,
1675
+ "learning_rate": 3.928454234674748e-06,
1676
+ "loss": 1.7995,
1677
+ "step": 278
1678
+ },
1679
+ {
1680
+ "epoch": 2.87,
1681
+ "learning_rate": 3.8965128248924956e-06,
1682
+ "loss": 1.853,
1683
+ "step": 279
1684
+ },
1685
+ {
1686
+ "epoch": 2.88,
1687
+ "learning_rate": 3.864618684828135e-06,
1688
+ "loss": 2.0151,
1689
+ "step": 280
1690
+ },
1691
+ {
1692
+ "epoch": 2.89,
1693
+ "learning_rate": 3.832773180720475e-06,
1694
+ "loss": 2.1437,
1695
+ "step": 281
1696
+ },
1697
+ {
1698
+ "epoch": 2.9,
1699
+ "learning_rate": 3.800977676724919e-06,
1700
+ "loss": 2.1601,
1701
+ "step": 282
1702
+ },
1703
+ {
1704
+ "epoch": 2.91,
1705
+ "learning_rate": 3.769233534855035e-06,
1706
+ "loss": 1.9736,
1707
+ "step": 283
1708
+ },
1709
+ {
1710
+ "epoch": 2.92,
1711
+ "learning_rate": 3.7375421149242102e-06,
1712
+ "loss": 1.7847,
1713
+ "step": 284
1714
+ },
1715
+ {
1716
+ "epoch": 2.93,
1717
+ "learning_rate": 3.705904774487396e-06,
1718
+ "loss": 2.1208,
1719
+ "step": 285
1720
+ },
1721
+ {
1722
+ "epoch": 2.94,
1723
+ "learning_rate": 3.6743228687829596e-06,
1724
+ "loss": 2.009,
1725
+ "step": 286
1726
+ },
1727
+ {
1728
+ "epoch": 2.95,
1729
+ "learning_rate": 3.6427977506746293e-06,
1730
+ "loss": 1.6825,
1731
+ "step": 287
1732
+ },
1733
+ {
1734
+ "epoch": 2.96,
1735
+ "learning_rate": 3.6113307705935398e-06,
1736
+ "loss": 1.6349,
1737
+ "step": 288
1738
+ },
1739
+ {
1740
+ "epoch": 2.97,
1741
+ "learning_rate": 3.579923276480387e-06,
1742
+ "loss": 2.0538,
1743
+ "step": 289
1744
+ },
1745
+ {
1746
+ "epoch": 2.98,
1747
+ "learning_rate": 3.5485766137276894e-06,
1748
+ "loss": 2.0987,
1749
+ "step": 290
1750
+ },
1751
+ {
1752
+ "epoch": 2.99,
1753
+ "learning_rate": 3.517292125122146e-06,
1754
+ "loss": 1.9249,
1755
+ "step": 291
1756
+ },
1757
+ {
1758
+ "epoch": 3.0,
1759
+ "learning_rate": 3.486071150787128e-06,
1760
+ "loss": 2.1965,
1761
+ "step": 292
1762
+ },
1763
+ {
1764
+ "epoch": 3.01,
1765
+ "learning_rate": 3.4549150281252635e-06,
1766
+ "loss": 1.8131,
1767
+ "step": 293
1768
+ },
1769
+ {
1770
+ "epoch": 3.02,
1771
+ "learning_rate": 3.4238250917611533e-06,
1772
+ "loss": 1.7838,
1773
+ "step": 294
1774
+ },
1775
+ {
1776
+ "epoch": 3.03,
1777
+ "learning_rate": 3.3928026734841935e-06,
1778
+ "loss": 1.7282,
1779
+ "step": 295
1780
+ },
1781
+ {
1782
+ "epoch": 3.04,
1783
+ "learning_rate": 3.3618491021915334e-06,
1784
+ "loss": 1.9375,
1785
+ "step": 296
1786
+ },
1787
+ {
1788
+ "epoch": 3.05,
1789
+ "learning_rate": 3.330965703831146e-06,
1790
+ "loss": 1.6664,
1791
+ "step": 297
1792
+ },
1793
+ {
1794
+ "epoch": 3.06,
1795
+ "learning_rate": 3.3001538013450285e-06,
1796
+ "loss": 2.164,
1797
+ "step": 298
1798
+ },
1799
+ {
1800
+ "epoch": 3.07,
1801
+ "learning_rate": 3.269414714612534e-06,
1802
+ "loss": 2.0269,
1803
+ "step": 299
1804
+ },
1805
+ {
1806
+ "epoch": 3.08,
1807
+ "learning_rate": 3.2387497603938327e-06,
1808
+ "loss": 1.9625,
1809
+ "step": 300
1810
+ },
1811
+ {
1812
+ "epoch": 3.09,
1813
+ "learning_rate": 3.2081602522734987e-06,
1814
+ "loss": 2.2313,
1815
+ "step": 301
1816
+ },
1817
+ {
1818
+ "epoch": 3.1,
1819
+ "learning_rate": 3.177647500604252e-06,
1820
+ "loss": 2.1034,
1821
+ "step": 302
1822
+ },
1823
+ {
1824
+ "epoch": 3.11,
1825
+ "learning_rate": 3.147212812450819e-06,
1826
+ "loss": 2.0628,
1827
+ "step": 303
1828
+ },
1829
+ {
1830
+ "epoch": 3.12,
1831
+ "learning_rate": 3.1168574915339465e-06,
1832
+ "loss": 2.2198,
1833
+ "step": 304
1834
+ },
1835
+ {
1836
+ "epoch": 3.13,
1837
+ "learning_rate": 3.0865828381745515e-06,
1838
+ "loss": 2.3057,
1839
+ "step": 305
1840
+ },
1841
+ {
1842
+ "epoch": 3.14,
1843
+ "learning_rate": 3.056390149238022e-06,
1844
+ "loss": 1.8151,
1845
+ "step": 306
1846
+ },
1847
+ {
1848
+ "epoch": 3.15,
1849
+ "learning_rate": 3.0262807180786647e-06,
1850
+ "loss": 2.0671,
1851
+ "step": 307
1852
+ },
1853
+ {
1854
+ "epoch": 3.16,
1855
+ "learning_rate": 2.9962558344842963e-06,
1856
+ "loss": 2.1226,
1857
+ "step": 308
1858
+ },
1859
+ {
1860
+ "epoch": 3.17,
1861
+ "learning_rate": 2.966316784621e-06,
1862
+ "loss": 2.0534,
1863
+ "step": 309
1864
+ },
1865
+ {
1866
+ "epoch": 3.18,
1867
+ "learning_rate": 2.936464850978027e-06,
1868
+ "loss": 2.1771,
1869
+ "step": 310
1870
+ },
1871
+ {
1872
+ "epoch": 3.19,
1873
+ "learning_rate": 2.906701312312861e-06,
1874
+ "loss": 2.1316,
1875
+ "step": 311
1876
+ },
1877
+ {
1878
+ "epoch": 3.2,
1879
+ "learning_rate": 2.8770274435964356e-06,
1880
+ "loss": 1.8236,
1881
+ "step": 312
1882
+ },
1883
+ {
1884
+ "epoch": 3.21,
1885
+ "learning_rate": 2.8474445159585235e-06,
1886
+ "loss": 1.8514,
1887
+ "step": 313
1888
+ },
1889
+ {
1890
+ "epoch": 3.22,
1891
+ "learning_rate": 2.817953796633289e-06,
1892
+ "loss": 2.1408,
1893
+ "step": 314
1894
+ },
1895
+ {
1896
+ "epoch": 3.23,
1897
+ "learning_rate": 2.7885565489049948e-06,
1898
+ "loss": 1.7615,
1899
+ "step": 315
1900
+ },
1901
+ {
1902
+ "epoch": 3.25,
1903
+ "learning_rate": 2.759254032053888e-06,
1904
+ "loss": 1.8991,
1905
+ "step": 316
1906
+ },
1907
+ {
1908
+ "epoch": 3.26,
1909
+ "learning_rate": 2.7300475013022666e-06,
1910
+ "loss": 1.8208,
1911
+ "step": 317
1912
+ },
1913
+ {
1914
+ "epoch": 3.27,
1915
+ "learning_rate": 2.700938207760701e-06,
1916
+ "loss": 1.6085,
1917
+ "step": 318
1918
+ },
1919
+ {
1920
+ "epoch": 3.28,
1921
+ "learning_rate": 2.671927398374443e-06,
1922
+ "loss": 1.8248,
1923
+ "step": 319
1924
+ },
1925
+ {
1926
+ "epoch": 3.29,
1927
+ "learning_rate": 2.6430163158700116e-06,
1928
+ "loss": 1.95,
1929
+ "step": 320
1930
+ },
1931
+ {
1932
+ "epoch": 3.3,
1933
+ "learning_rate": 2.614206198701958e-06,
1934
+ "loss": 1.7459,
1935
+ "step": 321
1936
+ },
1937
+ {
1938
+ "epoch": 3.31,
1939
+ "learning_rate": 2.5854982809998154e-06,
1940
+ "loss": 2.2413,
1941
+ "step": 322
1942
+ },
1943
+ {
1944
+ "epoch": 3.32,
1945
+ "learning_rate": 2.5568937925152272e-06,
1946
+ "loss": 2.181,
1947
+ "step": 323
1948
+ },
1949
+ {
1950
+ "epoch": 3.33,
1951
+ "learning_rate": 2.5283939585692787e-06,
1952
+ "loss": 1.6875,
1953
+ "step": 324
1954
+ },
1955
+ {
1956
+ "epoch": 3.34,
1957
+ "learning_rate": 2.5000000000000015e-06,
1958
+ "loss": 1.692,
1959
+ "step": 325
1960
+ },
1961
+ {
1962
+ "epoch": 3.35,
1963
+ "learning_rate": 2.471713133110078e-06,
1964
+ "loss": 1.8894,
1965
+ "step": 326
1966
+ },
1967
+ {
1968
+ "epoch": 3.36,
1969
+ "learning_rate": 2.4435345696147404e-06,
1970
+ "loss": 2.2015,
1971
+ "step": 327
1972
+ },
1973
+ {
1974
+ "epoch": 3.37,
1975
+ "learning_rate": 2.4154655165898626e-06,
1976
+ "loss": 1.8859,
1977
+ "step": 328
1978
+ },
1979
+ {
1980
+ "epoch": 3.38,
1981
+ "learning_rate": 2.387507176420256e-06,
1982
+ "loss": 2.0344,
1983
+ "step": 329
1984
+ },
1985
+ {
1986
+ "epoch": 3.39,
1987
+ "learning_rate": 2.3596607467481602e-06,
1988
+ "loss": 1.8513,
1989
+ "step": 330
1990
+ },
1991
+ {
1992
+ "epoch": 3.4,
1993
+ "learning_rate": 2.3319274204219427e-06,
1994
+ "loss": 1.9896,
1995
+ "step": 331
1996
+ },
1997
+ {
1998
+ "epoch": 3.41,
1999
+ "learning_rate": 2.304308385444999e-06,
2000
+ "loss": 1.6932,
2001
+ "step": 332
2002
+ },
2003
+ {
2004
+ "epoch": 3.42,
2005
+ "learning_rate": 2.2768048249248648e-06,
2006
+ "loss": 2.0101,
2007
+ "step": 333
2008
+ },
2009
+ {
2010
+ "epoch": 3.43,
2011
+ "learning_rate": 2.2494179170225333e-06,
2012
+ "loss": 1.793,
2013
+ "step": 334
2014
+ },
2015
+ {
2016
+ "epoch": 3.44,
2017
+ "learning_rate": 2.2221488349019903e-06,
2018
+ "loss": 1.8287,
2019
+ "step": 335
2020
+ },
2021
+ {
2022
+ "epoch": 3.45,
2023
+ "learning_rate": 2.1949987466799524e-06,
2024
+ "loss": 2.2081,
2025
+ "step": 336
2026
+ },
2027
+ {
2028
+ "epoch": 3.46,
2029
+ "learning_rate": 2.1679688153758373e-06,
2030
+ "loss": 1.9535,
2031
+ "step": 337
2032
+ },
2033
+ {
2034
+ "epoch": 3.47,
2035
+ "learning_rate": 2.1410601988619394e-06,
2036
+ "loss": 1.9921,
2037
+ "step": 338
2038
+ },
2039
+ {
2040
+ "epoch": 3.48,
2041
+ "learning_rate": 2.1142740498138327e-06,
2042
+ "loss": 2.0291,
2043
+ "step": 339
2044
+ },
2045
+ {
2046
+ "epoch": 3.49,
2047
+ "learning_rate": 2.08761151566099e-06,
2048
+ "loss": 2.063,
2049
+ "step": 340
2050
+ },
2051
+ {
2052
+ "epoch": 3.5,
2053
+ "learning_rate": 2.061073738537635e-06,
2054
+ "loss": 1.5788,
2055
+ "step": 341
2056
+ },
2057
+ {
2058
+ "epoch": 3.51,
2059
+ "learning_rate": 2.034661855233815e-06,
2060
+ "loss": 2.2809,
2061
+ "step": 342
2062
+ },
2063
+ {
2064
+ "epoch": 3.52,
2065
+ "learning_rate": 2.008376997146705e-06,
2066
+ "loss": 1.9602,
2067
+ "step": 343
2068
+ },
2069
+ {
2070
+ "epoch": 3.53,
2071
+ "learning_rate": 1.982220290232143e-06,
2072
+ "loss": 1.507,
2073
+ "step": 344
2074
+ },
2075
+ {
2076
+ "epoch": 3.54,
2077
+ "learning_rate": 1.956192854956397e-06,
2078
+ "loss": 1.5588,
2079
+ "step": 345
2080
+ },
2081
+ {
2082
+ "epoch": 3.55,
2083
+ "learning_rate": 1.9302958062481673e-06,
2084
+ "loss": 1.9348,
2085
+ "step": 346
2086
+ },
2087
+ {
2088
+ "epoch": 3.56,
2089
+ "learning_rate": 1.9045302534508298e-06,
2090
+ "loss": 1.8372,
2091
+ "step": 347
2092
+ },
2093
+ {
2094
+ "epoch": 3.57,
2095
+ "learning_rate": 1.8788973002749112e-06,
2096
+ "loss": 1.672,
2097
+ "step": 348
2098
+ },
2099
+ {
2100
+ "epoch": 3.58,
2101
+ "learning_rate": 1.8533980447508138e-06,
2102
+ "loss": 1.8803,
2103
+ "step": 349
2104
+ },
2105
+ {
2106
+ "epoch": 3.59,
2107
+ "learning_rate": 1.8280335791817733e-06,
2108
+ "loss": 2.133,
2109
+ "step": 350
2110
+ },
2111
+ {
2112
+ "epoch": 3.6,
2113
+ "learning_rate": 1.8028049900970768e-06,
2114
+ "loss": 1.7064,
2115
+ "step": 351
2116
+ },
2117
+ {
2118
+ "epoch": 3.61,
2119
+ "learning_rate": 1.777713358205514e-06,
2120
+ "loss": 1.8624,
2121
+ "step": 352
2122
+ },
2123
+ {
2124
+ "epoch": 3.63,
2125
+ "learning_rate": 1.7527597583490825e-06,
2126
+ "loss": 1.7757,
2127
+ "step": 353
2128
+ },
2129
+ {
2130
+ "epoch": 3.64,
2131
+ "learning_rate": 1.7279452594569484e-06,
2132
+ "loss": 1.9208,
2133
+ "step": 354
2134
+ },
2135
+ {
2136
+ "epoch": 3.65,
2137
+ "learning_rate": 1.7032709244996559e-06,
2138
+ "loss": 1.9518,
2139
+ "step": 355
2140
+ },
2141
+ {
2142
+ "epoch": 3.66,
2143
+ "learning_rate": 1.6787378104435931e-06,
2144
+ "loss": 1.6618,
2145
+ "step": 356
2146
+ },
2147
+ {
2148
+ "epoch": 3.67,
2149
+ "learning_rate": 1.6543469682057105e-06,
2150
+ "loss": 2.1538,
2151
+ "step": 357
2152
+ },
2153
+ {
2154
+ "epoch": 3.68,
2155
+ "learning_rate": 1.6300994426085103e-06,
2156
+ "loss": 1.9981,
2157
+ "step": 358
2158
+ },
2159
+ {
2160
+ "epoch": 3.69,
2161
+ "learning_rate": 1.6059962723352912e-06,
2162
+ "loss": 1.9644,
2163
+ "step": 359
2164
+ },
2165
+ {
2166
+ "epoch": 3.7,
2167
+ "learning_rate": 1.5820384898856433e-06,
2168
+ "loss": 2.0848,
2169
+ "step": 360
2170
+ },
2171
+ {
2172
+ "epoch": 3.71,
2173
+ "learning_rate": 1.5582271215312294e-06,
2174
+ "loss": 2.0623,
2175
+ "step": 361
2176
+ },
2177
+ {
2178
+ "epoch": 3.72,
2179
+ "learning_rate": 1.5345631872718214e-06,
2180
+ "loss": 1.9082,
2181
+ "step": 362
2182
+ },
2183
+ {
2184
+ "epoch": 3.73,
2185
+ "learning_rate": 1.5110477007916002e-06,
2186
+ "loss": 1.944,
2187
+ "step": 363
2188
+ },
2189
+ {
2190
+ "epoch": 3.74,
2191
+ "learning_rate": 1.487681669415742e-06,
2192
+ "loss": 1.7845,
2193
+ "step": 364
2194
+ },
2195
+ {
2196
+ "epoch": 3.75,
2197
+ "learning_rate": 1.4644660940672628e-06,
2198
+ "loss": 2.0057,
2199
+ "step": 365
2200
+ },
2201
+ {
2202
+ "epoch": 3.76,
2203
+ "learning_rate": 1.4414019692241437e-06,
2204
+ "loss": 2.2701,
2205
+ "step": 366
2206
+ },
2207
+ {
2208
+ "epoch": 3.77,
2209
+ "learning_rate": 1.4184902828767288e-06,
2210
+ "loss": 1.8745,
2211
+ "step": 367
2212
+ },
2213
+ {
2214
+ "epoch": 3.78,
2215
+ "learning_rate": 1.395732016485406e-06,
2216
+ "loss": 1.8174,
2217
+ "step": 368
2218
+ },
2219
+ {
2220
+ "epoch": 3.79,
2221
+ "learning_rate": 1.373128144938563e-06,
2222
+ "loss": 1.9715,
2223
+ "step": 369
2224
+ },
2225
+ {
2226
+ "epoch": 3.8,
2227
+ "learning_rate": 1.3506796365108232e-06,
2228
+ "loss": 1.8625,
2229
+ "step": 370
2230
+ },
2231
+ {
2232
+ "epoch": 3.81,
2233
+ "learning_rate": 1.3283874528215735e-06,
2234
+ "loss": 2.1635,
2235
+ "step": 371
2236
+ },
2237
+ {
2238
+ "epoch": 3.82,
2239
+ "learning_rate": 1.30625254879377e-06,
2240
+ "loss": 1.9431,
2241
+ "step": 372
2242
+ },
2243
+ {
2244
+ "epoch": 3.83,
2245
+ "learning_rate": 1.2842758726130283e-06,
2246
+ "loss": 1.7817,
2247
+ "step": 373
2248
+ },
2249
+ {
2250
+ "epoch": 3.84,
2251
+ "learning_rate": 1.2624583656870153e-06,
2252
+ "loss": 2.1267,
2253
+ "step": 374
2254
+ },
2255
+ {
2256
+ "epoch": 3.85,
2257
+ "learning_rate": 1.2408009626051137e-06,
2258
+ "loss": 2.2342,
2259
+ "step": 375
2260
+ },
2261
+ {
2262
+ "epoch": 3.86,
2263
+ "learning_rate": 1.2193045910983864e-06,
2264
+ "loss": 1.8949,
2265
+ "step": 376
2266
+ },
2267
+ {
2268
+ "epoch": 3.87,
2269
+ "learning_rate": 1.1979701719998454e-06,
2270
+ "loss": 1.8478,
2271
+ "step": 377
2272
+ },
2273
+ {
2274
+ "epoch": 3.88,
2275
+ "learning_rate": 1.1767986192049986e-06,
2276
+ "loss": 1.927,
2277
+ "step": 378
2278
+ },
2279
+ {
2280
+ "epoch": 3.89,
2281
+ "learning_rate": 1.1557908396327028e-06,
2282
+ "loss": 1.7817,
2283
+ "step": 379
2284
+ },
2285
+ {
2286
+ "epoch": 3.9,
2287
+ "learning_rate": 1.134947733186315e-06,
2288
+ "loss": 2.1291,
2289
+ "step": 380
2290
+ },
2291
+ {
2292
+ "epoch": 3.91,
2293
+ "learning_rate": 1.1142701927151456e-06,
2294
+ "loss": 2.0033,
2295
+ "step": 381
2296
+ },
2297
+ {
2298
+ "epoch": 3.92,
2299
+ "learning_rate": 1.0937591039762086e-06,
2300
+ "loss": 1.8841,
2301
+ "step": 382
2302
+ },
2303
+ {
2304
+ "epoch": 3.93,
2305
+ "learning_rate": 1.0734153455962765e-06,
2306
+ "loss": 1.4088,
2307
+ "step": 383
2308
+ },
2309
+ {
2310
+ "epoch": 3.94,
2311
+ "learning_rate": 1.0532397890342506e-06,
2312
+ "loss": 1.9065,
2313
+ "step": 384
2314
+ },
2315
+ {
2316
+ "epoch": 3.95,
2317
+ "learning_rate": 1.0332332985438248e-06,
2318
+ "loss": 1.9917,
2319
+ "step": 385
2320
+ },
2321
+ {
2322
+ "epoch": 3.96,
2323
+ "learning_rate": 1.013396731136465e-06,
2324
+ "loss": 1.7053,
2325
+ "step": 386
2326
+ },
2327
+ {
2328
+ "epoch": 3.97,
2329
+ "learning_rate": 9.937309365446973e-07,
2330
+ "loss": 1.7789,
2331
+ "step": 387
2332
+ },
2333
+ {
2334
+ "epoch": 3.98,
2335
+ "learning_rate": 9.742367571857092e-07,
2336
+ "loss": 1.9505,
2337
+ "step": 388
2338
+ },
2339
+ {
2340
+ "epoch": 3.99,
2341
+ "learning_rate": 9.549150281252633e-07,
2342
+ "loss": 1.6999,
2343
+ "step": 389
2344
+ },
2345
+ {
2346
+ "epoch": 4.01,
2347
+ "learning_rate": 9.357665770419244e-07,
2348
+ "loss": 1.8436,
2349
+ "step": 390
2350
+ },
2351
+ {
2352
+ "epoch": 4.02,
2353
+ "learning_rate": 9.167922241916055e-07,
2354
+ "loss": 1.9749,
2355
+ "step": 391
2356
+ },
2357
+ {
2358
+ "epoch": 4.03,
2359
+ "learning_rate": 8.979927823724321e-07,
2360
+ "loss": 2.0322,
2361
+ "step": 392
2362
+ },
2363
+ {
2364
+ "epoch": 4.04,
2365
+ "learning_rate": 8.793690568899216e-07,
2366
+ "loss": 2.0703,
2367
+ "step": 393
2368
+ },
2369
+ {
2370
+ "epoch": 4.05,
2371
+ "learning_rate": 8.609218455224893e-07,
2372
+ "loss": 1.9611,
2373
+ "step": 394
2374
+ },
2375
+ {
2376
+ "epoch": 4.06,
2377
+ "learning_rate": 8.426519384872733e-07,
2378
+ "loss": 2.1701,
2379
+ "step": 395
2380
+ },
2381
+ {
2382
+ "epoch": 4.07,
2383
+ "learning_rate": 8.245601184062851e-07,
2384
+ "loss": 2.0095,
2385
+ "step": 396
2386
+ },
2387
+ {
2388
+ "epoch": 4.08,
2389
+ "learning_rate": 8.066471602728804e-07,
2390
+ "loss": 1.8908,
2391
+ "step": 397
2392
+ },
2393
+ {
2394
+ "epoch": 4.09,
2395
+ "learning_rate": 7.88913831418568e-07,
2396
+ "loss": 2.1547,
2397
+ "step": 398
2398
+ },
2399
+ {
2400
+ "epoch": 4.1,
2401
+ "learning_rate": 7.71360891480134e-07,
2402
+ "loss": 1.9623,
2403
+ "step": 399
2404
+ },
2405
+ {
2406
+ "epoch": 4.11,
2407
+ "learning_rate": 7.539890923671061e-07,
2408
+ "loss": 1.8405,
2409
+ "step": 400
2410
+ },
2411
+ {
2412
+ "epoch": 4.12,
2413
+ "learning_rate": 7.367991782295392e-07,
2414
+ "loss": 1.926,
2415
+ "step": 401
2416
+ },
2417
+ {
2418
+ "epoch": 4.13,
2419
+ "learning_rate": 7.197918854261432e-07,
2420
+ "loss": 2.2612,
2421
+ "step": 402
2422
+ },
2423
+ {
2424
+ "epoch": 4.14,
2425
+ "learning_rate": 7.029679424927366e-07,
2426
+ "loss": 2.0554,
2427
+ "step": 403
2428
+ },
2429
+ {
2430
+ "epoch": 4.15,
2431
+ "learning_rate": 6.863280701110409e-07,
2432
+ "loss": 1.7727,
2433
+ "step": 404
2434
+ },
2435
+ {
2436
+ "epoch": 4.16,
2437
+ "learning_rate": 6.698729810778065e-07,
2438
+ "loss": 1.8858,
2439
+ "step": 405
2440
+ },
2441
+ {
2442
+ "epoch": 4.17,
2443
+ "learning_rate": 6.536033802742814e-07,
2444
+ "loss": 1.8505,
2445
+ "step": 406
2446
+ },
2447
+ {
2448
+ "epoch": 4.18,
2449
+ "learning_rate": 6.375199646360142e-07,
2450
+ "loss": 2.0033,
2451
+ "step": 407
2452
+ },
2453
+ {
2454
+ "epoch": 4.19,
2455
+ "learning_rate": 6.216234231230012e-07,
2456
+ "loss": 2.0853,
2457
+ "step": 408
2458
+ },
2459
+ {
2460
+ "epoch": 4.2,
2461
+ "learning_rate": 6.059144366901737e-07,
2462
+ "loss": 1.684,
2463
+ "step": 409
2464
+ },
2465
+ {
2466
+ "epoch": 4.21,
2467
+ "learning_rate": 5.903936782582253e-07,
2468
+ "loss": 2.0125,
2469
+ "step": 410
2470
+ },
2471
+ {
2472
+ "epoch": 4.22,
2473
+ "learning_rate": 5.750618126847912e-07,
2474
+ "loss": 1.7071,
2475
+ "step": 411
2476
+ },
2477
+ {
2478
+ "epoch": 4.23,
2479
+ "learning_rate": 5.599194967359639e-07,
2480
+ "loss": 2.0058,
2481
+ "step": 412
2482
+ },
2483
+ {
2484
+ "epoch": 4.24,
2485
+ "learning_rate": 5.449673790581611e-07,
2486
+ "loss": 1.8514,
2487
+ "step": 413
2488
+ },
2489
+ {
2490
+ "epoch": 4.25,
2491
+ "learning_rate": 5.302061001503395e-07,
2492
+ "loss": 1.7583,
2493
+ "step": 414
2494
+ },
2495
+ {
2496
+ "epoch": 4.26,
2497
+ "learning_rate": 5.156362923365587e-07,
2498
+ "loss": 1.649,
2499
+ "step": 415
2500
+ },
2501
+ {
2502
+ "epoch": 4.27,
2503
+ "learning_rate": 5.012585797388936e-07,
2504
+ "loss": 2.2002,
2505
+ "step": 416
2506
+ },
2507
+ {
2508
+ "epoch": 4.28,
2509
+ "learning_rate": 4.87073578250698e-07,
2510
+ "loss": 2.2455,
2511
+ "step": 417
2512
+ },
2513
+ {
2514
+ "epoch": 4.29,
2515
+ "learning_rate": 4.730818955102234e-07,
2516
+ "loss": 1.6698,
2517
+ "step": 418
2518
+ },
2519
+ {
2520
+ "epoch": 4.3,
2521
+ "learning_rate": 4.5928413087459325e-07,
2522
+ "loss": 1.9811,
2523
+ "step": 419
2524
+ },
2525
+ {
2526
+ "epoch": 4.31,
2527
+ "learning_rate": 4.456808753941205e-07,
2528
+ "loss": 1.9963,
2529
+ "step": 420
2530
+ },
2531
+ {
2532
+ "epoch": 4.32,
2533
+ "learning_rate": 4.322727117869951e-07,
2534
+ "loss": 1.5793,
2535
+ "step": 421
2536
+ },
2537
+ {
2538
+ "epoch": 4.33,
2539
+ "learning_rate": 4.1906021441432074e-07,
2540
+ "loss": 1.7237,
2541
+ "step": 422
2542
+ },
2543
+ {
2544
+ "epoch": 4.34,
2545
+ "learning_rate": 4.0604394925550906e-07,
2546
+ "loss": 1.6936,
2547
+ "step": 423
2548
+ },
2549
+ {
2550
+ "epoch": 4.35,
2551
+ "learning_rate": 3.9322447388403796e-07,
2552
+ "loss": 2.0876,
2553
+ "step": 424
2554
+ },
2555
+ {
2556
+ "epoch": 4.36,
2557
+ "learning_rate": 3.8060233744356634e-07,
2558
+ "loss": 1.8514,
2559
+ "step": 425
2560
+ },
2561
+ {
2562
+ "epoch": 4.37,
2563
+ "learning_rate": 3.6817808062440953e-07,
2564
+ "loss": 2.3487,
2565
+ "step": 426
2566
+ },
2567
+ {
2568
+ "epoch": 4.39,
2569
+ "learning_rate": 3.5595223564037884e-07,
2570
+ "loss": 1.8364,
2571
+ "step": 427
2572
+ },
2573
+ {
2574
+ "epoch": 4.4,
2575
+ "learning_rate": 3.439253262059822e-07,
2576
+ "loss": 1.9163,
2577
+ "step": 428
2578
+ },
2579
+ {
2580
+ "epoch": 4.41,
2581
+ "learning_rate": 3.320978675139919e-07,
2582
+ "loss": 1.9985,
2583
+ "step": 429
2584
+ },
2585
+ {
2586
+ "epoch": 4.42,
2587
+ "learning_rate": 3.204703662133724e-07,
2588
+ "loss": 1.9434,
2589
+ "step": 430
2590
+ },
2591
+ {
2592
+ "epoch": 4.43,
2593
+ "learning_rate": 3.0904332038757977e-07,
2594
+ "loss": 1.9705,
2595
+ "step": 431
2596
+ },
2597
+ {
2598
+ "epoch": 4.44,
2599
+ "learning_rate": 2.9781721953322627e-07,
2600
+ "loss": 2.2868,
2601
+ "step": 432
2602
+ },
2603
+ {
2604
+ "epoch": 4.45,
2605
+ "learning_rate": 2.867925445391079e-07,
2606
+ "loss": 1.8121,
2607
+ "step": 433
2608
+ },
2609
+ {
2610
+ "epoch": 4.46,
2611
+ "learning_rate": 2.7596976766560977e-07,
2612
+ "loss": 1.6713,
2613
+ "step": 434
2614
+ },
2615
+ {
2616
+ "epoch": 4.47,
2617
+ "learning_rate": 2.653493525244721e-07,
2618
+ "loss": 1.8284,
2619
+ "step": 435
2620
+ },
2621
+ {
2622
+ "epoch": 4.48,
2623
+ "learning_rate": 2.5493175405893076e-07,
2624
+ "loss": 2.011,
2625
+ "step": 436
2626
+ },
2627
+ {
2628
+ "epoch": 4.49,
2629
+ "learning_rate": 2.447174185242324e-07,
2630
+ "loss": 2.1148,
2631
+ "step": 437
2632
+ },
2633
+ {
2634
+ "epoch": 4.5,
2635
+ "learning_rate": 2.3470678346851517e-07,
2636
+ "loss": 2.0046,
2637
+ "step": 438
2638
+ },
2639
+ {
2640
+ "epoch": 4.51,
2641
+ "learning_rate": 2.2490027771406686e-07,
2642
+ "loss": 1.9366,
2643
+ "step": 439
2644
+ },
2645
+ {
2646
+ "epoch": 4.52,
2647
+ "learning_rate": 2.152983213389559e-07,
2648
+ "loss": 2.1379,
2649
+ "step": 440
2650
+ },
2651
+ {
2652
+ "epoch": 4.53,
2653
+ "learning_rate": 2.0590132565903475e-07,
2654
+ "loss": 1.9382,
2655
+ "step": 441
2656
+ },
2657
+ {
2658
+ "epoch": 4.54,
2659
+ "learning_rate": 1.9670969321032407e-07,
2660
+ "loss": 1.8226,
2661
+ "step": 442
2662
+ },
2663
+ {
2664
+ "epoch": 4.55,
2665
+ "learning_rate": 1.8772381773176417e-07,
2666
+ "loss": 2.2887,
2667
+ "step": 443
2668
+ },
2669
+ {
2670
+ "epoch": 4.56,
2671
+ "learning_rate": 1.7894408414835362e-07,
2672
+ "loss": 1.7401,
2673
+ "step": 444
2674
+ },
2675
+ {
2676
+ "epoch": 4.57,
2677
+ "learning_rate": 1.7037086855465902e-07,
2678
+ "loss": 1.713,
2679
+ "step": 445
2680
+ },
2681
+ {
2682
+ "epoch": 4.58,
2683
+ "learning_rate": 1.6200453819870122e-07,
2684
+ "loss": 1.9873,
2685
+ "step": 446
2686
+ },
2687
+ {
2688
+ "epoch": 4.59,
2689
+ "learning_rate": 1.5384545146622854e-07,
2690
+ "loss": 2.2339,
2691
+ "step": 447
2692
+ },
2693
+ {
2694
+ "epoch": 4.6,
2695
+ "learning_rate": 1.4589395786535954e-07,
2696
+ "loss": 2.4256,
2697
+ "step": 448
2698
+ },
2699
+ {
2700
+ "epoch": 4.61,
2701
+ "learning_rate": 1.3815039801161723e-07,
2702
+ "loss": 2.1304,
2703
+ "step": 449
2704
+ },
2705
+ {
2706
+ "epoch": 4.62,
2707
+ "learning_rate": 1.3061510361333186e-07,
2708
+ "loss": 1.829,
2709
+ "step": 450
2710
+ },
2711
+ {
2712
+ "epoch": 4.63,
2713
+ "learning_rate": 1.232883974574367e-07,
2714
+ "loss": 1.9966,
2715
+ "step": 451
2716
+ },
2717
+ {
2718
+ "epoch": 4.64,
2719
+ "learning_rate": 1.1617059339563807e-07,
2720
+ "loss": 1.8668,
2721
+ "step": 452
2722
+ },
2723
+ {
2724
+ "epoch": 4.65,
2725
+ "learning_rate": 1.0926199633097156e-07,
2726
+ "loss": 1.7622,
2727
+ "step": 453
2728
+ },
2729
+ {
2730
+ "epoch": 4.66,
2731
+ "learning_rate": 1.0256290220474308e-07,
2732
+ "loss": 1.9253,
2733
+ "step": 454
2734
+ },
2735
+ {
2736
+ "epoch": 4.67,
2737
+ "learning_rate": 9.607359798384785e-08,
2738
+ "loss": 1.8139,
2739
+ "step": 455
2740
+ },
2741
+ {
2742
+ "epoch": 4.68,
2743
+ "learning_rate": 8.979436164848088e-08,
2744
+ "loss": 1.9552,
2745
+ "step": 456
2746
+ },
2747
+ {
2748
+ "epoch": 4.69,
2749
+ "learning_rate": 8.372546218022747e-08,
2750
+ "loss": 1.5488,
2751
+ "step": 457
2752
+ },
2753
+ {
2754
+ "epoch": 4.7,
2755
+ "learning_rate": 7.786715955054202e-08,
2756
+ "loss": 2.1687,
2757
+ "step": 458
2758
+ },
2759
+ {
2760
+ "epoch": 4.71,
2761
+ "learning_rate": 7.221970470961125e-08,
2762
+ "loss": 1.7,
2763
+ "step": 459
2764
+ },
2765
+ {
2766
+ "epoch": 4.72,
2767
+ "learning_rate": 6.678333957560513e-08,
2768
+ "loss": 2.0648,
2769
+ "step": 460
2770
+ },
2771
+ {
2772
+ "epoch": 4.73,
2773
+ "learning_rate": 6.15582970243117e-08,
2774
+ "loss": 1.8835,
2775
+ "step": 461
2776
+ },
2777
+ {
2778
+ "epoch": 4.74,
2779
+ "learning_rate": 5.654480087916303e-08,
2780
+ "loss": 1.8804,
2781
+ "step": 462
2782
+ },
2783
+ {
2784
+ "epoch": 4.75,
2785
+ "learning_rate": 5.174306590164879e-08,
2786
+ "loss": 2.2831,
2787
+ "step": 463
2788
+ },
2789
+ {
2790
+ "epoch": 4.77,
2791
+ "learning_rate": 4.715329778211375e-08,
2792
+ "loss": 1.9674,
2793
+ "step": 464
2794
+ },
2795
+ {
2796
+ "epoch": 4.78,
2797
+ "learning_rate": 4.2775693130948094e-08,
2798
+ "loss": 2.0009,
2799
+ "step": 465
2800
+ },
2801
+ {
2802
+ "epoch": 4.79,
2803
+ "learning_rate": 3.861043947016474e-08,
2804
+ "loss": 1.6058,
2805
+ "step": 466
2806
+ },
2807
+ {
2808
+ "epoch": 4.8,
2809
+ "learning_rate": 3.465771522536854e-08,
2810
+ "loss": 1.7313,
2811
+ "step": 467
2812
+ },
2813
+ {
2814
+ "epoch": 4.81,
2815
+ "learning_rate": 3.09176897181096e-08,
2816
+ "loss": 1.8912,
2817
+ "step": 468
2818
+ },
2819
+ {
2820
+ "epoch": 4.82,
2821
+ "learning_rate": 2.7390523158633552e-08,
2822
+ "loss": 2.0388,
2823
+ "step": 469
2824
+ },
2825
+ {
2826
+ "epoch": 4.83,
2827
+ "learning_rate": 2.4076366639015914e-08,
2828
+ "loss": 1.8365,
2829
+ "step": 470
2830
+ },
2831
+ {
2832
+ "epoch": 4.84,
2833
+ "learning_rate": 2.097536212669171e-08,
2834
+ "loss": 1.9795,
2835
+ "step": 471
2836
+ },
2837
+ {
2838
+ "epoch": 4.85,
2839
+ "learning_rate": 1.8087642458373135e-08,
2840
+ "loss": 1.9468,
2841
+ "step": 472
2842
+ },
2843
+ {
2844
+ "epoch": 4.86,
2845
+ "learning_rate": 1.541333133436018e-08,
2846
+ "loss": 1.7218,
2847
+ "step": 473
2848
+ },
2849
+ {
2850
+ "epoch": 4.87,
2851
+ "learning_rate": 1.2952543313240474e-08,
2852
+ "loss": 1.3056,
2853
+ "step": 474
2854
+ },
2855
+ {
2856
+ "epoch": 4.88,
2857
+ "learning_rate": 1.0705383806982606e-08,
2858
+ "loss": 1.6465,
2859
+ "step": 475
2860
+ },
2861
+ {
2862
+ "epoch": 4.89,
2863
+ "learning_rate": 8.671949076420883e-09,
2864
+ "loss": 1.6287,
2865
+ "step": 476
2866
+ },
2867
+ {
2868
+ "epoch": 4.9,
2869
+ "learning_rate": 6.852326227130835e-09,
2870
+ "loss": 1.9142,
2871
+ "step": 477
2872
+ },
2873
+ {
2874
+ "epoch": 4.91,
2875
+ "learning_rate": 5.246593205699424e-09,
2876
+ "loss": 2.4245,
2877
+ "step": 478
2878
+ },
2879
+ {
2880
+ "epoch": 4.92,
2881
+ "learning_rate": 3.854818796385495e-09,
2882
+ "loss": 1.9302,
2883
+ "step": 479
2884
+ },
2885
+ {
2886
+ "epoch": 4.93,
2887
+ "learning_rate": 2.6770626181715776e-09,
2888
+ "loss": 1.5904,
2889
+ "step": 480
2890
+ },
2891
+ {
2892
+ "epoch": 4.94,
2893
+ "learning_rate": 1.7133751222137007e-09,
2894
+ "loss": 1.9541,
2895
+ "step": 481
2896
+ },
2897
+ {
2898
+ "epoch": 4.95,
2899
+ "learning_rate": 9.637975896759077e-10,
2900
+ "loss": 1.7176,
2901
+ "step": 482
2902
+ },
2903
+ {
2904
+ "epoch": 4.96,
2905
+ "learning_rate": 4.283621299649987e-10,
2906
+ "loss": 1.9053,
2907
+ "step": 483
2908
+ },
2909
+ {
2910
+ "epoch": 4.97,
2911
+ "learning_rate": 1.0709167935385456e-10,
2912
+ "loss": 2.0116,
2913
+ "step": 484
2914
+ },
2915
+ {
2916
+ "epoch": 4.98,
2917
+ "learning_rate": 0.0,
2918
+ "loss": 1.9722,
2919
+ "step": 485
2920
+ },
2921
+ {
2922
+ "epoch": 4.98,
2923
+ "step": 485,
2924
+ "total_flos": 4.3609614855438336e+17,
2925
+ "train_loss": 2.0201566543775735,
2926
+ "train_runtime": 8786.7992,
2927
+ "train_samples_per_second": 0.443,
2928
+ "train_steps_per_second": 0.055
2929
+ }
2930
+ ],
2931
+ "logging_steps": 1.0,
2932
+ "max_steps": 485,
2933
+ "num_train_epochs": 5,
2934
+ "save_steps": 1000,
2935
+ "total_flos": 4.3609614855438336e+17,
2936
+ "trial_name": null,
2937
+ "trial_params": null
2938
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aee3796a4d9a091d47ae62c544f61e3b34fd5b2ea9c60bd09f7f13e0d3a09124
3
+ size 4536