manu commited on
Commit
7bcfe09
1 Parent(s): 50d1e52

Upload folder using huggingface_hub

Browse files
README.md CHANGED
@@ -26,7 +26,7 @@ load_in_4bit: false
26
  strict: false
27
 
28
  datasets:
29
- - path: manu/mmlu_auxiliary_train_formatted_3
30
  split: train
31
  type: completion
32
 
@@ -96,7 +96,7 @@ special_tokens:
96
 
97
  This model is a fine-tuned version of [croissantllm/CroissantLLMBase](https://huggingface.co/croissantllm/CroissantLLMBase) on the None dataset.
98
  It achieves the following results on the evaluation set:
99
- - Loss: 1.3916
100
 
101
  ## Model description
102
 
@@ -130,10 +130,10 @@ The following hyperparameters were used during training:
130
 
131
  | Training Loss | Epoch | Step | Validation Loss |
132
  |:-------------:|:-----:|:----:|:---------------:|
133
- | 2.5221 | 0.0 | 1 | 2.5482 |
134
- | 2.2198 | 0.25 | 125 | 2.3040 |
135
- | 1.8488 | 0.5 | 250 | 1.8220 |
136
- | 1.383 | 0.75 | 375 | 1.3916 |
137
 
138
 
139
  ### Framework versions
 
26
  strict: false
27
 
28
  datasets:
29
+ - path: manu/mmlu_auxiliary_train_formatted_extra
30
  split: train
31
  type: completion
32
 
 
96
 
97
  This model is a fine-tuned version of [croissantllm/CroissantLLMBase](https://huggingface.co/croissantllm/CroissantLLMBase) on the None dataset.
98
  It achieves the following results on the evaluation set:
99
+ - Loss: 1.4229
100
 
101
  ## Model description
102
 
 
130
 
131
  | Training Loss | Epoch | Step | Validation Loss |
132
  |:-------------:|:-----:|:----:|:---------------:|
133
+ | 3.2302 | 0.0 | 1 | 3.1796 |
134
+ | 2.3772 | 0.25 | 134 | 2.3697 |
135
+ | 1.8538 | 0.5 | 268 | 1.8599 |
136
+ | 1.5117 | 0.75 | 402 | 1.4229 |
137
 
138
 
139
  ### Framework versions
checkpoint-533/config.json ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "croissantllm/CroissantLLMBase",
3
+ "architectures": [
4
+ "LlamaForCausalLM"
5
+ ],
6
+ "attention_bias": false,
7
+ "attention_dropout": 0.0,
8
+ "bos_token_id": 1,
9
+ "eos_token_id": 2,
10
+ "hidden_act": "silu",
11
+ "hidden_size": 2048,
12
+ "initializer_range": 0.02,
13
+ "intermediate_size": 5504,
14
+ "max_position_embeddings": 2048,
15
+ "model_type": "llama",
16
+ "num_attention_heads": 16,
17
+ "num_hidden_layers": 24,
18
+ "num_key_value_heads": 16,
19
+ "pretraining_tp": 1,
20
+ "rms_norm_eps": 1e-05,
21
+ "rope_scaling": null,
22
+ "rope_theta": 10000.0,
23
+ "tie_word_embeddings": false,
24
+ "torch_dtype": "bfloat16",
25
+ "transformers_version": "4.38.0.dev0",
26
+ "use_cache": false,
27
+ "vocab_size": 32000
28
+ }
checkpoint-533/generation_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 1,
4
+ "do_sample": true,
5
+ "eos_token_id": 2,
6
+ "transformers_version": "4.38.0.dev0"
7
+ }
checkpoint-533/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8b47c91452500681d1c7280dbef7dc5ce847f71ee611ee107140fb86f89dd25
3
+ size 2690869336
checkpoint-533/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76f9f6f2c0931c91f78f173505b1d0a335d07ecf43205922c21d52be8c02a938
3
+ size 2696906170
checkpoint-533/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c062f7f375beded48b5337f5a3f3a5cb38807fa3e85dbf3e294c0ab6b627bfc2
3
+ size 14244
checkpoint-533/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d5fc40b7e60aafb6a2bc36d24f4329114e8edc9ee620dda130087277adc9cfc
3
+ size 1064
checkpoint-533/trainer_state.json ADDED
@@ -0,0 +1,3251 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": null,
3
+ "best_model_checkpoint": null,
4
+ "epoch": 0.9990627928772259,
5
+ "eval_steps": 134,
6
+ "global_step": 533,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.0,
13
+ "learning_rate": 4.000000000000001e-06,
14
+ "loss": 3.2302,
15
+ "step": 1
16
+ },
17
+ {
18
+ "epoch": 0.0,
19
+ "eval_loss": 3.179551601409912,
20
+ "eval_runtime": 55.4081,
21
+ "eval_samples_per_second": 24.329,
22
+ "eval_steps_per_second": 1.029,
23
+ "step": 1
24
+ },
25
+ {
26
+ "epoch": 0.0,
27
+ "learning_rate": 8.000000000000001e-06,
28
+ "loss": 3.1024,
29
+ "step": 2
30
+ },
31
+ {
32
+ "epoch": 0.01,
33
+ "learning_rate": 1.2e-05,
34
+ "loss": 3.2198,
35
+ "step": 3
36
+ },
37
+ {
38
+ "epoch": 0.01,
39
+ "learning_rate": 1.6000000000000003e-05,
40
+ "loss": 3.0828,
41
+ "step": 4
42
+ },
43
+ {
44
+ "epoch": 0.01,
45
+ "learning_rate": 2e-05,
46
+ "loss": 2.9847,
47
+ "step": 5
48
+ },
49
+ {
50
+ "epoch": 0.01,
51
+ "learning_rate": 2.4e-05,
52
+ "loss": 2.7929,
53
+ "step": 6
54
+ },
55
+ {
56
+ "epoch": 0.01,
57
+ "learning_rate": 2.8000000000000003e-05,
58
+ "loss": 2.7878,
59
+ "step": 7
60
+ },
61
+ {
62
+ "epoch": 0.01,
63
+ "learning_rate": 3.2000000000000005e-05,
64
+ "loss": 2.6629,
65
+ "step": 8
66
+ },
67
+ {
68
+ "epoch": 0.02,
69
+ "learning_rate": 3.6e-05,
70
+ "loss": 2.6465,
71
+ "step": 9
72
+ },
73
+ {
74
+ "epoch": 0.02,
75
+ "learning_rate": 4e-05,
76
+ "loss": 2.5353,
77
+ "step": 10
78
+ },
79
+ {
80
+ "epoch": 0.02,
81
+ "learning_rate": 4.4000000000000006e-05,
82
+ "loss": 2.5154,
83
+ "step": 11
84
+ },
85
+ {
86
+ "epoch": 0.02,
87
+ "learning_rate": 4.8e-05,
88
+ "loss": 2.498,
89
+ "step": 12
90
+ },
91
+ {
92
+ "epoch": 0.02,
93
+ "learning_rate": 5.2000000000000004e-05,
94
+ "loss": 2.4848,
95
+ "step": 13
96
+ },
97
+ {
98
+ "epoch": 0.03,
99
+ "learning_rate": 5.6000000000000006e-05,
100
+ "loss": 2.4794,
101
+ "step": 14
102
+ },
103
+ {
104
+ "epoch": 0.03,
105
+ "learning_rate": 6e-05,
106
+ "loss": 2.4636,
107
+ "step": 15
108
+ },
109
+ {
110
+ "epoch": 0.03,
111
+ "learning_rate": 6.400000000000001e-05,
112
+ "loss": 2.4932,
113
+ "step": 16
114
+ },
115
+ {
116
+ "epoch": 0.03,
117
+ "learning_rate": 6.800000000000001e-05,
118
+ "loss": 2.4167,
119
+ "step": 17
120
+ },
121
+ {
122
+ "epoch": 0.03,
123
+ "learning_rate": 7.2e-05,
124
+ "loss": 2.4665,
125
+ "step": 18
126
+ },
127
+ {
128
+ "epoch": 0.04,
129
+ "learning_rate": 7.6e-05,
130
+ "loss": 2.3863,
131
+ "step": 19
132
+ },
133
+ {
134
+ "epoch": 0.04,
135
+ "learning_rate": 8e-05,
136
+ "loss": 2.4089,
137
+ "step": 20
138
+ },
139
+ {
140
+ "epoch": 0.04,
141
+ "learning_rate": 8.4e-05,
142
+ "loss": 2.4105,
143
+ "step": 21
144
+ },
145
+ {
146
+ "epoch": 0.04,
147
+ "learning_rate": 8.800000000000001e-05,
148
+ "loss": 2.4187,
149
+ "step": 22
150
+ },
151
+ {
152
+ "epoch": 0.04,
153
+ "learning_rate": 9.200000000000001e-05,
154
+ "loss": 2.3987,
155
+ "step": 23
156
+ },
157
+ {
158
+ "epoch": 0.04,
159
+ "learning_rate": 9.6e-05,
160
+ "loss": 2.3898,
161
+ "step": 24
162
+ },
163
+ {
164
+ "epoch": 0.05,
165
+ "learning_rate": 0.0001,
166
+ "loss": 2.4524,
167
+ "step": 25
168
+ },
169
+ {
170
+ "epoch": 0.05,
171
+ "learning_rate": 0.00010400000000000001,
172
+ "loss": 2.4081,
173
+ "step": 26
174
+ },
175
+ {
176
+ "epoch": 0.05,
177
+ "learning_rate": 0.00010800000000000001,
178
+ "loss": 2.4231,
179
+ "step": 27
180
+ },
181
+ {
182
+ "epoch": 0.05,
183
+ "learning_rate": 0.00011200000000000001,
184
+ "loss": 2.3854,
185
+ "step": 28
186
+ },
187
+ {
188
+ "epoch": 0.05,
189
+ "learning_rate": 0.000116,
190
+ "loss": 2.4511,
191
+ "step": 29
192
+ },
193
+ {
194
+ "epoch": 0.06,
195
+ "learning_rate": 0.00012,
196
+ "loss": 2.4137,
197
+ "step": 30
198
+ },
199
+ {
200
+ "epoch": 0.06,
201
+ "learning_rate": 0.000124,
202
+ "loss": 2.4189,
203
+ "step": 31
204
+ },
205
+ {
206
+ "epoch": 0.06,
207
+ "learning_rate": 0.00012800000000000002,
208
+ "loss": 2.4123,
209
+ "step": 32
210
+ },
211
+ {
212
+ "epoch": 0.06,
213
+ "learning_rate": 0.000132,
214
+ "loss": 2.3896,
215
+ "step": 33
216
+ },
217
+ {
218
+ "epoch": 0.06,
219
+ "learning_rate": 0.00013600000000000003,
220
+ "loss": 2.4448,
221
+ "step": 34
222
+ },
223
+ {
224
+ "epoch": 0.07,
225
+ "learning_rate": 0.00014,
226
+ "loss": 2.3936,
227
+ "step": 35
228
+ },
229
+ {
230
+ "epoch": 0.07,
231
+ "learning_rate": 0.000144,
232
+ "loss": 2.4505,
233
+ "step": 36
234
+ },
235
+ {
236
+ "epoch": 0.07,
237
+ "learning_rate": 0.000148,
238
+ "loss": 2.4321,
239
+ "step": 37
240
+ },
241
+ {
242
+ "epoch": 0.07,
243
+ "learning_rate": 0.000152,
244
+ "loss": 2.4273,
245
+ "step": 38
246
+ },
247
+ {
248
+ "epoch": 0.07,
249
+ "learning_rate": 0.00015600000000000002,
250
+ "loss": 2.4394,
251
+ "step": 39
252
+ },
253
+ {
254
+ "epoch": 0.07,
255
+ "learning_rate": 0.00016,
256
+ "loss": 2.4661,
257
+ "step": 40
258
+ },
259
+ {
260
+ "epoch": 0.08,
261
+ "learning_rate": 0.000164,
262
+ "loss": 2.4693,
263
+ "step": 41
264
+ },
265
+ {
266
+ "epoch": 0.08,
267
+ "learning_rate": 0.000168,
268
+ "loss": 2.4416,
269
+ "step": 42
270
+ },
271
+ {
272
+ "epoch": 0.08,
273
+ "learning_rate": 0.000172,
274
+ "loss": 2.4219,
275
+ "step": 43
276
+ },
277
+ {
278
+ "epoch": 0.08,
279
+ "learning_rate": 0.00017600000000000002,
280
+ "loss": 2.4929,
281
+ "step": 44
282
+ },
283
+ {
284
+ "epoch": 0.08,
285
+ "learning_rate": 0.00018,
286
+ "loss": 2.5098,
287
+ "step": 45
288
+ },
289
+ {
290
+ "epoch": 0.09,
291
+ "learning_rate": 0.00018400000000000003,
292
+ "loss": 2.5142,
293
+ "step": 46
294
+ },
295
+ {
296
+ "epoch": 0.09,
297
+ "learning_rate": 0.000188,
298
+ "loss": 2.4719,
299
+ "step": 47
300
+ },
301
+ {
302
+ "epoch": 0.09,
303
+ "learning_rate": 0.000192,
304
+ "loss": 2.4686,
305
+ "step": 48
306
+ },
307
+ {
308
+ "epoch": 0.09,
309
+ "learning_rate": 0.000196,
310
+ "loss": 2.4731,
311
+ "step": 49
312
+ },
313
+ {
314
+ "epoch": 0.09,
315
+ "learning_rate": 0.0002,
316
+ "loss": 2.4735,
317
+ "step": 50
318
+ },
319
+ {
320
+ "epoch": 0.1,
321
+ "learning_rate": 0.00019999788469031855,
322
+ "loss": 2.5597,
323
+ "step": 51
324
+ },
325
+ {
326
+ "epoch": 0.1,
327
+ "learning_rate": 0.00019999153885076487,
328
+ "loss": 2.4634,
329
+ "step": 52
330
+ },
331
+ {
332
+ "epoch": 0.1,
333
+ "learning_rate": 0.00019998096274980728,
334
+ "loss": 2.4727,
335
+ "step": 53
336
+ },
337
+ {
338
+ "epoch": 0.1,
339
+ "learning_rate": 0.00019996615683488039,
340
+ "loss": 2.4603,
341
+ "step": 54
342
+ },
343
+ {
344
+ "epoch": 0.1,
345
+ "learning_rate": 0.00019994712173236604,
346
+ "loss": 2.4999,
347
+ "step": 55
348
+ },
349
+ {
350
+ "epoch": 0.1,
351
+ "learning_rate": 0.000199923858247567,
352
+ "loss": 2.4886,
353
+ "step": 56
354
+ },
355
+ {
356
+ "epoch": 0.11,
357
+ "learning_rate": 0.00019989636736467278,
358
+ "loss": 2.5067,
359
+ "step": 57
360
+ },
361
+ {
362
+ "epoch": 0.11,
363
+ "learning_rate": 0.00019986465024671794,
364
+ "loss": 2.4929,
365
+ "step": 58
366
+ },
367
+ {
368
+ "epoch": 0.11,
369
+ "learning_rate": 0.00019982870823553308,
370
+ "loss": 2.4504,
371
+ "step": 59
372
+ },
373
+ {
374
+ "epoch": 0.11,
375
+ "learning_rate": 0.00019978854285168784,
376
+ "loss": 2.4733,
377
+ "step": 60
378
+ },
379
+ {
380
+ "epoch": 0.11,
381
+ "learning_rate": 0.00019974415579442675,
382
+ "loss": 2.5515,
383
+ "step": 61
384
+ },
385
+ {
386
+ "epoch": 0.12,
387
+ "learning_rate": 0.00019969554894159723,
388
+ "loss": 2.4798,
389
+ "step": 62
390
+ },
391
+ {
392
+ "epoch": 0.12,
393
+ "learning_rate": 0.00019964272434957022,
394
+ "loss": 2.5098,
395
+ "step": 63
396
+ },
397
+ {
398
+ "epoch": 0.12,
399
+ "learning_rate": 0.00019958568425315314,
400
+ "loss": 2.5603,
401
+ "step": 64
402
+ },
403
+ {
404
+ "epoch": 0.12,
405
+ "learning_rate": 0.00019952443106549533,
406
+ "loss": 2.68,
407
+ "step": 65
408
+ },
409
+ {
410
+ "epoch": 0.12,
411
+ "learning_rate": 0.00019945896737798603,
412
+ "loss": 2.7329,
413
+ "step": 66
414
+ },
415
+ {
416
+ "epoch": 0.13,
417
+ "learning_rate": 0.0001993892959601447,
418
+ "loss": 2.5781,
419
+ "step": 67
420
+ },
421
+ {
422
+ "epoch": 0.13,
423
+ "learning_rate": 0.00019931541975950378,
424
+ "loss": 2.5786,
425
+ "step": 68
426
+ },
427
+ {
428
+ "epoch": 0.13,
429
+ "learning_rate": 0.00019923734190148418,
430
+ "loss": 2.5429,
431
+ "step": 69
432
+ },
433
+ {
434
+ "epoch": 0.13,
435
+ "learning_rate": 0.0001991550656892628,
436
+ "loss": 2.4816,
437
+ "step": 70
438
+ },
439
+ {
440
+ "epoch": 0.13,
441
+ "learning_rate": 0.00019906859460363307,
442
+ "loss": 2.5149,
443
+ "step": 71
444
+ },
445
+ {
446
+ "epoch": 0.13,
447
+ "learning_rate": 0.00019897793230285748,
448
+ "loss": 2.5982,
449
+ "step": 72
450
+ },
451
+ {
452
+ "epoch": 0.14,
453
+ "learning_rate": 0.00019888308262251285,
454
+ "loss": 2.5852,
455
+ "step": 73
456
+ },
457
+ {
458
+ "epoch": 0.14,
459
+ "learning_rate": 0.00019878404957532814,
460
+ "loss": 2.5715,
461
+ "step": 74
462
+ },
463
+ {
464
+ "epoch": 0.14,
465
+ "learning_rate": 0.00019868083735101463,
466
+ "loss": 2.52,
467
+ "step": 75
468
+ },
469
+ {
470
+ "epoch": 0.14,
471
+ "learning_rate": 0.00019857345031608868,
472
+ "loss": 2.5562,
473
+ "step": 76
474
+ },
475
+ {
476
+ "epoch": 0.14,
477
+ "learning_rate": 0.0001984618930136869,
478
+ "loss": 2.4902,
479
+ "step": 77
480
+ },
481
+ {
482
+ "epoch": 0.15,
483
+ "learning_rate": 0.0001983461701633742,
484
+ "loss": 2.4734,
485
+ "step": 78
486
+ },
487
+ {
488
+ "epoch": 0.15,
489
+ "learning_rate": 0.0001982262866609439,
490
+ "loss": 2.4944,
491
+ "step": 79
492
+ },
493
+ {
494
+ "epoch": 0.15,
495
+ "learning_rate": 0.00019810224757821064,
496
+ "loss": 2.4315,
497
+ "step": 80
498
+ },
499
+ {
500
+ "epoch": 0.15,
501
+ "learning_rate": 0.00019797405816279585,
502
+ "loss": 2.4392,
503
+ "step": 81
504
+ },
505
+ {
506
+ "epoch": 0.15,
507
+ "learning_rate": 0.00019784172383790582,
508
+ "loss": 2.4658,
509
+ "step": 82
510
+ },
511
+ {
512
+ "epoch": 0.16,
513
+ "learning_rate": 0.00019770525020210204,
514
+ "loss": 2.4779,
515
+ "step": 83
516
+ },
517
+ {
518
+ "epoch": 0.16,
519
+ "learning_rate": 0.00019756464302906465,
520
+ "loss": 2.4132,
521
+ "step": 84
522
+ },
523
+ {
524
+ "epoch": 0.16,
525
+ "learning_rate": 0.00019741990826734794,
526
+ "loss": 2.4443,
527
+ "step": 85
528
+ },
529
+ {
530
+ "epoch": 0.16,
531
+ "learning_rate": 0.0001972710520401287,
532
+ "loss": 2.5367,
533
+ "step": 86
534
+ },
535
+ {
536
+ "epoch": 0.16,
537
+ "learning_rate": 0.0001971180806449473,
538
+ "loss": 2.4563,
539
+ "step": 87
540
+ },
541
+ {
542
+ "epoch": 0.16,
543
+ "learning_rate": 0.00019696100055344124,
544
+ "loss": 2.4693,
545
+ "step": 88
546
+ },
547
+ {
548
+ "epoch": 0.17,
549
+ "learning_rate": 0.0001967998184110713,
550
+ "loss": 2.4599,
551
+ "step": 89
552
+ },
553
+ {
554
+ "epoch": 0.17,
555
+ "learning_rate": 0.0001966345410368404,
556
+ "loss": 2.458,
557
+ "step": 90
558
+ },
559
+ {
560
+ "epoch": 0.17,
561
+ "learning_rate": 0.00019646517542300514,
562
+ "loss": 2.4395,
563
+ "step": 91
564
+ },
565
+ {
566
+ "epoch": 0.17,
567
+ "learning_rate": 0.00019629172873477995,
568
+ "loss": 2.453,
569
+ "step": 92
570
+ },
571
+ {
572
+ "epoch": 0.17,
573
+ "learning_rate": 0.000196114208310034,
574
+ "loss": 2.4638,
575
+ "step": 93
576
+ },
577
+ {
578
+ "epoch": 0.18,
579
+ "learning_rate": 0.00019593262165898076,
580
+ "loss": 2.4314,
581
+ "step": 94
582
+ },
583
+ {
584
+ "epoch": 0.18,
585
+ "learning_rate": 0.00019574697646386027,
586
+ "loss": 2.4776,
587
+ "step": 95
588
+ },
589
+ {
590
+ "epoch": 0.18,
591
+ "learning_rate": 0.0001955572805786141,
592
+ "loss": 2.4625,
593
+ "step": 96
594
+ },
595
+ {
596
+ "epoch": 0.18,
597
+ "learning_rate": 0.00019536354202855308,
598
+ "loss": 2.4451,
599
+ "step": 97
600
+ },
601
+ {
602
+ "epoch": 0.18,
603
+ "learning_rate": 0.0001951657690100178,
604
+ "loss": 2.4473,
605
+ "step": 98
606
+ },
607
+ {
608
+ "epoch": 0.19,
609
+ "learning_rate": 0.00019496396989003193,
610
+ "loss": 2.4928,
611
+ "step": 99
612
+ },
613
+ {
614
+ "epoch": 0.19,
615
+ "learning_rate": 0.0001947581532059481,
616
+ "loss": 2.4132,
617
+ "step": 100
618
+ },
619
+ {
620
+ "epoch": 0.19,
621
+ "learning_rate": 0.0001945483276650868,
622
+ "loss": 2.4591,
623
+ "step": 101
624
+ },
625
+ {
626
+ "epoch": 0.19,
627
+ "learning_rate": 0.00019433450214436797,
628
+ "loss": 2.465,
629
+ "step": 102
630
+ },
631
+ {
632
+ "epoch": 0.19,
633
+ "learning_rate": 0.0001941166856899355,
634
+ "loss": 2.3805,
635
+ "step": 103
636
+ },
637
+ {
638
+ "epoch": 0.19,
639
+ "learning_rate": 0.0001938948875167745,
640
+ "loss": 2.4012,
641
+ "step": 104
642
+ },
643
+ {
644
+ "epoch": 0.2,
645
+ "learning_rate": 0.00019366911700832145,
646
+ "loss": 2.3852,
647
+ "step": 105
648
+ },
649
+ {
650
+ "epoch": 0.2,
651
+ "learning_rate": 0.00019343938371606712,
652
+ "loss": 2.3642,
653
+ "step": 106
654
+ },
655
+ {
656
+ "epoch": 0.2,
657
+ "learning_rate": 0.00019320569735915271,
658
+ "loss": 2.39,
659
+ "step": 107
660
+ },
661
+ {
662
+ "epoch": 0.2,
663
+ "learning_rate": 0.0001929680678239585,
664
+ "loss": 2.4373,
665
+ "step": 108
666
+ },
667
+ {
668
+ "epoch": 0.2,
669
+ "learning_rate": 0.0001927265051636856,
670
+ "loss": 2.4666,
671
+ "step": 109
672
+ },
673
+ {
674
+ "epoch": 0.21,
675
+ "learning_rate": 0.00019248101959793066,
676
+ "loss": 2.4267,
677
+ "step": 110
678
+ },
679
+ {
680
+ "epoch": 0.21,
681
+ "learning_rate": 0.0001922316215122536,
682
+ "loss": 2.4158,
683
+ "step": 111
684
+ },
685
+ {
686
+ "epoch": 0.21,
687
+ "learning_rate": 0.0001919783214577381,
688
+ "loss": 2.3634,
689
+ "step": 112
690
+ },
691
+ {
692
+ "epoch": 0.21,
693
+ "learning_rate": 0.00019172113015054532,
694
+ "loss": 2.4179,
695
+ "step": 113
696
+ },
697
+ {
698
+ "epoch": 0.21,
699
+ "learning_rate": 0.0001914600584714605,
700
+ "loss": 2.364,
701
+ "step": 114
702
+ },
703
+ {
704
+ "epoch": 0.22,
705
+ "learning_rate": 0.00019119511746543263,
706
+ "loss": 2.3435,
707
+ "step": 115
708
+ },
709
+ {
710
+ "epoch": 0.22,
711
+ "learning_rate": 0.00019092631834110723,
712
+ "loss": 2.2741,
713
+ "step": 116
714
+ },
715
+ {
716
+ "epoch": 0.22,
717
+ "learning_rate": 0.00019065367247035213,
718
+ "loss": 2.3201,
719
+ "step": 117
720
+ },
721
+ {
722
+ "epoch": 0.22,
723
+ "learning_rate": 0.00019037719138777627,
724
+ "loss": 2.4475,
725
+ "step": 118
726
+ },
727
+ {
728
+ "epoch": 0.22,
729
+ "learning_rate": 0.0001900968867902419,
730
+ "loss": 2.3559,
731
+ "step": 119
732
+ },
733
+ {
734
+ "epoch": 0.22,
735
+ "learning_rate": 0.0001898127705363696,
736
+ "loss": 2.3547,
737
+ "step": 120
738
+ },
739
+ {
740
+ "epoch": 0.23,
741
+ "learning_rate": 0.00018952485464603664,
742
+ "loss": 2.2853,
743
+ "step": 121
744
+ },
745
+ {
746
+ "epoch": 0.23,
747
+ "learning_rate": 0.00018923315129986835,
748
+ "loss": 2.4317,
749
+ "step": 122
750
+ },
751
+ {
752
+ "epoch": 0.23,
753
+ "learning_rate": 0.00018893767283872305,
754
+ "loss": 2.3741,
755
+ "step": 123
756
+ },
757
+ {
758
+ "epoch": 0.23,
759
+ "learning_rate": 0.0001886384317631697,
760
+ "loss": 2.2959,
761
+ "step": 124
762
+ },
763
+ {
764
+ "epoch": 0.23,
765
+ "learning_rate": 0.00018833544073295917,
766
+ "loss": 2.3672,
767
+ "step": 125
768
+ },
769
+ {
770
+ "epoch": 0.24,
771
+ "learning_rate": 0.00018802871256648872,
772
+ "loss": 2.3465,
773
+ "step": 126
774
+ },
775
+ {
776
+ "epoch": 0.24,
777
+ "learning_rate": 0.00018771826024025946,
778
+ "loss": 2.2856,
779
+ "step": 127
780
+ },
781
+ {
782
+ "epoch": 0.24,
783
+ "learning_rate": 0.00018740409688832764,
784
+ "loss": 2.28,
785
+ "step": 128
786
+ },
787
+ {
788
+ "epoch": 0.24,
789
+ "learning_rate": 0.00018708623580174889,
790
+ "loss": 2.2592,
791
+ "step": 129
792
+ },
793
+ {
794
+ "epoch": 0.24,
795
+ "learning_rate": 0.00018676469042801588,
796
+ "loss": 2.3545,
797
+ "step": 130
798
+ },
799
+ {
800
+ "epoch": 0.25,
801
+ "learning_rate": 0.00018643947437048944,
802
+ "loss": 2.3505,
803
+ "step": 131
804
+ },
805
+ {
806
+ "epoch": 0.25,
807
+ "learning_rate": 0.00018611060138782305,
808
+ "loss": 2.3164,
809
+ "step": 132
810
+ },
811
+ {
812
+ "epoch": 0.25,
813
+ "learning_rate": 0.00018577808539338087,
814
+ "loss": 2.3547,
815
+ "step": 133
816
+ },
817
+ {
818
+ "epoch": 0.25,
819
+ "learning_rate": 0.00018544194045464886,
820
+ "loss": 2.3772,
821
+ "step": 134
822
+ },
823
+ {
824
+ "epoch": 0.25,
825
+ "eval_loss": 2.3696775436401367,
826
+ "eval_runtime": 55.6786,
827
+ "eval_samples_per_second": 24.21,
828
+ "eval_steps_per_second": 1.024,
829
+ "step": 134
830
+ },
831
+ {
832
+ "epoch": 0.25,
833
+ "learning_rate": 0.00018510218079263995,
834
+ "loss": 2.4287,
835
+ "step": 135
836
+ },
837
+ {
838
+ "epoch": 0.25,
839
+ "learning_rate": 0.00018475882078129212,
840
+ "loss": 2.3653,
841
+ "step": 136
842
+ },
843
+ {
844
+ "epoch": 0.26,
845
+ "learning_rate": 0.00018441187494686053,
846
+ "loss": 2.3392,
847
+ "step": 137
848
+ },
849
+ {
850
+ "epoch": 0.26,
851
+ "learning_rate": 0.00018406135796730287,
852
+ "loss": 2.3177,
853
+ "step": 138
854
+ },
855
+ {
856
+ "epoch": 0.26,
857
+ "learning_rate": 0.00018370728467165828,
858
+ "loss": 2.3777,
859
+ "step": 139
860
+ },
861
+ {
862
+ "epoch": 0.26,
863
+ "learning_rate": 0.0001833496700394202,
864
+ "loss": 2.3158,
865
+ "step": 140
866
+ },
867
+ {
868
+ "epoch": 0.26,
869
+ "learning_rate": 0.00018298852919990252,
870
+ "loss": 2.3367,
871
+ "step": 141
872
+ },
873
+ {
874
+ "epoch": 0.27,
875
+ "learning_rate": 0.0001826238774315995,
876
+ "loss": 2.231,
877
+ "step": 142
878
+ },
879
+ {
880
+ "epoch": 0.27,
881
+ "learning_rate": 0.00018225573016153945,
882
+ "loss": 2.2859,
883
+ "step": 143
884
+ },
885
+ {
886
+ "epoch": 0.27,
887
+ "learning_rate": 0.0001818841029646321,
888
+ "loss": 2.2594,
889
+ "step": 144
890
+ },
891
+ {
892
+ "epoch": 0.27,
893
+ "learning_rate": 0.00018150901156300956,
894
+ "loss": 2.2945,
895
+ "step": 145
896
+ },
897
+ {
898
+ "epoch": 0.27,
899
+ "learning_rate": 0.00018113047182536127,
900
+ "loss": 2.2277,
901
+ "step": 146
902
+ },
903
+ {
904
+ "epoch": 0.28,
905
+ "learning_rate": 0.00018074849976626274,
906
+ "loss": 2.285,
907
+ "step": 147
908
+ },
909
+ {
910
+ "epoch": 0.28,
911
+ "learning_rate": 0.00018036311154549784,
912
+ "loss": 2.287,
913
+ "step": 148
914
+ },
915
+ {
916
+ "epoch": 0.28,
917
+ "learning_rate": 0.00017997432346737524,
918
+ "loss": 2.2308,
919
+ "step": 149
920
+ },
921
+ {
922
+ "epoch": 0.28,
923
+ "learning_rate": 0.00017958215198003865,
924
+ "loss": 2.3425,
925
+ "step": 150
926
+ },
927
+ {
928
+ "epoch": 0.28,
929
+ "learning_rate": 0.00017918661367477098,
930
+ "loss": 2.1763,
931
+ "step": 151
932
+ },
933
+ {
934
+ "epoch": 0.28,
935
+ "learning_rate": 0.00017878772528529232,
936
+ "loss": 2.3044,
937
+ "step": 152
938
+ },
939
+ {
940
+ "epoch": 0.29,
941
+ "learning_rate": 0.00017838550368705217,
942
+ "loss": 2.1648,
943
+ "step": 153
944
+ },
945
+ {
946
+ "epoch": 0.29,
947
+ "learning_rate": 0.0001779799658965153,
948
+ "loss": 2.3134,
949
+ "step": 154
950
+ },
951
+ {
952
+ "epoch": 0.29,
953
+ "learning_rate": 0.000177571129070442,
954
+ "loss": 2.2027,
955
+ "step": 155
956
+ },
957
+ {
958
+ "epoch": 0.29,
959
+ "learning_rate": 0.0001771590105051622,
960
+ "loss": 2.2242,
961
+ "step": 156
962
+ },
963
+ {
964
+ "epoch": 0.29,
965
+ "learning_rate": 0.00017674362763584375,
966
+ "loss": 2.2897,
967
+ "step": 157
968
+ },
969
+ {
970
+ "epoch": 0.3,
971
+ "learning_rate": 0.00017632499803575474,
972
+ "loss": 2.1541,
973
+ "step": 158
974
+ },
975
+ {
976
+ "epoch": 0.3,
977
+ "learning_rate": 0.00017590313941552002,
978
+ "loss": 2.173,
979
+ "step": 159
980
+ },
981
+ {
982
+ "epoch": 0.3,
983
+ "learning_rate": 0.0001754780696223722,
984
+ "loss": 2.2662,
985
+ "step": 160
986
+ },
987
+ {
988
+ "epoch": 0.3,
989
+ "learning_rate": 0.00017504980663939613,
990
+ "loss": 2.2121,
991
+ "step": 161
992
+ },
993
+ {
994
+ "epoch": 0.3,
995
+ "learning_rate": 0.00017461836858476856,
996
+ "loss": 2.2703,
997
+ "step": 162
998
+ },
999
+ {
1000
+ "epoch": 0.31,
1001
+ "learning_rate": 0.00017418377371099136,
1002
+ "loss": 2.2875,
1003
+ "step": 163
1004
+ },
1005
+ {
1006
+ "epoch": 0.31,
1007
+ "learning_rate": 0.00017374604040411935,
1008
+ "loss": 2.2159,
1009
+ "step": 164
1010
+ },
1011
+ {
1012
+ "epoch": 0.31,
1013
+ "learning_rate": 0.00017330518718298264,
1014
+ "loss": 2.2517,
1015
+ "step": 165
1016
+ },
1017
+ {
1018
+ "epoch": 0.31,
1019
+ "learning_rate": 0.00017286123269840293,
1020
+ "loss": 2.2079,
1021
+ "step": 166
1022
+ },
1023
+ {
1024
+ "epoch": 0.31,
1025
+ "learning_rate": 0.00017241419573240462,
1026
+ "loss": 2.1622,
1027
+ "step": 167
1028
+ },
1029
+ {
1030
+ "epoch": 0.31,
1031
+ "learning_rate": 0.0001719640951974202,
1032
+ "loss": 2.2229,
1033
+ "step": 168
1034
+ },
1035
+ {
1036
+ "epoch": 0.32,
1037
+ "learning_rate": 0.00017151095013548994,
1038
+ "loss": 2.2151,
1039
+ "step": 169
1040
+ },
1041
+ {
1042
+ "epoch": 0.32,
1043
+ "learning_rate": 0.00017105477971745666,
1044
+ "loss": 2.232,
1045
+ "step": 170
1046
+ },
1047
+ {
1048
+ "epoch": 0.32,
1049
+ "learning_rate": 0.00017059560324215436,
1050
+ "loss": 2.2971,
1051
+ "step": 171
1052
+ },
1053
+ {
1054
+ "epoch": 0.32,
1055
+ "learning_rate": 0.00017013344013559197,
1056
+ "loss": 2.1772,
1057
+ "step": 172
1058
+ },
1059
+ {
1060
+ "epoch": 0.32,
1061
+ "learning_rate": 0.00016966830995013133,
1062
+ "loss": 2.2384,
1063
+ "step": 173
1064
+ },
1065
+ {
1066
+ "epoch": 0.33,
1067
+ "learning_rate": 0.00016920023236366002,
1068
+ "loss": 2.1376,
1069
+ "step": 174
1070
+ },
1071
+ {
1072
+ "epoch": 0.33,
1073
+ "learning_rate": 0.00016872922717875923,
1074
+ "loss": 2.1521,
1075
+ "step": 175
1076
+ },
1077
+ {
1078
+ "epoch": 0.33,
1079
+ "learning_rate": 0.00016825531432186543,
1080
+ "loss": 2.2222,
1081
+ "step": 176
1082
+ },
1083
+ {
1084
+ "epoch": 0.33,
1085
+ "learning_rate": 0.00016777851384242766,
1086
+ "loss": 2.1104,
1087
+ "step": 177
1088
+ },
1089
+ {
1090
+ "epoch": 0.33,
1091
+ "learning_rate": 0.0001672988459120594,
1092
+ "loss": 2.2398,
1093
+ "step": 178
1094
+ },
1095
+ {
1096
+ "epoch": 0.34,
1097
+ "learning_rate": 0.00016681633082368498,
1098
+ "loss": 2.1505,
1099
+ "step": 179
1100
+ },
1101
+ {
1102
+ "epoch": 0.34,
1103
+ "learning_rate": 0.0001663309889906811,
1104
+ "loss": 2.1549,
1105
+ "step": 180
1106
+ },
1107
+ {
1108
+ "epoch": 0.34,
1109
+ "learning_rate": 0.0001658428409460134,
1110
+ "loss": 2.2301,
1111
+ "step": 181
1112
+ },
1113
+ {
1114
+ "epoch": 0.34,
1115
+ "learning_rate": 0.0001653519073413675,
1116
+ "loss": 2.1479,
1117
+ "step": 182
1118
+ },
1119
+ {
1120
+ "epoch": 0.34,
1121
+ "learning_rate": 0.0001648582089462756,
1122
+ "loss": 2.1095,
1123
+ "step": 183
1124
+ },
1125
+ {
1126
+ "epoch": 0.34,
1127
+ "learning_rate": 0.0001643617666472376,
1128
+ "loss": 2.1487,
1129
+ "step": 184
1130
+ },
1131
+ {
1132
+ "epoch": 0.35,
1133
+ "learning_rate": 0.00016386260144683745,
1134
+ "loss": 2.1334,
1135
+ "step": 185
1136
+ },
1137
+ {
1138
+ "epoch": 0.35,
1139
+ "learning_rate": 0.00016336073446285485,
1140
+ "loss": 2.0953,
1141
+ "step": 186
1142
+ },
1143
+ {
1144
+ "epoch": 0.35,
1145
+ "learning_rate": 0.00016285618692737157,
1146
+ "loss": 2.1386,
1147
+ "step": 187
1148
+ },
1149
+ {
1150
+ "epoch": 0.35,
1151
+ "learning_rate": 0.00016234898018587337,
1152
+ "loss": 2.1415,
1153
+ "step": 188
1154
+ },
1155
+ {
1156
+ "epoch": 0.35,
1157
+ "learning_rate": 0.0001618391356963468,
1158
+ "loss": 2.0492,
1159
+ "step": 189
1160
+ },
1161
+ {
1162
+ "epoch": 0.36,
1163
+ "learning_rate": 0.00016132667502837165,
1164
+ "loss": 2.056,
1165
+ "step": 190
1166
+ },
1167
+ {
1168
+ "epoch": 0.36,
1169
+ "learning_rate": 0.00016081161986220807,
1170
+ "loss": 2.2249,
1171
+ "step": 191
1172
+ },
1173
+ {
1174
+ "epoch": 0.36,
1175
+ "learning_rate": 0.00016029399198787974,
1176
+ "loss": 2.1115,
1177
+ "step": 192
1178
+ },
1179
+ {
1180
+ "epoch": 0.36,
1181
+ "learning_rate": 0.00015977381330425163,
1182
+ "loss": 2.1275,
1183
+ "step": 193
1184
+ },
1185
+ {
1186
+ "epoch": 0.36,
1187
+ "learning_rate": 0.00015925110581810394,
1188
+ "loss": 1.9615,
1189
+ "step": 194
1190
+ },
1191
+ {
1192
+ "epoch": 0.37,
1193
+ "learning_rate": 0.00015872589164320078,
1194
+ "loss": 2.1591,
1195
+ "step": 195
1196
+ },
1197
+ {
1198
+ "epoch": 0.37,
1199
+ "learning_rate": 0.0001581981929993547,
1200
+ "loss": 2.1233,
1201
+ "step": 196
1202
+ },
1203
+ {
1204
+ "epoch": 0.37,
1205
+ "learning_rate": 0.00015766803221148673,
1206
+ "loss": 2.2147,
1207
+ "step": 197
1208
+ },
1209
+ {
1210
+ "epoch": 0.37,
1211
+ "learning_rate": 0.0001571354317086818,
1212
+ "loss": 2.1625,
1213
+ "step": 198
1214
+ },
1215
+ {
1216
+ "epoch": 0.37,
1217
+ "learning_rate": 0.0001566004140232399,
1218
+ "loss": 2.0565,
1219
+ "step": 199
1220
+ },
1221
+ {
1222
+ "epoch": 0.37,
1223
+ "learning_rate": 0.00015606300178972287,
1224
+ "loss": 2.1389,
1225
+ "step": 200
1226
+ },
1227
+ {
1228
+ "epoch": 0.38,
1229
+ "learning_rate": 0.00015552321774399666,
1230
+ "loss": 2.126,
1231
+ "step": 201
1232
+ },
1233
+ {
1234
+ "epoch": 0.38,
1235
+ "learning_rate": 0.00015498108472226964,
1236
+ "loss": 2.1251,
1237
+ "step": 202
1238
+ },
1239
+ {
1240
+ "epoch": 0.38,
1241
+ "learning_rate": 0.00015443662566012645,
1242
+ "loss": 2.0343,
1243
+ "step": 203
1244
+ },
1245
+ {
1246
+ "epoch": 0.38,
1247
+ "learning_rate": 0.00015388986359155758,
1248
+ "loss": 2.076,
1249
+ "step": 204
1250
+ },
1251
+ {
1252
+ "epoch": 0.38,
1253
+ "learning_rate": 0.00015334082164798489,
1254
+ "loss": 1.9876,
1255
+ "step": 205
1256
+ },
1257
+ {
1258
+ "epoch": 0.39,
1259
+ "learning_rate": 0.00015278952305728324,
1260
+ "loss": 2.1316,
1261
+ "step": 206
1262
+ },
1263
+ {
1264
+ "epoch": 0.39,
1265
+ "learning_rate": 0.00015223599114279755,
1266
+ "loss": 2.06,
1267
+ "step": 207
1268
+ },
1269
+ {
1270
+ "epoch": 0.39,
1271
+ "learning_rate": 0.00015168024932235617,
1272
+ "loss": 2.0479,
1273
+ "step": 208
1274
+ },
1275
+ {
1276
+ "epoch": 0.39,
1277
+ "learning_rate": 0.00015112232110728015,
1278
+ "loss": 1.9749,
1279
+ "step": 209
1280
+ },
1281
+ {
1282
+ "epoch": 0.39,
1283
+ "learning_rate": 0.00015056223010138857,
1284
+ "loss": 2.1165,
1285
+ "step": 210
1286
+ },
1287
+ {
1288
+ "epoch": 0.4,
1289
+ "learning_rate": 0.00015000000000000001,
1290
+ "loss": 2.0656,
1291
+ "step": 211
1292
+ },
1293
+ {
1294
+ "epoch": 0.4,
1295
+ "learning_rate": 0.00014943565458893,
1296
+ "loss": 2.0241,
1297
+ "step": 212
1298
+ },
1299
+ {
1300
+ "epoch": 0.4,
1301
+ "learning_rate": 0.00014886921774348472,
1302
+ "loss": 2.0393,
1303
+ "step": 213
1304
+ },
1305
+ {
1306
+ "epoch": 0.4,
1307
+ "learning_rate": 0.00014830071342745112,
1308
+ "loss": 2.0376,
1309
+ "step": 214
1310
+ },
1311
+ {
1312
+ "epoch": 0.4,
1313
+ "learning_rate": 0.00014773016569208283,
1314
+ "loss": 2.0739,
1315
+ "step": 215
1316
+ },
1317
+ {
1318
+ "epoch": 0.4,
1319
+ "learning_rate": 0.0001471575986750828,
1320
+ "loss": 2.0254,
1321
+ "step": 216
1322
+ },
1323
+ {
1324
+ "epoch": 0.41,
1325
+ "learning_rate": 0.0001465830365995821,
1326
+ "loss": 2.0989,
1327
+ "step": 217
1328
+ },
1329
+ {
1330
+ "epoch": 0.41,
1331
+ "learning_rate": 0.00014600650377311522,
1332
+ "loss": 2.1056,
1333
+ "step": 218
1334
+ },
1335
+ {
1336
+ "epoch": 0.41,
1337
+ "learning_rate": 0.00014542802458659152,
1338
+ "loss": 2.0197,
1339
+ "step": 219
1340
+ },
1341
+ {
1342
+ "epoch": 0.41,
1343
+ "learning_rate": 0.00014484762351326343,
1344
+ "loss": 2.055,
1345
+ "step": 220
1346
+ },
1347
+ {
1348
+ "epoch": 0.41,
1349
+ "learning_rate": 0.0001442653251076912,
1350
+ "loss": 2.058,
1351
+ "step": 221
1352
+ },
1353
+ {
1354
+ "epoch": 0.42,
1355
+ "learning_rate": 0.00014368115400470392,
1356
+ "loss": 1.9918,
1357
+ "step": 222
1358
+ },
1359
+ {
1360
+ "epoch": 0.42,
1361
+ "learning_rate": 0.00014309513491835734,
1362
+ "loss": 2.0102,
1363
+ "step": 223
1364
+ },
1365
+ {
1366
+ "epoch": 0.42,
1367
+ "learning_rate": 0.00014250729264088843,
1368
+ "loss": 2.0356,
1369
+ "step": 224
1370
+ },
1371
+ {
1372
+ "epoch": 0.42,
1373
+ "learning_rate": 0.00014191765204166643,
1374
+ "loss": 2.0166,
1375
+ "step": 225
1376
+ },
1377
+ {
1378
+ "epoch": 0.42,
1379
+ "learning_rate": 0.00014132623806614063,
1380
+ "loss": 1.9309,
1381
+ "step": 226
1382
+ },
1383
+ {
1384
+ "epoch": 0.43,
1385
+ "learning_rate": 0.00014073307573478526,
1386
+ "loss": 2.0886,
1387
+ "step": 227
1388
+ },
1389
+ {
1390
+ "epoch": 0.43,
1391
+ "learning_rate": 0.00014013819014204075,
1392
+ "loss": 1.973,
1393
+ "step": 228
1394
+ },
1395
+ {
1396
+ "epoch": 0.43,
1397
+ "learning_rate": 0.00013954160645525217,
1398
+ "loss": 1.9996,
1399
+ "step": 229
1400
+ },
1401
+ {
1402
+ "epoch": 0.43,
1403
+ "learning_rate": 0.00013894334991360448,
1404
+ "loss": 1.9444,
1405
+ "step": 230
1406
+ },
1407
+ {
1408
+ "epoch": 0.43,
1409
+ "learning_rate": 0.00013834344582705474,
1410
+ "loss": 2.0583,
1411
+ "step": 231
1412
+ },
1413
+ {
1414
+ "epoch": 0.43,
1415
+ "learning_rate": 0.00013774191957526143,
1416
+ "loss": 1.9805,
1417
+ "step": 232
1418
+ },
1419
+ {
1420
+ "epoch": 0.44,
1421
+ "learning_rate": 0.00013713879660651068,
1422
+ "loss": 2.0694,
1423
+ "step": 233
1424
+ },
1425
+ {
1426
+ "epoch": 0.44,
1427
+ "learning_rate": 0.00013653410243663952,
1428
+ "loss": 2.0294,
1429
+ "step": 234
1430
+ },
1431
+ {
1432
+ "epoch": 0.44,
1433
+ "learning_rate": 0.00013592786264795658,
1434
+ "loss": 1.966,
1435
+ "step": 235
1436
+ },
1437
+ {
1438
+ "epoch": 0.44,
1439
+ "learning_rate": 0.0001353201028881598,
1440
+ "loss": 1.8961,
1441
+ "step": 236
1442
+ },
1443
+ {
1444
+ "epoch": 0.44,
1445
+ "learning_rate": 0.00013471084886925122,
1446
+ "loss": 2.0144,
1447
+ "step": 237
1448
+ },
1449
+ {
1450
+ "epoch": 0.45,
1451
+ "learning_rate": 0.00013410012636644935,
1452
+ "loss": 1.9803,
1453
+ "step": 238
1454
+ },
1455
+ {
1456
+ "epoch": 0.45,
1457
+ "learning_rate": 0.00013348796121709862,
1458
+ "loss": 1.984,
1459
+ "step": 239
1460
+ },
1461
+ {
1462
+ "epoch": 0.45,
1463
+ "learning_rate": 0.0001328743793195764,
1464
+ "loss": 2.011,
1465
+ "step": 240
1466
+ },
1467
+ {
1468
+ "epoch": 0.45,
1469
+ "learning_rate": 0.00013225940663219726,
1470
+ "loss": 1.9768,
1471
+ "step": 241
1472
+ },
1473
+ {
1474
+ "epoch": 0.45,
1475
+ "learning_rate": 0.00013164306917211476,
1476
+ "loss": 1.9221,
1477
+ "step": 242
1478
+ },
1479
+ {
1480
+ "epoch": 0.46,
1481
+ "learning_rate": 0.00013102539301422086,
1482
+ "loss": 1.9793,
1483
+ "step": 243
1484
+ },
1485
+ {
1486
+ "epoch": 0.46,
1487
+ "learning_rate": 0.00013040640429004267,
1488
+ "loss": 1.944,
1489
+ "step": 244
1490
+ },
1491
+ {
1492
+ "epoch": 0.46,
1493
+ "learning_rate": 0.000129786129186637,
1494
+ "loss": 1.8944,
1495
+ "step": 245
1496
+ },
1497
+ {
1498
+ "epoch": 0.46,
1499
+ "learning_rate": 0.0001291645939454825,
1500
+ "loss": 2.0456,
1501
+ "step": 246
1502
+ },
1503
+ {
1504
+ "epoch": 0.46,
1505
+ "learning_rate": 0.00012854182486136942,
1506
+ "loss": 1.992,
1507
+ "step": 247
1508
+ },
1509
+ {
1510
+ "epoch": 0.46,
1511
+ "learning_rate": 0.00012791784828128724,
1512
+ "loss": 1.9942,
1513
+ "step": 248
1514
+ },
1515
+ {
1516
+ "epoch": 0.47,
1517
+ "learning_rate": 0.00012729269060330999,
1518
+ "loss": 1.9879,
1519
+ "step": 249
1520
+ },
1521
+ {
1522
+ "epoch": 0.47,
1523
+ "learning_rate": 0.00012666637827547932,
1524
+ "loss": 1.9231,
1525
+ "step": 250
1526
+ },
1527
+ {
1528
+ "epoch": 0.47,
1529
+ "learning_rate": 0.00012603893779468604,
1530
+ "loss": 1.9368,
1531
+ "step": 251
1532
+ },
1533
+ {
1534
+ "epoch": 0.47,
1535
+ "learning_rate": 0.0001254103957055485,
1536
+ "loss": 1.856,
1537
+ "step": 252
1538
+ },
1539
+ {
1540
+ "epoch": 0.47,
1541
+ "learning_rate": 0.00012478077859929,
1542
+ "loss": 1.9358,
1543
+ "step": 253
1544
+ },
1545
+ {
1546
+ "epoch": 0.48,
1547
+ "learning_rate": 0.0001241501131126138,
1548
+ "loss": 1.995,
1549
+ "step": 254
1550
+ },
1551
+ {
1552
+ "epoch": 0.48,
1553
+ "learning_rate": 0.00012351842592657613,
1554
+ "loss": 1.8455,
1555
+ "step": 255
1556
+ },
1557
+ {
1558
+ "epoch": 0.48,
1559
+ "learning_rate": 0.00012288574376545733,
1560
+ "loss": 1.8912,
1561
+ "step": 256
1562
+ },
1563
+ {
1564
+ "epoch": 0.48,
1565
+ "learning_rate": 0.00012225209339563145,
1566
+ "loss": 1.9491,
1567
+ "step": 257
1568
+ },
1569
+ {
1570
+ "epoch": 0.48,
1571
+ "learning_rate": 0.00012161750162443371,
1572
+ "loss": 1.8341,
1573
+ "step": 258
1574
+ },
1575
+ {
1576
+ "epoch": 0.49,
1577
+ "learning_rate": 0.00012098199529902648,
1578
+ "loss": 1.8941,
1579
+ "step": 259
1580
+ },
1581
+ {
1582
+ "epoch": 0.49,
1583
+ "learning_rate": 0.0001203456013052634,
1584
+ "loss": 1.8808,
1585
+ "step": 260
1586
+ },
1587
+ {
1588
+ "epoch": 0.49,
1589
+ "learning_rate": 0.00011970834656655199,
1590
+ "loss": 1.8794,
1591
+ "step": 261
1592
+ },
1593
+ {
1594
+ "epoch": 0.49,
1595
+ "learning_rate": 0.00011907025804271461,
1596
+ "loss": 1.8828,
1597
+ "step": 262
1598
+ },
1599
+ {
1600
+ "epoch": 0.49,
1601
+ "learning_rate": 0.00011843136272884794,
1602
+ "loss": 1.818,
1603
+ "step": 263
1604
+ },
1605
+ {
1606
+ "epoch": 0.49,
1607
+ "learning_rate": 0.00011779168765418079,
1608
+ "loss": 1.847,
1609
+ "step": 264
1610
+ },
1611
+ {
1612
+ "epoch": 0.5,
1613
+ "learning_rate": 0.00011715125988093074,
1614
+ "loss": 1.8181,
1615
+ "step": 265
1616
+ },
1617
+ {
1618
+ "epoch": 0.5,
1619
+ "learning_rate": 0.00011651010650315923,
1620
+ "loss": 1.8297,
1621
+ "step": 266
1622
+ },
1623
+ {
1624
+ "epoch": 0.5,
1625
+ "learning_rate": 0.00011586825464562514,
1626
+ "loss": 1.9047,
1627
+ "step": 267
1628
+ },
1629
+ {
1630
+ "epoch": 0.5,
1631
+ "learning_rate": 0.00011522573146263744,
1632
+ "loss": 1.8538,
1633
+ "step": 268
1634
+ },
1635
+ {
1636
+ "epoch": 0.5,
1637
+ "eval_loss": 1.8599034547805786,
1638
+ "eval_runtime": 55.6724,
1639
+ "eval_samples_per_second": 24.213,
1640
+ "eval_steps_per_second": 1.024,
1641
+ "step": 268
1642
+ },
1643
+ {
1644
+ "epoch": 0.5,
1645
+ "learning_rate": 0.00011458256413690633,
1646
+ "loss": 2.0143,
1647
+ "step": 269
1648
+ },
1649
+ {
1650
+ "epoch": 0.51,
1651
+ "learning_rate": 0.00011393877987839327,
1652
+ "loss": 1.7532,
1653
+ "step": 270
1654
+ },
1655
+ {
1656
+ "epoch": 0.51,
1657
+ "learning_rate": 0.00011329440592315971,
1658
+ "loss": 1.825,
1659
+ "step": 271
1660
+ },
1661
+ {
1662
+ "epoch": 0.51,
1663
+ "learning_rate": 0.00011264946953221496,
1664
+ "loss": 1.7548,
1665
+ "step": 272
1666
+ },
1667
+ {
1668
+ "epoch": 0.51,
1669
+ "learning_rate": 0.00011200399799036288,
1670
+ "loss": 1.8505,
1671
+ "step": 273
1672
+ },
1673
+ {
1674
+ "epoch": 0.51,
1675
+ "learning_rate": 0.00011135801860504749,
1676
+ "loss": 1.8608,
1677
+ "step": 274
1678
+ },
1679
+ {
1680
+ "epoch": 0.52,
1681
+ "learning_rate": 0.00011071155870519777,
1682
+ "loss": 1.8352,
1683
+ "step": 275
1684
+ },
1685
+ {
1686
+ "epoch": 0.52,
1687
+ "learning_rate": 0.00011006464564007138,
1688
+ "loss": 1.9602,
1689
+ "step": 276
1690
+ },
1691
+ {
1692
+ "epoch": 0.52,
1693
+ "learning_rate": 0.00010941730677809772,
1694
+ "loss": 1.7833,
1695
+ "step": 277
1696
+ },
1697
+ {
1698
+ "epoch": 0.52,
1699
+ "learning_rate": 0.00010876956950572006,
1700
+ "loss": 1.8567,
1701
+ "step": 278
1702
+ },
1703
+ {
1704
+ "epoch": 0.52,
1705
+ "learning_rate": 0.00010812146122623683,
1706
+ "loss": 1.8606,
1707
+ "step": 279
1708
+ },
1709
+ {
1710
+ "epoch": 0.52,
1711
+ "learning_rate": 0.00010747300935864243,
1712
+ "loss": 1.7611,
1713
+ "step": 280
1714
+ },
1715
+ {
1716
+ "epoch": 0.53,
1717
+ "learning_rate": 0.0001068242413364671,
1718
+ "loss": 1.8188,
1719
+ "step": 281
1720
+ },
1721
+ {
1722
+ "epoch": 0.53,
1723
+ "learning_rate": 0.00010617518460661644,
1724
+ "loss": 1.7576,
1725
+ "step": 282
1726
+ },
1727
+ {
1728
+ "epoch": 0.53,
1729
+ "learning_rate": 0.00010552586662821009,
1730
+ "loss": 1.8525,
1731
+ "step": 283
1732
+ },
1733
+ {
1734
+ "epoch": 0.53,
1735
+ "learning_rate": 0.00010487631487142017,
1736
+ "loss": 1.7134,
1737
+ "step": 284
1738
+ },
1739
+ {
1740
+ "epoch": 0.53,
1741
+ "learning_rate": 0.00010422655681630917,
1742
+ "loss": 1.8414,
1743
+ "step": 285
1744
+ },
1745
+ {
1746
+ "epoch": 0.54,
1747
+ "learning_rate": 0.00010357661995166705,
1748
+ "loss": 1.815,
1749
+ "step": 286
1750
+ },
1751
+ {
1752
+ "epoch": 0.54,
1753
+ "learning_rate": 0.00010292653177384876,
1754
+ "loss": 1.7789,
1755
+ "step": 287
1756
+ },
1757
+ {
1758
+ "epoch": 0.54,
1759
+ "learning_rate": 0.00010227631978561056,
1760
+ "loss": 1.82,
1761
+ "step": 288
1762
+ },
1763
+ {
1764
+ "epoch": 0.54,
1765
+ "learning_rate": 0.00010162601149494676,
1766
+ "loss": 1.8095,
1767
+ "step": 289
1768
+ },
1769
+ {
1770
+ "epoch": 0.54,
1771
+ "learning_rate": 0.00010097563441392581,
1772
+ "loss": 1.7666,
1773
+ "step": 290
1774
+ },
1775
+ {
1776
+ "epoch": 0.55,
1777
+ "learning_rate": 0.00010032521605752646,
1778
+ "loss": 1.8287,
1779
+ "step": 291
1780
+ },
1781
+ {
1782
+ "epoch": 0.55,
1783
+ "learning_rate": 9.967478394247357e-05,
1784
+ "loss": 1.8818,
1785
+ "step": 292
1786
+ },
1787
+ {
1788
+ "epoch": 0.55,
1789
+ "learning_rate": 9.90243655860742e-05,
1790
+ "loss": 1.7085,
1791
+ "step": 293
1792
+ },
1793
+ {
1794
+ "epoch": 0.55,
1795
+ "learning_rate": 9.837398850505324e-05,
1796
+ "loss": 1.7111,
1797
+ "step": 294
1798
+ },
1799
+ {
1800
+ "epoch": 0.55,
1801
+ "learning_rate": 9.772368021438943e-05,
1802
+ "loss": 1.7282,
1803
+ "step": 295
1804
+ },
1805
+ {
1806
+ "epoch": 0.55,
1807
+ "learning_rate": 9.707346822615128e-05,
1808
+ "loss": 1.8105,
1809
+ "step": 296
1810
+ },
1811
+ {
1812
+ "epoch": 0.56,
1813
+ "learning_rate": 9.642338004833295e-05,
1814
+ "loss": 1.7592,
1815
+ "step": 297
1816
+ },
1817
+ {
1818
+ "epoch": 0.56,
1819
+ "learning_rate": 9.577344318369084e-05,
1820
+ "loss": 1.6769,
1821
+ "step": 298
1822
+ },
1823
+ {
1824
+ "epoch": 0.56,
1825
+ "learning_rate": 9.512368512857984e-05,
1826
+ "loss": 1.721,
1827
+ "step": 299
1828
+ },
1829
+ {
1830
+ "epoch": 0.56,
1831
+ "learning_rate": 9.447413337178995e-05,
1832
+ "loss": 1.6353,
1833
+ "step": 300
1834
+ },
1835
+ {
1836
+ "epoch": 0.56,
1837
+ "learning_rate": 9.38248153933836e-05,
1838
+ "loss": 1.654,
1839
+ "step": 301
1840
+ },
1841
+ {
1842
+ "epoch": 0.57,
1843
+ "learning_rate": 9.317575866353292e-05,
1844
+ "loss": 1.7222,
1845
+ "step": 302
1846
+ },
1847
+ {
1848
+ "epoch": 0.57,
1849
+ "learning_rate": 9.252699064135758e-05,
1850
+ "loss": 1.7727,
1851
+ "step": 303
1852
+ },
1853
+ {
1854
+ "epoch": 0.57,
1855
+ "learning_rate": 9.187853877376318e-05,
1856
+ "loss": 1.8161,
1857
+ "step": 304
1858
+ },
1859
+ {
1860
+ "epoch": 0.57,
1861
+ "learning_rate": 9.123043049427995e-05,
1862
+ "loss": 1.7088,
1863
+ "step": 305
1864
+ },
1865
+ {
1866
+ "epoch": 0.57,
1867
+ "learning_rate": 9.058269322190228e-05,
1868
+ "loss": 1.7274,
1869
+ "step": 306
1870
+ },
1871
+ {
1872
+ "epoch": 0.58,
1873
+ "learning_rate": 8.993535435992867e-05,
1874
+ "loss": 1.6949,
1875
+ "step": 307
1876
+ },
1877
+ {
1878
+ "epoch": 0.58,
1879
+ "learning_rate": 8.928844129480227e-05,
1880
+ "loss": 1.7429,
1881
+ "step": 308
1882
+ },
1883
+ {
1884
+ "epoch": 0.58,
1885
+ "learning_rate": 8.86419813949525e-05,
1886
+ "loss": 1.7443,
1887
+ "step": 309
1888
+ },
1889
+ {
1890
+ "epoch": 0.58,
1891
+ "learning_rate": 8.799600200963716e-05,
1892
+ "loss": 1.5959,
1893
+ "step": 310
1894
+ },
1895
+ {
1896
+ "epoch": 0.58,
1897
+ "learning_rate": 8.735053046778506e-05,
1898
+ "loss": 1.6557,
1899
+ "step": 311
1900
+ },
1901
+ {
1902
+ "epoch": 0.58,
1903
+ "learning_rate": 8.670559407684034e-05,
1904
+ "loss": 1.6743,
1905
+ "step": 312
1906
+ },
1907
+ {
1908
+ "epoch": 0.59,
1909
+ "learning_rate": 8.606122012160676e-05,
1910
+ "loss": 1.7672,
1911
+ "step": 313
1912
+ },
1913
+ {
1914
+ "epoch": 0.59,
1915
+ "learning_rate": 8.541743586309365e-05,
1916
+ "loss": 1.6774,
1917
+ "step": 314
1918
+ },
1919
+ {
1920
+ "epoch": 0.59,
1921
+ "learning_rate": 8.477426853736257e-05,
1922
+ "loss": 1.6597,
1923
+ "step": 315
1924
+ },
1925
+ {
1926
+ "epoch": 0.59,
1927
+ "learning_rate": 8.413174535437487e-05,
1928
+ "loss": 1.7112,
1929
+ "step": 316
1930
+ },
1931
+ {
1932
+ "epoch": 0.59,
1933
+ "learning_rate": 8.348989349684076e-05,
1934
+ "loss": 1.6499,
1935
+ "step": 317
1936
+ },
1937
+ {
1938
+ "epoch": 0.6,
1939
+ "learning_rate": 8.284874011906927e-05,
1940
+ "loss": 1.625,
1941
+ "step": 318
1942
+ },
1943
+ {
1944
+ "epoch": 0.6,
1945
+ "learning_rate": 8.220831234581922e-05,
1946
+ "loss": 1.6922,
1947
+ "step": 319
1948
+ },
1949
+ {
1950
+ "epoch": 0.6,
1951
+ "learning_rate": 8.156863727115211e-05,
1952
+ "loss": 1.6797,
1953
+ "step": 320
1954
+ },
1955
+ {
1956
+ "epoch": 0.6,
1957
+ "learning_rate": 8.092974195728542e-05,
1958
+ "loss": 1.6772,
1959
+ "step": 321
1960
+ },
1961
+ {
1962
+ "epoch": 0.6,
1963
+ "learning_rate": 8.029165343344805e-05,
1964
+ "loss": 1.6439,
1965
+ "step": 322
1966
+ },
1967
+ {
1968
+ "epoch": 0.61,
1969
+ "learning_rate": 7.965439869473664e-05,
1970
+ "loss": 1.6358,
1971
+ "step": 323
1972
+ },
1973
+ {
1974
+ "epoch": 0.61,
1975
+ "learning_rate": 7.901800470097355e-05,
1976
+ "loss": 1.6808,
1977
+ "step": 324
1978
+ },
1979
+ {
1980
+ "epoch": 0.61,
1981
+ "learning_rate": 7.838249837556629e-05,
1982
+ "loss": 1.6013,
1983
+ "step": 325
1984
+ },
1985
+ {
1986
+ "epoch": 0.61,
1987
+ "learning_rate": 7.774790660436858e-05,
1988
+ "loss": 1.6607,
1989
+ "step": 326
1990
+ },
1991
+ {
1992
+ "epoch": 0.61,
1993
+ "learning_rate": 7.711425623454267e-05,
1994
+ "loss": 1.7424,
1995
+ "step": 327
1996
+ },
1997
+ {
1998
+ "epoch": 0.61,
1999
+ "learning_rate": 7.648157407342386e-05,
2000
+ "loss": 1.6395,
2001
+ "step": 328
2002
+ },
2003
+ {
2004
+ "epoch": 0.62,
2005
+ "learning_rate": 7.584988688738622e-05,
2006
+ "loss": 1.7159,
2007
+ "step": 329
2008
+ },
2009
+ {
2010
+ "epoch": 0.62,
2011
+ "learning_rate": 7.521922140071002e-05,
2012
+ "loss": 1.57,
2013
+ "step": 330
2014
+ },
2015
+ {
2016
+ "epoch": 0.62,
2017
+ "learning_rate": 7.458960429445157e-05,
2018
+ "loss": 1.6616,
2019
+ "step": 331
2020
+ },
2021
+ {
2022
+ "epoch": 0.62,
2023
+ "learning_rate": 7.396106220531398e-05,
2024
+ "loss": 1.6996,
2025
+ "step": 332
2026
+ },
2027
+ {
2028
+ "epoch": 0.62,
2029
+ "learning_rate": 7.333362172452065e-05,
2030
+ "loss": 1.6087,
2031
+ "step": 333
2032
+ },
2033
+ {
2034
+ "epoch": 0.63,
2035
+ "learning_rate": 7.270730939669006e-05,
2036
+ "loss": 1.6516,
2037
+ "step": 334
2038
+ },
2039
+ {
2040
+ "epoch": 0.63,
2041
+ "learning_rate": 7.208215171871277e-05,
2042
+ "loss": 1.6155,
2043
+ "step": 335
2044
+ },
2045
+ {
2046
+ "epoch": 0.63,
2047
+ "learning_rate": 7.145817513863057e-05,
2048
+ "loss": 1.7189,
2049
+ "step": 336
2050
+ },
2051
+ {
2052
+ "epoch": 0.63,
2053
+ "learning_rate": 7.08354060545175e-05,
2054
+ "loss": 1.6217,
2055
+ "step": 337
2056
+ },
2057
+ {
2058
+ "epoch": 0.63,
2059
+ "learning_rate": 7.021387081336301e-05,
2060
+ "loss": 1.6072,
2061
+ "step": 338
2062
+ },
2063
+ {
2064
+ "epoch": 0.64,
2065
+ "learning_rate": 6.959359570995738e-05,
2066
+ "loss": 1.6163,
2067
+ "step": 339
2068
+ },
2069
+ {
2070
+ "epoch": 0.64,
2071
+ "learning_rate": 6.897460698577918e-05,
2072
+ "loss": 1.5596,
2073
+ "step": 340
2074
+ },
2075
+ {
2076
+ "epoch": 0.64,
2077
+ "learning_rate": 6.835693082788525e-05,
2078
+ "loss": 1.5035,
2079
+ "step": 341
2080
+ },
2081
+ {
2082
+ "epoch": 0.64,
2083
+ "learning_rate": 6.774059336780277e-05,
2084
+ "loss": 1.5525,
2085
+ "step": 342
2086
+ },
2087
+ {
2088
+ "epoch": 0.64,
2089
+ "learning_rate": 6.712562068042361e-05,
2090
+ "loss": 1.578,
2091
+ "step": 343
2092
+ },
2093
+ {
2094
+ "epoch": 0.64,
2095
+ "learning_rate": 6.651203878290139e-05,
2096
+ "loss": 1.5724,
2097
+ "step": 344
2098
+ },
2099
+ {
2100
+ "epoch": 0.65,
2101
+ "learning_rate": 6.589987363355068e-05,
2102
+ "loss": 1.6454,
2103
+ "step": 345
2104
+ },
2105
+ {
2106
+ "epoch": 0.65,
2107
+ "learning_rate": 6.528915113074879e-05,
2108
+ "loss": 1.5945,
2109
+ "step": 346
2110
+ },
2111
+ {
2112
+ "epoch": 0.65,
2113
+ "learning_rate": 6.46798971118402e-05,
2114
+ "loss": 1.5424,
2115
+ "step": 347
2116
+ },
2117
+ {
2118
+ "epoch": 0.65,
2119
+ "learning_rate": 6.407213735204343e-05,
2120
+ "loss": 1.6592,
2121
+ "step": 348
2122
+ },
2123
+ {
2124
+ "epoch": 0.65,
2125
+ "learning_rate": 6.34658975633605e-05,
2126
+ "loss": 1.6077,
2127
+ "step": 349
2128
+ },
2129
+ {
2130
+ "epoch": 0.66,
2131
+ "learning_rate": 6.286120339348935e-05,
2132
+ "loss": 1.5977,
2133
+ "step": 350
2134
+ },
2135
+ {
2136
+ "epoch": 0.66,
2137
+ "learning_rate": 6.225808042473858e-05,
2138
+ "loss": 1.6713,
2139
+ "step": 351
2140
+ },
2141
+ {
2142
+ "epoch": 0.66,
2143
+ "learning_rate": 6.165655417294527e-05,
2144
+ "loss": 1.4955,
2145
+ "step": 352
2146
+ },
2147
+ {
2148
+ "epoch": 0.66,
2149
+ "learning_rate": 6.105665008639557e-05,
2150
+ "loss": 1.5353,
2151
+ "step": 353
2152
+ },
2153
+ {
2154
+ "epoch": 0.66,
2155
+ "learning_rate": 6.045839354474786e-05,
2156
+ "loss": 1.4601,
2157
+ "step": 354
2158
+ },
2159
+ {
2160
+ "epoch": 0.67,
2161
+ "learning_rate": 5.986180985795926e-05,
2162
+ "loss": 1.5212,
2163
+ "step": 355
2164
+ },
2165
+ {
2166
+ "epoch": 0.67,
2167
+ "learning_rate": 5.926692426521474e-05,
2168
+ "loss": 1.5534,
2169
+ "step": 356
2170
+ },
2171
+ {
2172
+ "epoch": 0.67,
2173
+ "learning_rate": 5.867376193385936e-05,
2174
+ "loss": 1.5822,
2175
+ "step": 357
2176
+ },
2177
+ {
2178
+ "epoch": 0.67,
2179
+ "learning_rate": 5.8082347958333625e-05,
2180
+ "loss": 1.583,
2181
+ "step": 358
2182
+ },
2183
+ {
2184
+ "epoch": 0.67,
2185
+ "learning_rate": 5.749270735911158e-05,
2186
+ "loss": 1.484,
2187
+ "step": 359
2188
+ },
2189
+ {
2190
+ "epoch": 0.67,
2191
+ "learning_rate": 5.6904865081642676e-05,
2192
+ "loss": 1.404,
2193
+ "step": 360
2194
+ },
2195
+ {
2196
+ "epoch": 0.68,
2197
+ "learning_rate": 5.631884599529611e-05,
2198
+ "loss": 1.4449,
2199
+ "step": 361
2200
+ },
2201
+ {
2202
+ "epoch": 0.68,
2203
+ "learning_rate": 5.573467489230879e-05,
2204
+ "loss": 1.553,
2205
+ "step": 362
2206
+ },
2207
+ {
2208
+ "epoch": 0.68,
2209
+ "learning_rate": 5.515237648673656e-05,
2210
+ "loss": 1.4247,
2211
+ "step": 363
2212
+ },
2213
+ {
2214
+ "epoch": 0.68,
2215
+ "learning_rate": 5.457197541340853e-05,
2216
+ "loss": 1.4967,
2217
+ "step": 364
2218
+ },
2219
+ {
2220
+ "epoch": 0.68,
2221
+ "learning_rate": 5.399349622688479e-05,
2222
+ "loss": 1.5317,
2223
+ "step": 365
2224
+ },
2225
+ {
2226
+ "epoch": 0.69,
2227
+ "learning_rate": 5.3416963400417905e-05,
2228
+ "loss": 1.5611,
2229
+ "step": 366
2230
+ },
2231
+ {
2232
+ "epoch": 0.69,
2233
+ "learning_rate": 5.284240132491727e-05,
2234
+ "loss": 1.588,
2235
+ "step": 367
2236
+ },
2237
+ {
2238
+ "epoch": 0.69,
2239
+ "learning_rate": 5.226983430791722e-05,
2240
+ "loss": 1.5095,
2241
+ "step": 368
2242
+ },
2243
+ {
2244
+ "epoch": 0.69,
2245
+ "learning_rate": 5.16992865725489e-05,
2246
+ "loss": 1.4771,
2247
+ "step": 369
2248
+ },
2249
+ {
2250
+ "epoch": 0.69,
2251
+ "learning_rate": 5.113078225651529e-05,
2252
+ "loss": 1.4928,
2253
+ "step": 370
2254
+ },
2255
+ {
2256
+ "epoch": 0.7,
2257
+ "learning_rate": 5.0564345411070025e-05,
2258
+ "loss": 1.5018,
2259
+ "step": 371
2260
+ },
2261
+ {
2262
+ "epoch": 0.7,
2263
+ "learning_rate": 5.000000000000002e-05,
2264
+ "loss": 1.4768,
2265
+ "step": 372
2266
+ },
2267
+ {
2268
+ "epoch": 0.7,
2269
+ "learning_rate": 4.943776989861145e-05,
2270
+ "loss": 1.5867,
2271
+ "step": 373
2272
+ },
2273
+ {
2274
+ "epoch": 0.7,
2275
+ "learning_rate": 4.8877678892719866e-05,
2276
+ "loss": 1.4886,
2277
+ "step": 374
2278
+ },
2279
+ {
2280
+ "epoch": 0.7,
2281
+ "learning_rate": 4.831975067764387e-05,
2282
+ "loss": 1.5394,
2283
+ "step": 375
2284
+ },
2285
+ {
2286
+ "epoch": 0.7,
2287
+ "learning_rate": 4.7764008857202425e-05,
2288
+ "loss": 1.4141,
2289
+ "step": 376
2290
+ },
2291
+ {
2292
+ "epoch": 0.71,
2293
+ "learning_rate": 4.721047694271676e-05,
2294
+ "loss": 1.4668,
2295
+ "step": 377
2296
+ },
2297
+ {
2298
+ "epoch": 0.71,
2299
+ "learning_rate": 4.665917835201512e-05,
2300
+ "loss": 1.507,
2301
+ "step": 378
2302
+ },
2303
+ {
2304
+ "epoch": 0.71,
2305
+ "learning_rate": 4.611013640844245e-05,
2306
+ "loss": 1.4728,
2307
+ "step": 379
2308
+ },
2309
+ {
2310
+ "epoch": 0.71,
2311
+ "learning_rate": 4.556337433987359e-05,
2312
+ "loss": 1.4566,
2313
+ "step": 380
2314
+ },
2315
+ {
2316
+ "epoch": 0.71,
2317
+ "learning_rate": 4.501891527773038e-05,
2318
+ "loss": 1.4617,
2319
+ "step": 381
2320
+ },
2321
+ {
2322
+ "epoch": 0.72,
2323
+ "learning_rate": 4.447678225600337e-05,
2324
+ "loss": 1.4384,
2325
+ "step": 382
2326
+ },
2327
+ {
2328
+ "epoch": 0.72,
2329
+ "learning_rate": 4.393699821027716e-05,
2330
+ "loss": 1.5093,
2331
+ "step": 383
2332
+ },
2333
+ {
2334
+ "epoch": 0.72,
2335
+ "learning_rate": 4.3399585976760105e-05,
2336
+ "loss": 1.4602,
2337
+ "step": 384
2338
+ },
2339
+ {
2340
+ "epoch": 0.72,
2341
+ "learning_rate": 4.286456829131821e-05,
2342
+ "loss": 1.3591,
2343
+ "step": 385
2344
+ },
2345
+ {
2346
+ "epoch": 0.72,
2347
+ "learning_rate": 4.2331967788513295e-05,
2348
+ "loss": 1.4804,
2349
+ "step": 386
2350
+ },
2351
+ {
2352
+ "epoch": 0.73,
2353
+ "learning_rate": 4.180180700064531e-05,
2354
+ "loss": 1.4427,
2355
+ "step": 387
2356
+ },
2357
+ {
2358
+ "epoch": 0.73,
2359
+ "learning_rate": 4.127410835679926e-05,
2360
+ "loss": 1.3901,
2361
+ "step": 388
2362
+ },
2363
+ {
2364
+ "epoch": 0.73,
2365
+ "learning_rate": 4.074889418189608e-05,
2366
+ "loss": 1.4564,
2367
+ "step": 389
2368
+ },
2369
+ {
2370
+ "epoch": 0.73,
2371
+ "learning_rate": 4.022618669574839e-05,
2372
+ "loss": 1.4548,
2373
+ "step": 390
2374
+ },
2375
+ {
2376
+ "epoch": 0.73,
2377
+ "learning_rate": 3.97060080121203e-05,
2378
+ "loss": 1.4485,
2379
+ "step": 391
2380
+ },
2381
+ {
2382
+ "epoch": 0.73,
2383
+ "learning_rate": 3.9188380137791936e-05,
2384
+ "loss": 1.418,
2385
+ "step": 392
2386
+ },
2387
+ {
2388
+ "epoch": 0.74,
2389
+ "learning_rate": 3.8673324971628357e-05,
2390
+ "loss": 1.4664,
2391
+ "step": 393
2392
+ },
2393
+ {
2394
+ "epoch": 0.74,
2395
+ "learning_rate": 3.816086430365321e-05,
2396
+ "loss": 1.4593,
2397
+ "step": 394
2398
+ },
2399
+ {
2400
+ "epoch": 0.74,
2401
+ "learning_rate": 3.7651019814126654e-05,
2402
+ "loss": 1.4556,
2403
+ "step": 395
2404
+ },
2405
+ {
2406
+ "epoch": 0.74,
2407
+ "learning_rate": 3.7143813072628465e-05,
2408
+ "loss": 1.3472,
2409
+ "step": 396
2410
+ },
2411
+ {
2412
+ "epoch": 0.74,
2413
+ "learning_rate": 3.663926553714518e-05,
2414
+ "loss": 1.2962,
2415
+ "step": 397
2416
+ },
2417
+ {
2418
+ "epoch": 0.75,
2419
+ "learning_rate": 3.613739855316257e-05,
2420
+ "loss": 1.4875,
2421
+ "step": 398
2422
+ },
2423
+ {
2424
+ "epoch": 0.75,
2425
+ "learning_rate": 3.563823335276244e-05,
2426
+ "loss": 1.382,
2427
+ "step": 399
2428
+ },
2429
+ {
2430
+ "epoch": 0.75,
2431
+ "learning_rate": 3.5141791053724405e-05,
2432
+ "loss": 1.3698,
2433
+ "step": 400
2434
+ },
2435
+ {
2436
+ "epoch": 0.75,
2437
+ "learning_rate": 3.46480926586325e-05,
2438
+ "loss": 1.4564,
2439
+ "step": 401
2440
+ },
2441
+ {
2442
+ "epoch": 0.75,
2443
+ "learning_rate": 3.415715905398664e-05,
2444
+ "loss": 1.5117,
2445
+ "step": 402
2446
+ },
2447
+ {
2448
+ "epoch": 0.75,
2449
+ "eval_loss": 1.422906517982483,
2450
+ "eval_runtime": 55.7451,
2451
+ "eval_samples_per_second": 24.182,
2452
+ "eval_steps_per_second": 1.023,
2453
+ "step": 402
2454
+ },
2455
+ {
2456
+ "epoch": 0.76,
2457
+ "learning_rate": 3.366901100931892e-05,
2458
+ "loss": 1.407,
2459
+ "step": 403
2460
+ },
2461
+ {
2462
+ "epoch": 0.76,
2463
+ "learning_rate": 3.3183669176315045e-05,
2464
+ "loss": 1.3833,
2465
+ "step": 404
2466
+ },
2467
+ {
2468
+ "epoch": 0.76,
2469
+ "learning_rate": 3.27011540879406e-05,
2470
+ "loss": 1.4071,
2471
+ "step": 405
2472
+ },
2473
+ {
2474
+ "epoch": 0.76,
2475
+ "learning_rate": 3.2221486157572324e-05,
2476
+ "loss": 1.439,
2477
+ "step": 406
2478
+ },
2479
+ {
2480
+ "epoch": 0.76,
2481
+ "learning_rate": 3.174468567813461e-05,
2482
+ "loss": 1.4009,
2483
+ "step": 407
2484
+ },
2485
+ {
2486
+ "epoch": 0.76,
2487
+ "learning_rate": 3.1270772821240776e-05,
2488
+ "loss": 1.417,
2489
+ "step": 408
2490
+ },
2491
+ {
2492
+ "epoch": 0.77,
2493
+ "learning_rate": 3.079976763633996e-05,
2494
+ "loss": 1.2888,
2495
+ "step": 409
2496
+ },
2497
+ {
2498
+ "epoch": 0.77,
2499
+ "learning_rate": 3.033169004986873e-05,
2500
+ "loss": 1.475,
2501
+ "step": 410
2502
+ },
2503
+ {
2504
+ "epoch": 0.77,
2505
+ "learning_rate": 2.986655986440805e-05,
2506
+ "loss": 1.3512,
2507
+ "step": 411
2508
+ },
2509
+ {
2510
+ "epoch": 0.77,
2511
+ "learning_rate": 2.940439675784563e-05,
2512
+ "loss": 1.2825,
2513
+ "step": 412
2514
+ },
2515
+ {
2516
+ "epoch": 0.77,
2517
+ "learning_rate": 2.894522028254334e-05,
2518
+ "loss": 1.3424,
2519
+ "step": 413
2520
+ },
2521
+ {
2522
+ "epoch": 0.78,
2523
+ "learning_rate": 2.8489049864510054e-05,
2524
+ "loss": 1.391,
2525
+ "step": 414
2526
+ },
2527
+ {
2528
+ "epoch": 0.78,
2529
+ "learning_rate": 2.803590480257985e-05,
2530
+ "loss": 1.2999,
2531
+ "step": 415
2532
+ },
2533
+ {
2534
+ "epoch": 0.78,
2535
+ "learning_rate": 2.7585804267595384e-05,
2536
+ "loss": 1.39,
2537
+ "step": 416
2538
+ },
2539
+ {
2540
+ "epoch": 0.78,
2541
+ "learning_rate": 2.7138767301597067e-05,
2542
+ "loss": 1.3686,
2543
+ "step": 417
2544
+ },
2545
+ {
2546
+ "epoch": 0.78,
2547
+ "learning_rate": 2.669481281701739e-05,
2548
+ "loss": 1.3871,
2549
+ "step": 418
2550
+ },
2551
+ {
2552
+ "epoch": 0.79,
2553
+ "learning_rate": 2.6253959595880673e-05,
2554
+ "loss": 1.3755,
2555
+ "step": 419
2556
+ },
2557
+ {
2558
+ "epoch": 0.79,
2559
+ "learning_rate": 2.581622628900868e-05,
2560
+ "loss": 1.4435,
2561
+ "step": 420
2562
+ },
2563
+ {
2564
+ "epoch": 0.79,
2565
+ "learning_rate": 2.5381631415231454e-05,
2566
+ "loss": 1.3808,
2567
+ "step": 421
2568
+ },
2569
+ {
2570
+ "epoch": 0.79,
2571
+ "learning_rate": 2.495019336060387e-05,
2572
+ "loss": 1.4653,
2573
+ "step": 422
2574
+ },
2575
+ {
2576
+ "epoch": 0.79,
2577
+ "learning_rate": 2.4521930377627812e-05,
2578
+ "loss": 1.3653,
2579
+ "step": 423
2580
+ },
2581
+ {
2582
+ "epoch": 0.79,
2583
+ "learning_rate": 2.4096860584479974e-05,
2584
+ "loss": 1.4224,
2585
+ "step": 424
2586
+ },
2587
+ {
2588
+ "epoch": 0.8,
2589
+ "learning_rate": 2.367500196424529e-05,
2590
+ "loss": 1.3416,
2591
+ "step": 425
2592
+ },
2593
+ {
2594
+ "epoch": 0.8,
2595
+ "learning_rate": 2.3256372364156286e-05,
2596
+ "loss": 1.3177,
2597
+ "step": 426
2598
+ },
2599
+ {
2600
+ "epoch": 0.8,
2601
+ "learning_rate": 2.2840989494837793e-05,
2602
+ "loss": 1.403,
2603
+ "step": 427
2604
+ },
2605
+ {
2606
+ "epoch": 0.8,
2607
+ "learning_rate": 2.242887092955801e-05,
2608
+ "loss": 1.4582,
2609
+ "step": 428
2610
+ },
2611
+ {
2612
+ "epoch": 0.8,
2613
+ "learning_rate": 2.202003410348473e-05,
2614
+ "loss": 1.4202,
2615
+ "step": 429
2616
+ },
2617
+ {
2618
+ "epoch": 0.81,
2619
+ "learning_rate": 2.1614496312947852e-05,
2620
+ "loss": 1.3492,
2621
+ "step": 430
2622
+ },
2623
+ {
2624
+ "epoch": 0.81,
2625
+ "learning_rate": 2.121227471470768e-05,
2626
+ "loss": 1.201,
2627
+ "step": 431
2628
+ },
2629
+ {
2630
+ "epoch": 0.81,
2631
+ "learning_rate": 2.0813386325229055e-05,
2632
+ "loss": 1.3131,
2633
+ "step": 432
2634
+ },
2635
+ {
2636
+ "epoch": 0.81,
2637
+ "learning_rate": 2.0417848019961372e-05,
2638
+ "loss": 1.3579,
2639
+ "step": 433
2640
+ },
2641
+ {
2642
+ "epoch": 0.81,
2643
+ "learning_rate": 2.002567653262479e-05,
2644
+ "loss": 1.3943,
2645
+ "step": 434
2646
+ },
2647
+ {
2648
+ "epoch": 0.82,
2649
+ "learning_rate": 1.9636888454502178e-05,
2650
+ "loss": 1.4777,
2651
+ "step": 435
2652
+ },
2653
+ {
2654
+ "epoch": 0.82,
2655
+ "learning_rate": 1.925150023373726e-05,
2656
+ "loss": 1.4449,
2657
+ "step": 436
2658
+ },
2659
+ {
2660
+ "epoch": 0.82,
2661
+ "learning_rate": 1.8869528174638752e-05,
2662
+ "loss": 1.3711,
2663
+ "step": 437
2664
+ },
2665
+ {
2666
+ "epoch": 0.82,
2667
+ "learning_rate": 1.8490988436990488e-05,
2668
+ "loss": 1.2473,
2669
+ "step": 438
2670
+ },
2671
+ {
2672
+ "epoch": 0.82,
2673
+ "learning_rate": 1.8115897035367934e-05,
2674
+ "loss": 1.4266,
2675
+ "step": 439
2676
+ },
2677
+ {
2678
+ "epoch": 0.82,
2679
+ "learning_rate": 1.774426983846058e-05,
2680
+ "loss": 1.3646,
2681
+ "step": 440
2682
+ },
2683
+ {
2684
+ "epoch": 0.83,
2685
+ "learning_rate": 1.7376122568400532e-05,
2686
+ "loss": 1.2857,
2687
+ "step": 441
2688
+ },
2689
+ {
2690
+ "epoch": 0.83,
2691
+ "learning_rate": 1.7011470800097496e-05,
2692
+ "loss": 1.3349,
2693
+ "step": 442
2694
+ },
2695
+ {
2696
+ "epoch": 0.83,
2697
+ "learning_rate": 1.6650329960579792e-05,
2698
+ "loss": 1.3196,
2699
+ "step": 443
2700
+ },
2701
+ {
2702
+ "epoch": 0.83,
2703
+ "learning_rate": 1.6292715328341712e-05,
2704
+ "loss": 1.3533,
2705
+ "step": 444
2706
+ },
2707
+ {
2708
+ "epoch": 0.83,
2709
+ "learning_rate": 1.593864203269716e-05,
2710
+ "loss": 1.3276,
2711
+ "step": 445
2712
+ },
2713
+ {
2714
+ "epoch": 0.84,
2715
+ "learning_rate": 1.5588125053139468e-05,
2716
+ "loss": 1.434,
2717
+ "step": 446
2718
+ },
2719
+ {
2720
+ "epoch": 0.84,
2721
+ "learning_rate": 1.5241179218707891e-05,
2722
+ "loss": 1.4045,
2723
+ "step": 447
2724
+ },
2725
+ {
2726
+ "epoch": 0.84,
2727
+ "learning_rate": 1.4897819207360098e-05,
2728
+ "loss": 1.4106,
2729
+ "step": 448
2730
+ },
2731
+ {
2732
+ "epoch": 0.84,
2733
+ "learning_rate": 1.4558059545351143e-05,
2734
+ "loss": 1.3125,
2735
+ "step": 449
2736
+ },
2737
+ {
2738
+ "epoch": 0.84,
2739
+ "learning_rate": 1.4221914606619135e-05,
2740
+ "loss": 1.2878,
2741
+ "step": 450
2742
+ },
2743
+ {
2744
+ "epoch": 0.85,
2745
+ "learning_rate": 1.3889398612176941e-05,
2746
+ "loss": 1.3981,
2747
+ "step": 451
2748
+ },
2749
+ {
2750
+ "epoch": 0.85,
2751
+ "learning_rate": 1.3560525629510568e-05,
2752
+ "loss": 1.2914,
2753
+ "step": 452
2754
+ },
2755
+ {
2756
+ "epoch": 0.85,
2757
+ "learning_rate": 1.3235309571984156e-05,
2758
+ "loss": 1.2669,
2759
+ "step": 453
2760
+ },
2761
+ {
2762
+ "epoch": 0.85,
2763
+ "learning_rate": 1.2913764198251132e-05,
2764
+ "loss": 1.405,
2765
+ "step": 454
2766
+ },
2767
+ {
2768
+ "epoch": 0.85,
2769
+ "learning_rate": 1.259590311167238e-05,
2770
+ "loss": 1.3743,
2771
+ "step": 455
2772
+ },
2773
+ {
2774
+ "epoch": 0.85,
2775
+ "learning_rate": 1.2281739759740574e-05,
2776
+ "loss": 1.2633,
2777
+ "step": 456
2778
+ },
2779
+ {
2780
+ "epoch": 0.86,
2781
+ "learning_rate": 1.1971287433511313e-05,
2782
+ "loss": 1.2473,
2783
+ "step": 457
2784
+ },
2785
+ {
2786
+ "epoch": 0.86,
2787
+ "learning_rate": 1.166455926704082e-05,
2788
+ "loss": 1.366,
2789
+ "step": 458
2790
+ },
2791
+ {
2792
+ "epoch": 0.86,
2793
+ "learning_rate": 1.1361568236830323e-05,
2794
+ "loss": 1.286,
2795
+ "step": 459
2796
+ },
2797
+ {
2798
+ "epoch": 0.86,
2799
+ "learning_rate": 1.1062327161276963e-05,
2800
+ "loss": 1.3363,
2801
+ "step": 460
2802
+ },
2803
+ {
2804
+ "epoch": 0.86,
2805
+ "learning_rate": 1.0766848700131648e-05,
2806
+ "loss": 1.3854,
2807
+ "step": 461
2808
+ },
2809
+ {
2810
+ "epoch": 0.87,
2811
+ "learning_rate": 1.0475145353963389e-05,
2812
+ "loss": 1.4039,
2813
+ "step": 462
2814
+ },
2815
+ {
2816
+ "epoch": 0.87,
2817
+ "learning_rate": 1.01872294636304e-05,
2818
+ "loss": 1.446,
2819
+ "step": 463
2820
+ },
2821
+ {
2822
+ "epoch": 0.87,
2823
+ "learning_rate": 9.903113209758096e-06,
2824
+ "loss": 1.3371,
2825
+ "step": 464
2826
+ },
2827
+ {
2828
+ "epoch": 0.87,
2829
+ "learning_rate": 9.62280861222372e-06,
2830
+ "loss": 1.3936,
2831
+ "step": 465
2832
+ },
2833
+ {
2834
+ "epoch": 0.87,
2835
+ "learning_rate": 9.346327529647868e-06,
2836
+ "loss": 1.2979,
2837
+ "step": 466
2838
+ },
2839
+ {
2840
+ "epoch": 0.88,
2841
+ "learning_rate": 9.073681658892775e-06,
2842
+ "loss": 1.3019,
2843
+ "step": 467
2844
+ },
2845
+ {
2846
+ "epoch": 0.88,
2847
+ "learning_rate": 8.804882534567382e-06,
2848
+ "loss": 1.3869,
2849
+ "step": 468
2850
+ },
2851
+ {
2852
+ "epoch": 0.88,
2853
+ "learning_rate": 8.53994152853952e-06,
2854
+ "loss": 1.3959,
2855
+ "step": 469
2856
+ },
2857
+ {
2858
+ "epoch": 0.88,
2859
+ "learning_rate": 8.278869849454718e-06,
2860
+ "loss": 1.2561,
2861
+ "step": 470
2862
+ },
2863
+ {
2864
+ "epoch": 0.88,
2865
+ "learning_rate": 8.021678542261924e-06,
2866
+ "loss": 1.3396,
2867
+ "step": 471
2868
+ },
2869
+ {
2870
+ "epoch": 0.88,
2871
+ "learning_rate": 7.76837848774642e-06,
2872
+ "loss": 1.3443,
2873
+ "step": 472
2874
+ },
2875
+ {
2876
+ "epoch": 0.89,
2877
+ "learning_rate": 7.5189804020693536e-06,
2878
+ "loss": 1.3167,
2879
+ "step": 473
2880
+ },
2881
+ {
2882
+ "epoch": 0.89,
2883
+ "learning_rate": 7.2734948363144206e-06,
2884
+ "loss": 1.2964,
2885
+ "step": 474
2886
+ },
2887
+ {
2888
+ "epoch": 0.89,
2889
+ "learning_rate": 7.031932176041523e-06,
2890
+ "loss": 1.3125,
2891
+ "step": 475
2892
+ },
2893
+ {
2894
+ "epoch": 0.89,
2895
+ "learning_rate": 6.794302640847294e-06,
2896
+ "loss": 1.2952,
2897
+ "step": 476
2898
+ },
2899
+ {
2900
+ "epoch": 0.89,
2901
+ "learning_rate": 6.560616283932897e-06,
2902
+ "loss": 1.2655,
2903
+ "step": 477
2904
+ },
2905
+ {
2906
+ "epoch": 0.9,
2907
+ "learning_rate": 6.330882991678577e-06,
2908
+ "loss": 1.3877,
2909
+ "step": 478
2910
+ },
2911
+ {
2912
+ "epoch": 0.9,
2913
+ "learning_rate": 6.1051124832254944e-06,
2914
+ "loss": 1.33,
2915
+ "step": 479
2916
+ },
2917
+ {
2918
+ "epoch": 0.9,
2919
+ "learning_rate": 5.883314310064492e-06,
2920
+ "loss": 1.3948,
2921
+ "step": 480
2922
+ },
2923
+ {
2924
+ "epoch": 0.9,
2925
+ "learning_rate": 5.6654978556320405e-06,
2926
+ "loss": 1.3569,
2927
+ "step": 481
2928
+ },
2929
+ {
2930
+ "epoch": 0.9,
2931
+ "learning_rate": 5.451672334913216e-06,
2932
+ "loss": 1.2655,
2933
+ "step": 482
2934
+ },
2935
+ {
2936
+ "epoch": 0.91,
2937
+ "learning_rate": 5.2418467940519185e-06,
2938
+ "loss": 1.3639,
2939
+ "step": 483
2940
+ },
2941
+ {
2942
+ "epoch": 0.91,
2943
+ "learning_rate": 5.036030109968082e-06,
2944
+ "loss": 1.427,
2945
+ "step": 484
2946
+ },
2947
+ {
2948
+ "epoch": 0.91,
2949
+ "learning_rate": 4.834230989982213e-06,
2950
+ "loss": 1.3306,
2951
+ "step": 485
2952
+ },
2953
+ {
2954
+ "epoch": 0.91,
2955
+ "learning_rate": 4.63645797144695e-06,
2956
+ "loss": 1.3196,
2957
+ "step": 486
2958
+ },
2959
+ {
2960
+ "epoch": 0.91,
2961
+ "learning_rate": 4.442719421385922e-06,
2962
+ "loss": 1.2518,
2963
+ "step": 487
2964
+ },
2965
+ {
2966
+ "epoch": 0.91,
2967
+ "learning_rate": 4.253023536139733e-06,
2968
+ "loss": 1.2918,
2969
+ "step": 488
2970
+ },
2971
+ {
2972
+ "epoch": 0.92,
2973
+ "learning_rate": 4.067378341019257e-06,
2974
+ "loss": 1.3128,
2975
+ "step": 489
2976
+ },
2977
+ {
2978
+ "epoch": 0.92,
2979
+ "learning_rate": 3.885791689966023e-06,
2980
+ "loss": 1.3452,
2981
+ "step": 490
2982
+ },
2983
+ {
2984
+ "epoch": 0.92,
2985
+ "learning_rate": 3.7082712652200867e-06,
2986
+ "loss": 1.4055,
2987
+ "step": 491
2988
+ },
2989
+ {
2990
+ "epoch": 0.92,
2991
+ "learning_rate": 3.5348245769948773e-06,
2992
+ "loss": 1.2194,
2993
+ "step": 492
2994
+ },
2995
+ {
2996
+ "epoch": 0.92,
2997
+ "learning_rate": 3.3654589631595955e-06,
2998
+ "loss": 1.338,
2999
+ "step": 493
3000
+ },
3001
+ {
3002
+ "epoch": 0.93,
3003
+ "learning_rate": 3.2001815889286856e-06,
3004
+ "loss": 1.158,
3005
+ "step": 494
3006
+ },
3007
+ {
3008
+ "epoch": 0.93,
3009
+ "learning_rate": 3.0389994465587545e-06,
3010
+ "loss": 1.3595,
3011
+ "step": 495
3012
+ },
3013
+ {
3014
+ "epoch": 0.93,
3015
+ "learning_rate": 2.881919355052709e-06,
3016
+ "loss": 1.2421,
3017
+ "step": 496
3018
+ },
3019
+ {
3020
+ "epoch": 0.93,
3021
+ "learning_rate": 2.728947959871353e-06,
3022
+ "loss": 1.3172,
3023
+ "step": 497
3024
+ },
3025
+ {
3026
+ "epoch": 0.93,
3027
+ "learning_rate": 2.580091732652101e-06,
3028
+ "loss": 1.2558,
3029
+ "step": 498
3030
+ },
3031
+ {
3032
+ "epoch": 0.94,
3033
+ "learning_rate": 2.435356970935354e-06,
3034
+ "loss": 1.2086,
3035
+ "step": 499
3036
+ },
3037
+ {
3038
+ "epoch": 0.94,
3039
+ "learning_rate": 2.294749797897955e-06,
3040
+ "loss": 1.3303,
3041
+ "step": 500
3042
+ },
3043
+ {
3044
+ "epoch": 0.94,
3045
+ "learning_rate": 2.158276162094197e-06,
3046
+ "loss": 1.3262,
3047
+ "step": 501
3048
+ },
3049
+ {
3050
+ "epoch": 0.94,
3051
+ "learning_rate": 2.0259418372041485e-06,
3052
+ "loss": 1.3066,
3053
+ "step": 502
3054
+ },
3055
+ {
3056
+ "epoch": 0.94,
3057
+ "learning_rate": 1.8977524217893783e-06,
3058
+ "loss": 1.3071,
3059
+ "step": 503
3060
+ },
3061
+ {
3062
+ "epoch": 0.94,
3063
+ "learning_rate": 1.7737133390561046e-06,
3064
+ "loss": 1.338,
3065
+ "step": 504
3066
+ },
3067
+ {
3068
+ "epoch": 0.95,
3069
+ "learning_rate": 1.6538298366257976e-06,
3070
+ "loss": 1.3407,
3071
+ "step": 505
3072
+ },
3073
+ {
3074
+ "epoch": 0.95,
3075
+ "learning_rate": 1.5381069863131037e-06,
3076
+ "loss": 1.4355,
3077
+ "step": 506
3078
+ },
3079
+ {
3080
+ "epoch": 0.95,
3081
+ "learning_rate": 1.426549683911349e-06,
3082
+ "loss": 1.341,
3083
+ "step": 507
3084
+ },
3085
+ {
3086
+ "epoch": 0.95,
3087
+ "learning_rate": 1.3191626489853615e-06,
3088
+ "loss": 1.3546,
3089
+ "step": 508
3090
+ },
3091
+ {
3092
+ "epoch": 0.95,
3093
+ "learning_rate": 1.2159504246718522e-06,
3094
+ "loss": 1.3322,
3095
+ "step": 509
3096
+ },
3097
+ {
3098
+ "epoch": 0.96,
3099
+ "learning_rate": 1.1169173774871478e-06,
3100
+ "loss": 1.3374,
3101
+ "step": 510
3102
+ },
3103
+ {
3104
+ "epoch": 0.96,
3105
+ "learning_rate": 1.0220676971425257e-06,
3106
+ "loss": 1.3706,
3107
+ "step": 511
3108
+ },
3109
+ {
3110
+ "epoch": 0.96,
3111
+ "learning_rate": 9.314053963669245e-07,
3112
+ "loss": 1.3249,
3113
+ "step": 512
3114
+ },
3115
+ {
3116
+ "epoch": 0.96,
3117
+ "learning_rate": 8.44934310737211e-07,
3118
+ "loss": 1.4235,
3119
+ "step": 513
3120
+ },
3121
+ {
3122
+ "epoch": 0.96,
3123
+ "learning_rate": 7.62658098515856e-07,
3124
+ "loss": 1.2759,
3125
+ "step": 514
3126
+ },
3127
+ {
3128
+ "epoch": 0.97,
3129
+ "learning_rate": 6.845802404962243e-07,
3130
+ "loss": 1.342,
3131
+ "step": 515
3132
+ },
3133
+ {
3134
+ "epoch": 0.97,
3135
+ "learning_rate": 6.107040398553144e-07,
3136
+ "loss": 1.4004,
3137
+ "step": 516
3138
+ },
3139
+ {
3140
+ "epoch": 0.97,
3141
+ "learning_rate": 5.410326220139705e-07,
3142
+ "loss": 1.3671,
3143
+ "step": 517
3144
+ },
3145
+ {
3146
+ "epoch": 0.97,
3147
+ "learning_rate": 4.7556893450466653e-07,
3148
+ "loss": 1.2746,
3149
+ "step": 518
3150
+ },
3151
+ {
3152
+ "epoch": 0.97,
3153
+ "learning_rate": 4.143157468468717e-07,
3154
+ "loss": 1.3585,
3155
+ "step": 519
3156
+ },
3157
+ {
3158
+ "epoch": 0.97,
3159
+ "learning_rate": 3.5727565042978915e-07,
3160
+ "loss": 1.3258,
3161
+ "step": 520
3162
+ },
3163
+ {
3164
+ "epoch": 0.98,
3165
+ "learning_rate": 3.044510584027771e-07,
3166
+ "loss": 1.2909,
3167
+ "step": 521
3168
+ },
3169
+ {
3170
+ "epoch": 0.98,
3171
+ "learning_rate": 2.558442055732524e-07,
3172
+ "loss": 1.2929,
3173
+ "step": 522
3174
+ },
3175
+ {
3176
+ "epoch": 0.98,
3177
+ "learning_rate": 2.1145714831216634e-07,
3178
+ "loss": 1.389,
3179
+ "step": 523
3180
+ },
3181
+ {
3182
+ "epoch": 0.98,
3183
+ "learning_rate": 1.7129176446692984e-07,
3184
+ "loss": 1.4132,
3185
+ "step": 524
3186
+ },
3187
+ {
3188
+ "epoch": 0.98,
3189
+ "learning_rate": 1.3534975328205467e-07,
3190
+ "loss": 1.2848,
3191
+ "step": 525
3192
+ },
3193
+ {
3194
+ "epoch": 0.99,
3195
+ "learning_rate": 1.0363263532724432e-07,
3196
+ "loss": 1.3483,
3197
+ "step": 526
3198
+ },
3199
+ {
3200
+ "epoch": 0.99,
3201
+ "learning_rate": 7.614175243301213e-08,
3202
+ "loss": 1.3588,
3203
+ "step": 527
3204
+ },
3205
+ {
3206
+ "epoch": 0.99,
3207
+ "learning_rate": 5.287826763398229e-08,
3208
+ "loss": 1.3012,
3209
+ "step": 528
3210
+ },
3211
+ {
3212
+ "epoch": 0.99,
3213
+ "learning_rate": 3.384316511964025e-08,
3214
+ "loss": 1.3524,
3215
+ "step": 529
3216
+ },
3217
+ {
3218
+ "epoch": 0.99,
3219
+ "learning_rate": 1.9037250192732726e-08,
3220
+ "loss": 1.3232,
3221
+ "step": 530
3222
+ },
3223
+ {
3224
+ "epoch": 1.0,
3225
+ "learning_rate": 8.46114923513941e-09,
3226
+ "loss": 1.3092,
3227
+ "step": 531
3228
+ },
3229
+ {
3230
+ "epoch": 1.0,
3231
+ "learning_rate": 2.1153096814607865e-09,
3232
+ "loss": 1.2231,
3233
+ "step": 532
3234
+ },
3235
+ {
3236
+ "epoch": 1.0,
3237
+ "learning_rate": 0.0,
3238
+ "loss": 1.4531,
3239
+ "step": 533
3240
+ }
3241
+ ],
3242
+ "logging_steps": 1,
3243
+ "max_steps": 533,
3244
+ "num_input_tokens_seen": 0,
3245
+ "num_train_epochs": 1,
3246
+ "save_steps": 500,
3247
+ "total_flos": 4.023661144257331e+17,
3248
+ "train_batch_size": 24,
3249
+ "trial_name": null,
3250
+ "trial_params": null
3251
+ }
checkpoint-533/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90963497c775e2c4826a759fa340d1cb03b54b14febd8fa57150d11705b3b3d2
3
+ size 5304
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:430773bcc382aa85105ac14dfbe701477264c4471e671bcfd04fbedb29a7d17d
3
  size 2690915926
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3464c8cb8a932250431b5dbd85ed6326d02b5a522804bc43caae6c0ceb9cc5dd
3
  size 2690915926
runs/Feb08_21-57-29_ruche-gpu12.cluster/events.out.tfevents.1707425852.ruche-gpu12.cluster.19037.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:072c616c52a3abff9659d22155a018fa9823bb289430a3b09d44ded3335c47bd
3
+ size 89752