Hugging Face's logo

sanchit-gandhi
/
flax-wav2vec2-2-bart-large-ls-960h-feature-encoder

Automatic Speech Recognition
Transformers
speech-encoder-decoder
Inference Endpoints
Model card Files Community
sanchit-gandhi HF staff commited on
Commit
4f0ee1a
•
1 Parent(s): 70a51c6

up

Browse files
Files changed (12) hide show
  1. nohup.out +0 -0
  2. wandb/debug-internal.log +1 -0
  3. wandb/debug.log +1 -0
  4. wandb/latest-run +1 -0
  5. wandb/run-20220530_120145-2k01y1ky/files/config.yaml +38 -0
  6. wandb/run-20220530_120145-2k01y1ky/files/output.log +560 -0
  7. wandb/run-20220530_120145-2k01y1ky/files/requirements.txt +159 -0
  8. wandb/run-20220530_120145-2k01y1ky/files/wandb-metadata.json +62 -0
  9. wandb/run-20220530_120145-2k01y1ky/files/wandb-summary.json +1 -0
  10. wandb/run-20220530_120145-2k01y1ky/logs/debug-internal.log +369 -0
  11. wandb/run-20220530_120145-2k01y1ky/logs/debug.log +139 -0
  12. wandb/run-20220530_120145-2k01y1ky/run-2k01y1ky.wandb +0 -0
nohup.out ADDED
The diff for this file is too large to render. See raw diff
 
wandb/debug-internal.log ADDED
@@ -0,0 +1 @@
 
 
1
+ run-20220530_120145-2k01y1ky/logs/debug-internal.log
wandb/debug.log ADDED
@@ -0,0 +1 @@
 
 
1
+ run-20220530_120145-2k01y1ky/logs/debug.log
wandb/latest-run ADDED
@@ -0,0 +1 @@
 
 
1
+ run-20220530_120145-2k01y1ky
wandb/run-20220530_120145-2k01y1ky/files/config.yaml ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ wandb_version: 1
2
+
3
+ _wandb:
4
+ desc: null
5
+ value:
6
+ cli_version: 0.12.15
7
+ framework: huggingface
8
+ huggingface_version: 4.18.0.dev0
9
+ is_jupyter_run: false
10
+ is_kaggle_kernel: false
11
+ python_version: 3.8.10
12
+ start_time: 1653912105
13
+ t:
14
+ 1:
15
+ - 1
16
+ - 11
17
+ - 12
18
+ - 45
19
+ - 49
20
+ - 51
21
+ - 55
22
+ 2:
23
+ - 1
24
+ - 5
25
+ - 11
26
+ - 12
27
+ - 45
28
+ - 49
29
+ - 51
30
+ - 53
31
+ - 55
32
+ 3:
33
+ - 13
34
+ 4: 3.8.10
35
+ 5: 0.12.15
36
+ 6: 4.18.0.dev0
37
+ 8:
38
+ - 5
wandb/run-20220530_120145-2k01y1ky/files/output.log ADDED
@@ -0,0 +1,560 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 05/30/2022 12:01:47 - INFO - __main__ - Training/evaluation parameters FlaxSeq2SeqTrainingArguments(
2
+ _n_gpu=-1,
3
+ adafactor=False,
4
+ adam_beta1=0.9,
5
+ adam_beta2=0.999,
6
+ adam_epsilon=1e-08,
7
+ bf16=False,
8
+ bf16_full_eval=False,
9
+ data_seed=None,
10
+ dataloader_drop_last=False,
11
+ dataloader_num_workers=0,
12
+ dataloader_pin_memory=True,
13
+ ddp_bucket_cap_mb=None,
14
+ ddp_find_unused_parameters=None,
15
+ debug=,
16
+ deepspeed=None,
17
+ disable_tqdm=None,
18
+ do_eval=True,
19
+ do_predict=True,
20
+ do_train=True,
21
+ eval_accumulation_steps=None,
22
+ eval_delay=0,
23
+ eval_steps=10000,
24
+ evaluation_strategy=no,
25
+ final_generation_max_length=200,
26
+ final_generation_num_beams=5,
27
+ fp16=False,
28
+ fp16_backend=auto,
29
+ fp16_full_eval=False,
30
+ fp16_opt_level=O1,
31
+ generation_length_penalty=1.2,
32
+ generation_max_length=40,
33
+ generation_num_beams=1,
34
+ gradient_accumulation_steps=1,
35
+ gradient_checkpointing=True,
36
+ greater_is_better=None,
37
+ group_by_length=False,
38
+ half_precision_backend=auto,
39
+ hub_model_id=None,
40
+ hub_strategy=every_save,
41
+ hub_token=<HUB_TOKEN>,
42
+ ignore_data_skip=False,
43
+ label_names=None,
44
+ label_smoothing_factor=0.0,
45
+ learning_rate=0.0001,
46
+ length_column_name=input_length,
47
+ load_best_model_at_end=False,
48
+ local_rank=-1,
49
+ log_level=passive,
50
+ log_level_replica=passive,
51
+ log_on_each_node=True,
52
+ logging_dir=None,
53
+ logging_first_step=False,
54
+ logging_nan_inf_filter=True,
55
+ logging_steps=25,
56
+ logging_strategy=steps,
57
+ lr_scheduler_type=linear,
58
+ matmul_precision=default,
59
+ max_grad_norm=1.0,
60
+ max_steps=50000,
61
+ metric_for_best_model=None,
62
+ mp_parameters=,
63
+ no_cuda=False,
64
+ num_train_epochs=3.0,
65
+ optim=adamw_hf,
66
+ output_dir=./,
67
+ overwrite_output_dir=True,
68
+ past_index=-1,
69
+ per_device_eval_batch_size=4,
70
+ per_device_train_batch_size=8,
71
+ precision=full,
72
+ predict_with_generate=True,
73
+ prediction_loss_only=False,
74
+ push_to_hub=True,
75
+ push_to_hub_model_id=None,
76
+ push_to_hub_organization=None,
77
+ push_to_hub_token=<PUSH_TO_HUB_TOKEN>,
78
+ remove_unused_columns=True,
79
+ report_to=None,
80
+ resume_from_checkpoint=None,
81
+ run_name=None,
82
+ save_on_each_node=False,
83
+ save_steps=10000,
84
+ save_strategy=steps,
85
+ save_total_limit=1,
86
+ seed=42,
87
+ sharded_ddp=,
88
+ skip_memory_metrics=True,
89
+ sortish_sampler=False,
90
+ tf32=None,
91
+ tpu_metrics_debug=False,
92
+ tpu_num_cores=None,
93
+ use_legacy_prediction_loop=False,
94
+ warmup_ratio=0.0,
95
+ warmup_steps=500,
96
+ weight_decay=0.0,
97
+ xpu_backend=None,
98
+ )
99
+ 05/30/2022 12:01:47 - INFO - __main__ - JAX devices: 8, matmul precision: default
100
+ 05/30/2022 12:01:47 - WARNING - datasets.builder - Reusing dataset librispeech_asr (/home/sanchitgandhi/cache/huggingface/datasets/librispeech_asr/all/2.1.0/14c8bffddb861b4b3a4fcdff648a56980dbb808f3fc56f5a3d56b18ee88458eb)
101
+ 05/30/2022 12:01:49 - WARNING - datasets.builder - Reusing dataset librispeech_asr (/home/sanchitgandhi/cache/huggingface/datasets/librispeech_asr/all/2.1.0/14c8bffddb861b4b3a4fcdff648a56980dbb808f3fc56f5a3d56b18ee88458eb)
102
+ 05/30/2022 12:01:50 - WARNING - datasets.builder - Reusing dataset librispeech_asr (/home/sanchitgandhi/cache/huggingface/datasets/librispeech_asr/all/2.1.0/14c8bffddb861b4b3a4fcdff648a56980dbb808f3fc56f5a3d56b18ee88458eb)
103
+ 05/30/2022 12:01:50 - WARNING - datasets.builder - Reusing dataset librispeech_asr (/home/sanchitgandhi/cache/huggingface/datasets/librispeech_asr/all/2.1.0/14c8bffddb861b4b3a4fcdff648a56980dbb808f3fc56f5a3d56b18ee88458eb)
104
+ 05/30/2022 12:01:51 - WARNING - datasets.builder - Reusing dataset librispeech_asr (/home/sanchitgandhi/cache/huggingface/datasets/librispeech_asr/all/2.1.0/14c8bffddb861b4b3a4fcdff648a56980dbb808f3fc56f5a3d56b18ee88458eb)
105
+ https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-scan/resolve/main/config.json not found in cache or force_download set to True, downloading to /home/sanchitgandhi/.cache/huggingface/transformers/tmp2_f644vh
106
+ Downloading: 100% 6.84k/6.84k [00:00<00:00, 10.2MB/s]
107
+ storing https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-scan/resolve/main/config.json in cache at /home/sanchitgandhi/.cache/huggingface/transformers/e6d3af8a2b6624d8adf8fc289717c121400164223b3e51d49b639aa34d1d3048.c9a58c9120361b7b034a0136cc74d5dce009e745c4cc111c255d5f3d0a9e2fd9
108
+ creating metadata file for /home/sanchitgandhi/.cache/huggingface/transformers/e6d3af8a2b6624d8adf8fc289717c121400164223b3e51d49b639aa34d1d3048.c9a58c9120361b7b034a0136cc74d5dce009e745c4cc111c255d5f3d0a9e2fd9
109
+ loading configuration file https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-scan/resolve/main/config.json from cache at /home/sanchitgandhi/.cache/huggingface/transformers/e6d3af8a2b6624d8adf8fc289717c121400164223b3e51d49b639aa34d1d3048.c9a58c9120361b7b034a0136cc74d5dce009e745c4cc111c255d5f3d0a9e2fd9
110
+ /home/sanchitgandhi/transformers/src/transformers/configuration_utils.py:358: UserWarning: Passing `gradient_checkpointing` to a config initialization is deprecated and will be removed in v5 Transformers. Using `model.gradient_checkpointing_enable()` instead, or if you are using the `Trainer` API, pass `gradient_checkpointing=True` in your `TrainingArguments`.
111
+ warnings.warn(
112
+ Model config SpeechEncoderDecoderConfig {
113
+ "_name_or_path": "sanchit-gandhi/flax-wav2vec2-2-bart-large-scan",
114
+ "architectures": [
115
+ "SpeechEncoderDecoderModel"
116
+ ],
117
+ "decoder": {
118
+ "_name_or_path": "",
119
+ "activation_dropout": 0.1,
120
+ "activation_function": "gelu",
121
+ "add_bias_logits": false,
122
+ "add_cross_attention": true,
123
+ "add_final_layer_norm": false,
124
+ "architectures": [
125
+ "BartModel"
126
+ ],
127
+ "attention_dropout": 0.1,
128
+ "bad_words_ids": null,
129
+ "bos_token_id": 0,
130
+ "chunk_size_feed_forward": 0,
131
+ "classif_dropout": 0.1,
132
+ "classifier_dropout": 0.0,
133
+ "cross_attention_hidden_size": null,
134
+ "d_model": 1024,
135
+ "decoder_attention_heads": 16,
136
+ "decoder_ffn_dim": 4096,
137
+ "decoder_layerdrop": 0.0,
138
+ "decoder_layers": 12,
139
+ "decoder_start_token_id": 2,
140
+ "diversity_penalty": 0.0,
141
+ "do_sample": false,
142
+ "dropout": 0.1,
143
+ "early_stopping": true,
144
+ "encoder_attention_heads": 16,
145
+ "encoder_ffn_dim": 4096,
146
+ "encoder_layerdrop": 0.0,
147
+ "encoder_layers": 12,
148
+ "encoder_no_repeat_ngram_size": 0,
149
+ "eos_token_id": 2,
150
+ "exponential_decay_length_penalty": null,
151
+ "finetuning_task": null,
152
+ "forced_bos_token_id": 0,
153
+ "forced_eos_token_id": 2,
154
+ "fuse_matmuls": false,
155
+ "gradient_checkpointing": true,
156
+ "id2label": {
157
+ "0": "LABEL_0",
158
+ "1": "LABEL_1",
159
+ "2": "LABEL_2"
160
+ },
161
+ "init_std": 0.02,
162
+ "is_decoder": true,
163
+ "is_encoder_decoder": false,
164
+ "label2id": {
165
+ "LABEL_0": 0,
166
+ "LABEL_1": 1,
167
+ "LABEL_2": 2
168
+ },
169
+ "length_penalty": 1.0,
170
+ "max_length": 20,
171
+ "max_position_embeddings": 1024,
172
+ "min_length": 0,
173
+ "model_type": "bart",
174
+ "no_repeat_ngram_size": 3,
175
+ "normalize_before": false,
176
+ "num_beam_groups": 1,
177
+ "num_beams": 4,
178
+ "num_hidden_layers": 12,
179
+ "num_return_sequences": 1,
180
+ "output_attentions": false,
181
+ "output_hidden_states": false,
182
+ "output_scores": false,
183
+ "pad_token_id": 1,
184
+ "prefix": null,
185
+ "problem_type": null,
186
+ "pruned_heads": {},
187
+ "remove_invalid_values": false,
188
+ "repetition_penalty": 1.0,
189
+ "return_dict": true,
190
+ "return_dict_in_generate": false,
191
+ "scale_embedding": false,
192
+ "sep_token_id": null,
193
+ "task_specific_params": {
194
+ "summarization": {
195
+ "length_penalty": 1.0,
196
+ "max_length": 128,
197
+ "min_length": 12,
198
+ "num_beams": 4
199
+ },
200
+ "summarization_cnn": {
201
+ "length_penalty": 2.0,
202
+ "max_length": 142,
203
+ "min_length": 56,
204
+ "num_beams": 4
205
+ },
206
+ "summarization_xsum": {
207
+ "length_penalty": 1.0,
208
+ "max_length": 62,
209
+ "min_length": 11,
210
+ "num_beams": 6
211
+ }
212
+ },
213
+ "temperature": 1.0,
214
+ "tie_encoder_decoder": false,
215
+ "tie_word_embeddings": true,
216
+ "tokenizer_class": null,
217
+ "top_k": 50,
218
+ "top_p": 1.0,
219
+ "torch_dtype": "float32",
220
+ "torchscript": false,
221
+ "transformers_version": "4.18.0.dev0",
222
+ "typical_p": 1.0,
223
+ "use_bfloat16": false,
224
+ "use_cache": true,
225
+ "use_scan": true,
226
+ "vocab_size": 50265
227
+ },
228
+ "decoder_start_token_id": 0,
229
+ "encoder": {
230
+ "_name_or_path": "",
231
+ "activation_dropout": 0.1,
232
+ "adapter_kernel_size": 3,
233
+ "adapter_stride": 2,
234
+ "add_adapter": true,
235
+ "add_cross_attention": false,
236
+ "apply_spec_augment": true,
237
+ "architectures": [
238
+ "Wav2Vec2ForPreTraining"
239
+ ],
240
+ "attention_dropout": 0.1,
241
+ "bad_words_ids": null,
242
+ "bos_token_id": 1,
243
+ "chunk_size_feed_forward": 0,
244
+ "classifier_proj_size": 256,
245
+ "codevector_dim": 768,
246
+ "contrastive_logits_temperature": 0.1,
247
+ "conv_bias": true,
248
+ "conv_dim": [
249
+ 512,
250
+ 512,
251
+ 512,
252
+ 512,
253
+ 512,
254
+ 512,
255
+ 512
256
+ ],
257
+ "conv_kernel": [
258
+ 10,
259
+ 3,
260
+ 3,
261
+ 3,
262
+ 3,
263
+ 2,
264
+ 2
265
+ ],
266
+ "conv_stride": [
267
+ 5,
268
+ 2,
269
+ 2,
270
+ 2,
271
+ 2,
272
+ 2,
273
+ 2
274
+ ],
275
+ "cross_attention_hidden_size": null,
276
+ "ctc_loss_reduction": "sum",
277
+ "ctc_zero_infinity": false,
278
+ "decoder_start_token_id": null,
279
+ "diversity_loss_weight": 0.1,
280
+ "diversity_penalty": 0.0,
281
+ "do_sample": false,
282
+ "do_stable_layer_norm": true,
283
+ "early_stopping": false,
284
+ "encoder_no_repeat_ngram_size": 0,
285
+ "eos_token_id": 2,
286
+ "exponential_decay_length_penalty": null,
287
+ "feat_extract_activation": "gelu",
288
+ "feat_extract_dropout": 0.0,
289
+ "feat_extract_norm": "layer",
290
+ "feat_proj_dropout": 0.0,
291
+ "feat_quantizer_dropout": 0.0,
292
+ "final_dropout": 0.0,
293
+ "finetuning_task": null,
294
+ "forced_bos_token_id": null,
295
+ "forced_eos_token_id": null,
296
+ "fuse_matmuls": false,
297
+ "gradient_checkpointing": true,
298
+ "hidden_act": "gelu",
299
+ "hidden_dropout": 0.1,
300
+ "hidden_dropout_prob": 0.1,
301
+ "hidden_size": 1024,
302
+ "id2label": {
303
+ "0": "LABEL_0",
304
+ "1": "LABEL_1"
305
+ },
306
+ "initializer_range": 0.02,
307
+ "intermediate_size": 4096,
308
+ "is_decoder": false,
309
+ "is_encoder_decoder": false,
310
+ "label2id": {
311
+ "LABEL_0": 0,
312
+ "LABEL_1": 1
313
+ },
314
+ "layer_norm_eps": 1e-05,
315
+ "layerdrop": 0.0,
316
+ "length_penalty": 1.0,
317
+ "mask_feature_length": 10,
318
+ "mask_feature_min_masks": 0,
319
+ "mask_feature_prob": 0.0,
320
+ "mask_time_length": 10,
321
+ "mask_time_min_masks": 2,
322
+ "mask_time_prob": 0.1,
323
+ "max_length": 20,
324
+ "min_length": 0,
325
+ "model_type": "wav2vec2",
326
+ "no_repeat_ngram_size": 0,
327
+ "num_adapter_layers": 3,
328
+ "num_attention_heads": 16,
329
+ "num_beam_groups": 1,
330
+ "num_beams": 1,
331
+ "num_codevector_groups": 2,
332
+ "num_codevectors_per_group": 320,
333
+ "num_conv_pos_embedding_groups": 16,
334
+ "num_conv_pos_embeddings": 128,
335
+ "num_feat_extract_layers": 7,
336
+ "num_hidden_layers": 24,
337
+ "num_negatives": 100,
338
+ "num_return_sequences": 1,
339
+ "output_attentions": false,
340
+ "output_hidden_size": 1024,
341
+ "output_hidden_states": false,
342
+ "output_scores": false,
343
+ "pad_token_id": 0,
344
+ "prefix": null,
345
+ "problem_type": null,
346
+ "proj_codevector_dim": 768,
347
+ "pruned_heads": {},
348
+ "remove_invalid_values": false,
349
+ "repetition_penalty": 1.0,
350
+ "return_dict": true,
351
+ "return_dict_in_generate": false,
352
+ "sep_token_id": null,
353
+ "task_specific_params": null,
354
+ "tdnn_dilation": [
355
+ 1,
356
+ 2,
357
+ 3,
358
+ 1,
359
+ 1
360
+ ],
361
+ "tdnn_dim": [
362
+ 512,
363
+ 512,
364
+ 512,
365
+ 512,
366
+ 1500
367
+ ],
368
+ "tdnn_kernel": [
369
+ 5,
370
+ 3,
371
+ 3,
372
+ 1,
373
+ 1
374
+ ],
375
+ "temperature": 1.0,
376
+ "tie_encoder_decoder": false,
377
+ "tie_word_embeddings": true,
378
+ "tokenizer_class": null,
379
+ "top_k": 50,
380
+ "top_p": 1.0,
381
+ "torch_dtype": null,
382
+ "torchscript": false,
383
+ "transformers_version": "4.18.0.dev0",
384
+ "typical_p": 1.0,
385
+ "use_bfloat16": false,
386
+ "use_scan": true,
387
+ "use_weighted_layer_sum": false,
388
+ "vocab_size": 32,
389
+ "xvector_output_dim": 512
390
+ },
391
+ "eos_token_id": 2,
392
+ "is_encoder_decoder": true,
393
+ "max_length": 40,
394
+ "model_type": "speech-encoder-decoder",
395
+ "pad_token_id": 1,
396
+ "processor_class": "Wav2Vec2Processor",
397
+ "tie_word_embeddings": false,
398
+ "transformers_version": null,
399
+ "use_cache": false
400
+ }
401
+ loading feature extractor configuration file https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-scan/resolve/main/preprocessor_config.json from cache at /home/sanchitgandhi/.cache/huggingface/transformers/bc2232c616201c7d3d66ba3f6a7d1186306134838dfb19786149f0e16122787d.bbc1eb890a39c82e710a893223b8452ac5b78e8b57083b2f893aa7dc59d4ed69
402
+ Feature extractor Wav2Vec2FeatureExtractor {
403
+ "do_normalize": true,
404
+ "feature_extractor_type": "Wav2Vec2FeatureExtractor",
405
+ "feature_size": 1,
406
+ "padding_side": "right",
407
+ "padding_value": 0.0,
408
+ "return_attention_mask": true,
409
+ "sampling_rate": 16000
410
+ }
411
+ loading file https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-scan/resolve/main/vocab.json from cache at /home/sanchitgandhi/.cache/huggingface/transformers/86c0de13925d1534934e540ff4c9dd778f49761b4eaf59dae3335a4f6690a814.bfdcc444ff249bca1a95ca170ec350b442f81804d7df3a95a2252217574121d7
412
+ loading file https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-scan/resolve/main/merges.txt from cache at /home/sanchitgandhi/.cache/huggingface/transformers/7cf4fc91891684e1177d1c519689e4c310ebdec965e00d6e45134bb9227ab01b.f5b91da9e34259b8f4d88dbc97c740667a0e8430b96314460cdb04e86d4fc435
413
+ loading file https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-scan/resolve/main/tokenizer.json from cache at /home/sanchitgandhi/.cache/huggingface/transformers/c02f3f3009bfacaa24cfead1d0f7fbf4fc2fb5f8092f68703449f02aa3a28e03.393fa6a095aa312a3cce4d5263e471bd94ec0215e6c63448a6464d59ff900814
414
+ loading file https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-scan/resolve/main/added_tokens.json from cache at None
415
+ loading file https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-scan/resolve/main/special_tokens_map.json from cache at /home/sanchitgandhi/.cache/huggingface/transformers/505d61b8f6e05764b5aec1483bfdd13a310681a5af54957263604323be3bbabf.a11ebb04664c067c8fe5ef8f8068b0f721263414a26058692f7b2e4ba2a1b342
416
+ loading file https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-scan/resolve/main/tokenizer_config.json from cache at /home/sanchitgandhi/.cache/huggingface/transformers/ff79c23164eac352d7f9651f3c3774a962ce80f81460d9e17d689235fa34ee80.0e8b2b497f91e23302894a5c1f19ced6334b0abd450a7bce75a67bf0f9ee5c54
417
+ loading weights file https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-scan/resolve/main/flax_model.msgpack from cache at /home/sanchitgandhi/.cache/huggingface/transformers/1279dc21f7dd9ed546f166e7e445e068b2672ddfa5386b2e3a3a973b8d668365.8e03496bb6919447aeb468483249e7b65dfb59c42989be9787af0aa6aa9b3f50
418
+ tcmalloc: large alloc 2353618944 bytes == 0xa38a8000 @ 0x7f47ee716680 0x7f47ee737824 0x5f8a01 0x648cf1 0x5c4676 0x4f290e 0x64f718 0x5048b3 0x56b1da 0x56939a 0x50aaa0 0x56c28c 0x56939a 0x5f6a13 0x56b0ae 0x56939a 0x68d047 0x67e351 0x67e3cf 0x67e471 0x67e817 0x6b6fe2 0x6b736d 0x7f47ee5290b3 0x5fa5ce
419
+ /home/sanchitgandhi/hf/lib/python3.8/site-packages/jax/_src/tree_util.py:188: FutureWarning: jax.tree_util.tree_multimap() is deprecated. Please use jax.tree_util.tree_map() instead as a drop-in replacement.
420
+ warnings.warn('jax.tree_util.tree_multimap() is deprecated. Please use jax.tree_util.tree_map() '
421
+ All model checkpoint weights were used when initializing FlaxSpeechEncoderDecoderModel.
422
+ All the weights of FlaxSpeechEncoderDecoderModel were initialized from the model checkpoint at sanchit-gandhi/flax-wav2vec2-2-bart-large-scan.
423
+ If your task is similar to the task the model of the checkpoint was trained on, you can already use FlaxSpeechEncoderDecoderModel for predictions without further training.
424
+ 100% 282/282 [00:00<00:00, 413.62ba/s]
425
+ 100% 3/3 [00:00<00:00, 461.84ba/s]
426
+ 100% 3/3 [00:00<00:00, 450.77ba/s]
427
+ 100% 3/3 [00:00<00:00, 427.10ba/s]
428
+ 100% 3/3 [00:00<00:00, 489.47ba/s]
429
+
430
+
431
+
432
+
433
+
434
+
435
+
436
+
437
+
438
+
439
+
440
+
441
+
442
+
443
+
444
+
445
+
446
+
447
+
448
+
449
+
450
+
451
+
452
+
453
+
454
+
455
+
456
+
457
+
458
+
459
+
460
+
461
+
462
+
463
+
464
+
465
+
466
+
467
+
468
+
469
+
470
+
471
+
472
+
473
+
474
+
475
+
476
+
477
+
478
+
479
+
480
+
481
+
482
+
483
+
484
+
485
+
486
+
487
+
488
+
489
+
490
+
491
+
492
+
493
+
494
+
495
+
496
+
497
+
498
+
499
+
500
+
501
+
502
+
503
+
504
+
505
+
506
+
507
+
508
+
509
+
510
+
511
+
512
+
513
+
514
+
515
+
516
+
517
+
518
+
519
+
520
+
521
+
522
+
523
+
524
+
525
+
526
+
527
+
528
+
529
+
530
+
531
+
532
+
533
+
534
+
535
+
536
+
537
+
538
+
539
+
540
+
541
+
542
+
543
+
544
+
545
+
546
+
547
+
548
+
549
+
550
+
551
+
552
+
553
+
554
+
555
+
556
+
557
+
558
+
559
+
560
+ preprocess train dataset: 11% 31999/281241 [07:44<1:00:15, 68.94ex/s]
wandb/run-20220530_120145-2k01y1ky/files/requirements.txt ADDED
@@ -0,0 +1,159 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ absl-py==1.0.0
2
+ aiohttp==3.8.1
3
+ aiosignal==1.2.0
4
+ anyio==3.5.0
5
+ appdirs==1.4.4
6
+ argon2-cffi-bindings==21.2.0
7
+ argon2-cffi==21.3.0
8
+ asttokens==2.0.5
9
+ async-timeout==4.0.2
10
+ attrs==21.4.0
11
+ audioread==2.1.9
12
+ babel==2.10.1
13
+ backcall==0.2.0
14
+ beautifulsoup4==4.11.1
15
+ bleach==5.0.0
16
+ certifi==2021.10.8
17
+ cffi==1.15.0
18
+ charset-normalizer==2.0.12
19
+ chex==0.1.3
20
+ click==8.1.2
21
+ cycler==0.11.0
22
+ datasets==2.1.1.dev0
23
+ debugpy==1.6.0
24
+ decorator==5.1.1
25
+ defusedxml==0.7.1
26
+ dill==0.3.4
27
+ dm-tree==0.1.7
28
+ docker-pycreds==0.4.0
29
+ entrypoints==0.4
30
+ executing==0.8.3
31
+ fastjsonschema==2.15.3
32
+ filelock==3.6.0
33
+ flatbuffers==2.0
34
+ flax==0.4.1
35
+ fonttools==4.33.3
36
+ frozenlist==1.3.0
37
+ fsspec==2022.3.0
38
+ gitdb==4.0.9
39
+ gitpython==3.1.27
40
+ huggingface-hub==0.5.1
41
+ hypothesis==6.46.7
42
+ idna==3.3
43
+ ijson==3.1.4
44
+ importlib-metadata==4.11.3
45
+ importlib-resources==5.7.1
46
+ ipdb==0.13.9
47
+ ipykernel==6.13.0
48
+ ipython-genutils==0.2.0
49
+ ipython==8.2.0
50
+ jax==0.3.7
51
+ jaxlib==0.3.7
52
+ jedi==0.18.1
53
+ jinja2==3.1.2
54
+ jiwer==2.3.0
55
+ joblib==1.1.0
56
+ json5==0.9.8
57
+ jsonschema==4.5.1
58
+ jupyter-client==7.3.1
59
+ jupyter-core==4.10.0
60
+ jupyter-server==1.17.0
61
+ jupyterlab-pygments==0.2.2
62
+ jupyterlab-server==2.13.0
63
+ jupyterlab==3.4.1
64
+ kenlm==0.0.0
65
+ kiwisolver==1.4.2
66
+ librosa==0.9.1
67
+ libtpu-nightly==0.1.dev20220415
68
+ llvmlite==0.38.0
69
+ markupsafe==2.1.1
70
+ matplotlib-inline==0.1.3
71
+ matplotlib==3.5.1
72
+ mistune==0.8.4
73
+ msgpack==1.0.3
74
+ multidict==6.0.2
75
+ multiprocess==0.70.12.2
76
+ nbclassic==0.3.7
77
+ nbclient==0.6.3
78
+ nbconvert==6.5.0
79
+ nbformat==5.4.0
80
+ nest-asyncio==1.5.5
81
+ notebook-shim==0.1.0
82
+ notebook==6.4.11
83
+ numba==0.55.1
84
+ numpy==1.21.0
85
+ opt-einsum==3.3.0
86
+ optax==0.1.2
87
+ packaging==21.3
88
+ pandas==1.4.2
89
+ pandocfilters==1.5.0
90
+ parso==0.8.3
91
+ pathtools==0.1.2
92
+ pexpect==4.8.0
93
+ pickleshare==0.7.5
94
+ pillow==9.1.0
95
+ pip==20.0.2
96
+ pkg-resources==0.0.0
97
+ pooch==1.6.0
98
+ prometheus-client==0.14.1
99
+ promise==2.3
100
+ prompt-toolkit==3.0.29
101
+ protobuf==3.20.1
102
+ psutil==5.9.0
103
+ ptyprocess==0.7.0
104
+ pure-eval==0.2.2
105
+ pyarrow==7.0.0
106
+ pycparser==2.21
107
+ pycryptodome==3.14.1
108
+ pyctcdecode==0.3.0
109
+ pygments==2.12.0
110
+ pygtrie==2.4.2
111
+ pyparsing==3.0.8
112
+ pyrsistent==0.18.1
113
+ python-dateutil==2.8.2
114
+ python-levenshtein==0.12.2
115
+ pytz==2022.1
116
+ pyyaml==6.0
117
+ pyzmq==22.3.0
118
+ regex==2022.4.24
119
+ requests==2.27.1
120
+ resampy==0.2.2
121
+ responses==0.18.0
122
+ sacremoses==0.0.49
123
+ scikit-learn==1.0.2
124
+ scipy==1.8.0
125
+ send2trash==1.8.0
126
+ sentry-sdk==1.5.10
127
+ setproctitle==1.2.3
128
+ setuptools==44.0.0
129
+ shortuuid==1.0.8
130
+ six==1.16.0
131
+ smmap==5.0.0
132
+ sniffio==1.2.0
133
+ sortedcontainers==2.4.0
134
+ soundfile==0.10.3.post1
135
+ soupsieve==2.3.2.post1
136
+ speechcolab==0.0.6a0
137
+ stack-data==0.2.0
138
+ terminado==0.13.3
139
+ threadpoolctl==3.1.0
140
+ tinycss2==1.1.1
141
+ tokenizers==0.12.1
142
+ toml==0.10.2
143
+ toolz==0.11.2
144
+ torch==1.11.0+cpu
145
+ torchaudio==0.11.0+cpu
146
+ tornado==6.1
147
+ tqdm==4.64.0
148
+ traitlets==5.1.1
149
+ transformers==4.18.0.dev0
150
+ typing-extensions==4.2.0
151
+ urllib3==1.26.9
152
+ wandb==0.12.15
153
+ wcwidth==0.2.5
154
+ webencodings==0.5.1
155
+ websocket-client==1.3.2
156
+ wheel==0.37.1
157
+ xxhash==3.0.0
158
+ yarl==1.7.2
159
+ zipp==3.8.0
wandb/run-20220530_120145-2k01y1ky/files/wandb-metadata.json ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "os": "Linux-5.11.0-1028-gcp-x86_64-with-glibc2.29",
3
+ "python": "3.8.10",
4
+ "heartbeatAt": "2022-05-30T12:01:46.976287",
5
+ "startedAt": "2022-05-30T12:01:45.819658",
6
+ "docker": null,
7
+ "cpu_count": 96,
8
+ "cuda": null,
9
+ "args": [
10
+ "--dataset_name=librispeech_asr",
11
+ "--model_name_or_path=sanchit-gandhi/flax-wav2vec2-2-bart-large-scan",
12
+ "--dataset_config_name=all",
13
+ "--train_split_name=train.clean.100+train.clean.360+train.other.500",
14
+ "--eval_split_name=validation.clean",
15
+ "--test_split_name=validation.other+test.clean+test.other",
16
+ "--dataset_cache_dir=/home/sanchitgandhi/cache/huggingface/datasets",
17
+ "--output_dir=./",
18
+ "--preprocessing_num_workers=1",
19
+ "--length_column_name=input_length",
20
+ "--overwrite_output_dir",
21
+ "--per_device_train_batch_size=8",
22
+ "--per_device_eval_batch_size=4",
23
+ "--logging_steps=25",
24
+ "--max_steps=50000",
25
+ "--eval_steps=10000",
26
+ "--save_steps=10000",
27
+ "--gradient_checkpointing",
28
+ "--max_duration_in_seconds=20",
29
+ "--max_target_length=128",
30
+ "--generation_max_length=40",
31
+ "--generation_num_beams=1",
32
+ "--generation_length_penalty=1.2",
33
+ "--final_generation_max_length=200",
34
+ "--final_generation_num_beams=5",
35
+ "--learning_rate=1e-4",
36
+ "--warmup_steps=500",
37
+ "--text_column_name=text",
38
+ "--save_total_limit=1",
39
+ "--freeze_feature_encoder=False",
40
+ "--predict_with_generate",
41
+ "--do_lower_case",
42
+ "--do_eval",
43
+ "--do_train",
44
+ "--do_predict",
45
+ "--push_to_hub",
46
+ "--use_auth_token",
47
+ "--wandb_project=librispeech_960h",
48
+ "--wandb_name=flax-wav2vec2-2-bart-large-ls-960h-feature-encoder"
49
+ ],
50
+ "state": "running",
51
+ "program": "run_flax_speech_recognition_seq2seq.py",
52
+ "codePath": "run_flax_speech_recognition_seq2seq.py",
53
+ "git": {
54
+ "remote": "https://huggingface.co/sanchit-gandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder",
55
+ "commit": "70a51c6ed0f374cbfa7ba53612d66d25dbc2e89d"
56
+ },
57
+ "email": "sanchit@huggingface.co",
58
+ "root": "/home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder",
59
+ "host": "t1v-n-7e6d8bf0-w-0",
60
+ "username": "sanchitgandhi",
61
+ "executable": "/home/sanchitgandhi/hf/bin/python"
62
+ }
wandb/run-20220530_120145-2k01y1ky/files/wandb-summary.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"_wandb": {"runtime": 524}}
wandb/run-20220530_120145-2k01y1ky/logs/debug-internal.log ADDED
@@ -0,0 +1,369 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-05-30 12:01:46,716 INFO MainThread:2797740 [internal.py:wandb_internal():90] W&B internal server running at pid: 2797740, started at: 2022-05-30 12:01:46.715881
2
+ 2022-05-30 12:01:46,718 INFO WriterThread:2797740 [datastore.py:open_for_write():75] open: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/run-2k01y1ky.wandb
3
+ 2022-05-30 12:01:46,719 DEBUG SenderThread:2797740 [sender.py:send():232] send: header
4
+ 2022-05-30 12:01:46,719 DEBUG SenderThread:2797740 [sender.py:send():232] send: run
5
+ 2022-05-30 12:01:46,893 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: check_version
6
+ 2022-05-30 12:01:46,901 INFO SenderThread:2797740 [dir_watcher.py:__init__():166] watching files in: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files
7
+ 2022-05-30 12:01:46,901 INFO SenderThread:2797740 [sender.py:_start_run_threads():811] run started: 2k01y1ky with start time 1653912105
8
+ 2022-05-30 12:01:46,901 DEBUG SenderThread:2797740 [sender.py:send():232] send: summary
9
+ 2022-05-30 12:01:46,901 INFO SenderThread:2797740 [sender.py:_save_file():946] saving file wandb-summary.json with policy end
10
+ 2022-05-30 12:01:46,901 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: check_version
11
+ 2022-05-30 12:01:46,975 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: run_start
12
+ 2022-05-30 12:01:46,976 DEBUG HandlerThread:2797740 [meta.py:__init__():35] meta init
13
+ 2022-05-30 12:01:46,976 DEBUG HandlerThread:2797740 [meta.py:__init__():49] meta init done
14
+ 2022-05-30 12:01:46,976 DEBUG HandlerThread:2797740 [meta.py:probe():209] probe
15
+ 2022-05-30 12:01:46,977 DEBUG HandlerThread:2797740 [meta.py:_setup_git():199] setup git
16
+ 2022-05-30 12:01:46,998 DEBUG HandlerThread:2797740 [meta.py:_setup_git():206] setup git done
17
+ 2022-05-30 12:01:46,998 DEBUG HandlerThread:2797740 [meta.py:_save_pip():53] save pip
18
+ 2022-05-30 12:01:46,998 DEBUG HandlerThread:2797740 [meta.py:_save_pip():67] save pip done
19
+ 2022-05-30 12:01:46,999 DEBUG HandlerThread:2797740 [meta.py:probe():247] probe done
20
+ 2022-05-30 12:01:47,002 DEBUG SenderThread:2797740 [sender.py:send():232] send: files
21
+ 2022-05-30 12:01:47,002 INFO SenderThread:2797740 [sender.py:_save_file():946] saving file wandb-metadata.json with policy now
22
+ 2022-05-30 12:01:47,007 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
23
+ 2022-05-30 12:01:47,007 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
24
+ 2022-05-30 12:01:47,136 DEBUG SenderThread:2797740 [sender.py:send():232] send: telemetry
25
+ 2022-05-30 12:01:47,465 INFO Thread-11 :2797740 [upload_job.py:push():137] Uploaded file /tmp/tmppk91otfuwandb/1ktg7quk-wandb-metadata.json
26
+ 2022-05-30 12:01:47,902 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_created():213] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/wandb-metadata.json
27
+ 2022-05-30 12:01:47,902 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_created():213] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
28
+ 2022-05-30 12:01:47,902 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_created():213] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/requirements.txt
29
+ 2022-05-30 12:01:47,903 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_created():213] file/dir created: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/wandb-summary.json
30
+ 2022-05-30 12:01:49,902 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
31
+ 2022-05-30 12:01:51,902 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
32
+ 2022-05-30 12:01:53,903 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
33
+ 2022-05-30 12:01:57,904 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
34
+ 2022-05-30 12:02:02,138 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
35
+ 2022-05-30 12:02:02,138 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
36
+ 2022-05-30 12:02:15,042 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
37
+ 2022-05-30 12:02:17,266 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
38
+ 2022-05-30 12:02:17,266 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
39
+ 2022-05-30 12:02:17,911 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/config.yaml
40
+ 2022-05-30 12:02:19,912 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
41
+ 2022-05-30 12:02:32,402 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
42
+ 2022-05-30 12:02:32,402 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
43
+ 2022-05-30 12:02:41,919 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
44
+ 2022-05-30 12:02:43,919 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
45
+ 2022-05-30 12:02:45,111 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
46
+ 2022-05-30 12:02:45,920 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
47
+ 2022-05-30 12:02:47,535 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
48
+ 2022-05-30 12:02:47,536 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
49
+ 2022-05-30 12:02:47,920 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
50
+ 2022-05-30 12:02:49,921 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
51
+ 2022-05-30 12:02:51,921 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
52
+ 2022-05-30 12:02:55,923 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
53
+ 2022-05-30 12:02:57,923 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
54
+ 2022-05-30 12:02:59,924 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
55
+ 2022-05-30 12:03:01,924 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
56
+ 2022-05-30 12:03:02,668 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
57
+ 2022-05-30 12:03:02,668 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
58
+ 2022-05-30 12:03:03,925 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
59
+ 2022-05-30 12:03:05,926 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
60
+ 2022-05-30 12:03:07,926 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
61
+ 2022-05-30 12:03:09,927 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
62
+ 2022-05-30 12:03:11,928 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
63
+ 2022-05-30 12:03:13,928 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
64
+ 2022-05-30 12:03:15,200 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
65
+ 2022-05-30 12:03:15,929 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
66
+ 2022-05-30 12:03:17,800 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
67
+ 2022-05-30 12:03:17,800 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
68
+ 2022-05-30 12:03:17,930 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
69
+ 2022-05-30 12:03:19,931 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
70
+ 2022-05-30 12:03:21,932 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
71
+ 2022-05-30 12:03:23,932 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
72
+ 2022-05-30 12:03:25,933 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
73
+ 2022-05-30 12:03:27,934 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
74
+ 2022-05-30 12:03:31,935 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
75
+ 2022-05-30 12:03:32,932 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
76
+ 2022-05-30 12:03:32,932 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
77
+ 2022-05-30 12:03:33,935 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
78
+ 2022-05-30 12:03:35,936 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
79
+ 2022-05-30 12:03:37,937 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
80
+ 2022-05-30 12:03:39,937 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
81
+ 2022-05-30 12:03:41,938 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
82
+ 2022-05-30 12:03:43,938 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
83
+ 2022-05-30 12:03:45,263 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
84
+ 2022-05-30 12:03:45,939 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
85
+ 2022-05-30 12:03:47,940 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
86
+ 2022-05-30 12:03:48,062 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
87
+ 2022-05-30 12:03:48,063 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
88
+ 2022-05-30 12:03:49,941 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
89
+ 2022-05-30 12:03:51,942 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
90
+ 2022-05-30 12:03:53,942 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
91
+ 2022-05-30 12:03:57,944 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
92
+ 2022-05-30 12:03:59,944 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
93
+ 2022-05-30 12:04:01,945 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
94
+ 2022-05-30 12:04:03,190 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
95
+ 2022-05-30 12:04:03,191 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
96
+ 2022-05-30 12:04:03,946 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
97
+ 2022-05-30 12:04:05,947 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
98
+ 2022-05-30 12:04:07,947 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
99
+ 2022-05-30 12:04:09,948 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
100
+ 2022-05-30 12:04:11,948 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
101
+ 2022-05-30 12:04:15,327 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
102
+ 2022-05-30 12:04:15,950 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
103
+ 2022-05-30 12:04:17,951 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
104
+ 2022-05-30 12:04:18,320 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
105
+ 2022-05-30 12:04:18,320 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
106
+ 2022-05-30 12:04:19,951 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
107
+ 2022-05-30 12:04:23,953 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
108
+ 2022-05-30 12:04:25,953 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
109
+ 2022-05-30 12:04:27,954 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
110
+ 2022-05-30 12:04:29,955 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
111
+ 2022-05-30 12:04:31,956 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
112
+ 2022-05-30 12:04:33,449 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
113
+ 2022-05-30 12:04:33,449 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
114
+ 2022-05-30 12:04:33,956 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
115
+ 2022-05-30 12:04:35,957 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
116
+ 2022-05-30 12:04:37,958 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
117
+ 2022-05-30 12:04:39,959 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
118
+ 2022-05-30 12:04:41,960 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
119
+ 2022-05-30 12:04:43,960 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
120
+ 2022-05-30 12:04:45,390 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
121
+ 2022-05-30 12:04:45,961 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
122
+ 2022-05-30 12:04:48,580 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
123
+ 2022-05-30 12:04:48,580 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
124
+ 2022-05-30 12:04:49,963 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
125
+ 2022-05-30 12:04:51,963 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
126
+ 2022-05-30 12:04:53,964 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
127
+ 2022-05-30 12:04:55,965 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
128
+ 2022-05-30 12:04:57,966 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
129
+ 2022-05-30 12:04:59,967 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
130
+ 2022-05-30 12:05:01,967 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
131
+ 2022-05-30 12:05:03,713 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
132
+ 2022-05-30 12:05:03,713 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
133
+ 2022-05-30 12:05:03,968 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
134
+ 2022-05-30 12:05:05,969 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
135
+ 2022-05-30 12:05:07,970 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
136
+ 2022-05-30 12:05:09,970 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
137
+ 2022-05-30 12:05:11,971 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
138
+ 2022-05-30 12:05:15,459 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
139
+ 2022-05-30 12:05:15,973 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
140
+ 2022-05-30 12:05:17,973 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
141
+ 2022-05-30 12:05:18,854 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
142
+ 2022-05-30 12:05:18,854 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
143
+ 2022-05-30 12:05:19,974 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
144
+ 2022-05-30 12:05:21,975 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
145
+ 2022-05-30 12:05:23,976 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
146
+ 2022-05-30 12:05:25,977 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
147
+ 2022-05-30 12:05:27,977 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
148
+ 2022-05-30 12:05:29,978 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
149
+ 2022-05-30 12:05:31,979 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
150
+ 2022-05-30 12:05:33,980 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
151
+ 2022-05-30 12:05:33,986 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
152
+ 2022-05-30 12:05:33,986 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
153
+ 2022-05-30 12:05:35,981 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
154
+ 2022-05-30 12:05:37,982 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
155
+ 2022-05-30 12:05:41,983 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
156
+ 2022-05-30 12:05:43,983 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
157
+ 2022-05-30 12:05:45,524 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
158
+ 2022-05-30 12:05:45,984 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
159
+ 2022-05-30 12:05:47,985 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
160
+ 2022-05-30 12:05:49,116 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
161
+ 2022-05-30 12:05:49,116 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
162
+ 2022-05-30 12:05:49,985 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
163
+ 2022-05-30 12:05:51,986 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
164
+ 2022-05-30 12:05:53,987 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
165
+ 2022-05-30 12:05:55,987 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
166
+ 2022-05-30 12:05:57,988 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
167
+ 2022-05-30 12:05:59,989 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
168
+ 2022-05-30 12:06:01,989 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
169
+ 2022-05-30 12:06:03,990 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
170
+ 2022-05-30 12:06:04,252 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
171
+ 2022-05-30 12:06:04,253 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
172
+ 2022-05-30 12:06:05,991 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
173
+ 2022-05-30 12:06:07,991 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
174
+ 2022-05-30 12:06:09,992 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
175
+ 2022-05-30 12:06:11,992 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
176
+ 2022-05-30 12:06:13,993 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
177
+ 2022-05-30 12:06:15,593 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
178
+ 2022-05-30 12:06:15,994 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
179
+ 2022-05-30 12:06:17,994 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
180
+ 2022-05-30 12:06:19,385 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
181
+ 2022-05-30 12:06:19,385 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
182
+ 2022-05-30 12:06:19,995 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
183
+ 2022-05-30 12:06:21,996 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
184
+ 2022-05-30 12:06:23,997 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
185
+ 2022-05-30 12:06:25,997 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
186
+ 2022-05-30 12:06:27,998 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
187
+ 2022-05-30 12:06:29,999 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
188
+ 2022-05-30 12:06:34,000 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
189
+ 2022-05-30 12:06:34,520 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
190
+ 2022-05-30 12:06:34,520 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
191
+ 2022-05-30 12:06:36,001 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
192
+ 2022-05-30 12:06:38,002 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
193
+ 2022-05-30 12:06:40,002 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
194
+ 2022-05-30 12:06:42,003 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
195
+ 2022-05-30 12:06:44,004 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
196
+ 2022-05-30 12:06:45,664 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
197
+ 2022-05-30 12:06:46,004 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
198
+ 2022-05-30 12:06:48,005 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
199
+ 2022-05-30 12:06:49,649 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
200
+ 2022-05-30 12:06:49,649 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
201
+ 2022-05-30 12:06:50,006 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
202
+ 2022-05-30 12:06:52,007 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
203
+ 2022-05-30 12:06:54,008 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
204
+ 2022-05-30 12:06:56,008 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
205
+ 2022-05-30 12:07:00,010 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
206
+ 2022-05-30 12:07:02,010 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
207
+ 2022-05-30 12:07:04,011 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
208
+ 2022-05-30 12:07:04,779 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
209
+ 2022-05-30 12:07:04,779 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
210
+ 2022-05-30 12:07:06,012 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
211
+ 2022-05-30 12:07:10,014 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
212
+ 2022-05-30 12:07:12,014 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
213
+ 2022-05-30 12:07:14,015 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
214
+ 2022-05-30 12:07:15,733 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
215
+ 2022-05-30 12:07:16,016 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
216
+ 2022-05-30 12:07:19,910 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
217
+ 2022-05-30 12:07:19,910 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
218
+ 2022-05-30 12:07:34,022 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
219
+ 2022-05-30 12:07:35,042 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
220
+ 2022-05-30 12:07:35,043 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
221
+ 2022-05-30 12:07:45,796 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
222
+ 2022-05-30 12:07:50,172 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
223
+ 2022-05-30 12:07:50,172 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
224
+ 2022-05-30 12:08:05,304 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
225
+ 2022-05-30 12:08:05,304 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
226
+ 2022-05-30 12:08:15,856 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
227
+ 2022-05-30 12:08:20,434 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
228
+ 2022-05-30 12:08:20,434 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
229
+ 2022-05-30 12:08:35,565 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
230
+ 2022-05-30 12:08:35,565 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
231
+ 2022-05-30 12:08:45,918 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
232
+ 2022-05-30 12:08:50,694 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
233
+ 2022-05-30 12:08:50,694 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
234
+ 2022-05-30 12:09:05,825 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
235
+ 2022-05-30 12:09:05,825 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
236
+ 2022-05-30 12:09:15,977 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
237
+ 2022-05-30 12:09:20,957 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
238
+ 2022-05-30 12:09:20,957 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
239
+ 2022-05-30 12:09:36,086 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
240
+ 2022-05-30 12:09:36,086 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
241
+ 2022-05-30 12:09:46,030 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
242
+ 2022-05-30 12:09:51,572 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
243
+ 2022-05-30 12:09:51,573 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
244
+ 2022-05-30 12:10:06,706 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
245
+ 2022-05-30 12:10:06,706 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
246
+ 2022-05-30 12:10:16,091 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
247
+ 2022-05-30 12:10:18,067 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
248
+ 2022-05-30 12:10:20,068 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
249
+ 2022-05-30 12:10:21,836 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: stop_status
250
+ 2022-05-30 12:10:21,836 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: stop_status
251
+ 2022-05-30 12:10:22,068 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
252
+ 2022-05-30 12:10:24,069 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
253
+ 2022-05-30 12:10:28,071 INFO Thread-7 :2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
254
+ 2022-05-30 12:10:28,350 DEBUG SenderThread:2797740 [sender.py:send():232] send: telemetry
255
+ 2022-05-30 12:10:31,176 DEBUG SenderThread:2797740 [sender.py:send():232] send: exit
256
+ 2022-05-30 12:10:31,177 INFO SenderThread:2797740 [sender.py:send_exit():368] handling exit code: 1
257
+ 2022-05-30 12:10:31,177 INFO SenderThread:2797740 [sender.py:send_exit():370] handling runtime: 524
258
+ 2022-05-30 12:10:31,177 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
259
+ 2022-05-30 12:10:31,177 INFO SenderThread:2797740 [sender.py:_save_file():946] saving file wandb-summary.json with policy end
260
+ 2022-05-30 12:10:31,177 INFO SenderThread:2797740 [sender.py:send_exit():376] send defer
261
+ 2022-05-30 12:10:31,178 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
262
+ 2022-05-30 12:10:31,178 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: defer
263
+ 2022-05-30 12:10:31,178 INFO HandlerThread:2797740 [handler.py:handle_request_defer():164] handle defer: 0
264
+ 2022-05-30 12:10:31,179 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: defer
265
+ 2022-05-30 12:10:31,179 INFO SenderThread:2797740 [sender.py:send_request_defer():385] handle sender defer: 0
266
+ 2022-05-30 12:10:31,179 INFO SenderThread:2797740 [sender.py:transition_state():389] send defer: 1
267
+ 2022-05-30 12:10:31,179 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: defer
268
+ 2022-05-30 12:10:31,179 INFO HandlerThread:2797740 [handler.py:handle_request_defer():164] handle defer: 1
269
+ 2022-05-30 12:10:31,224 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: defer
270
+ 2022-05-30 12:10:31,224 INFO SenderThread:2797740 [sender.py:send_request_defer():385] handle sender defer: 1
271
+ 2022-05-30 12:10:31,224 INFO SenderThread:2797740 [sender.py:transition_state():389] send defer: 2
272
+ 2022-05-30 12:10:31,224 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: defer
273
+ 2022-05-30 12:10:31,224 DEBUG SenderThread:2797740 [sender.py:send():232] send: stats
274
+ 2022-05-30 12:10:31,225 INFO HandlerThread:2797740 [handler.py:handle_request_defer():164] handle defer: 2
275
+ 2022-05-30 12:10:31,225 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: defer
276
+ 2022-05-30 12:10:31,225 INFO SenderThread:2797740 [sender.py:send_request_defer():385] handle sender defer: 2
277
+ 2022-05-30 12:10:31,225 INFO SenderThread:2797740 [sender.py:transition_state():389] send defer: 3
278
+ 2022-05-30 12:10:31,225 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: defer
279
+ 2022-05-30 12:10:31,225 INFO HandlerThread:2797740 [handler.py:handle_request_defer():164] handle defer: 3
280
+ 2022-05-30 12:10:31,225 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: defer
281
+ 2022-05-30 12:10:31,226 INFO SenderThread:2797740 [sender.py:send_request_defer():385] handle sender defer: 3
282
+ 2022-05-30 12:10:31,226 INFO SenderThread:2797740 [sender.py:transition_state():389] send defer: 4
283
+ 2022-05-30 12:10:31,226 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: defer
284
+ 2022-05-30 12:10:31,226 INFO HandlerThread:2797740 [handler.py:handle_request_defer():164] handle defer: 4
285
+ 2022-05-30 12:10:31,226 DEBUG SenderThread:2797740 [sender.py:send():232] send: summary
286
+ 2022-05-30 12:10:31,226 INFO SenderThread:2797740 [sender.py:_save_file():946] saving file wandb-summary.json with policy end
287
+ 2022-05-30 12:10:31,226 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: defer
288
+ 2022-05-30 12:10:31,226 INFO SenderThread:2797740 [sender.py:send_request_defer():385] handle sender defer: 4
289
+ 2022-05-30 12:10:31,226 INFO SenderThread:2797740 [sender.py:transition_state():389] send defer: 5
290
+ 2022-05-30 12:10:31,227 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: defer
291
+ 2022-05-30 12:10:31,227 INFO HandlerThread:2797740 [handler.py:handle_request_defer():164] handle defer: 5
292
+ 2022-05-30 12:10:31,227 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: defer
293
+ 2022-05-30 12:10:31,227 INFO SenderThread:2797740 [sender.py:send_request_defer():385] handle sender defer: 5
294
+ 2022-05-30 12:10:31,279 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
295
+ 2022-05-30 12:10:31,395 INFO SenderThread:2797740 [sender.py:transition_state():389] send defer: 6
296
+ 2022-05-30 12:10:31,395 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
297
+ 2022-05-30 12:10:31,396 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: defer
298
+ 2022-05-30 12:10:31,396 INFO HandlerThread:2797740 [handler.py:handle_request_defer():164] handle defer: 6
299
+ 2022-05-30 12:10:31,396 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: defer
300
+ 2022-05-30 12:10:31,396 INFO SenderThread:2797740 [sender.py:send_request_defer():385] handle sender defer: 6
301
+ 2022-05-30 12:10:31,396 INFO SenderThread:2797740 [dir_watcher.py:finish():279] shutting down directory watcher
302
+ 2022-05-30 12:10:31,497 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
303
+ 2022-05-30 12:10:32,072 INFO SenderThread:2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/config.yaml
304
+ 2022-05-30 12:10:32,072 INFO SenderThread:2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
305
+ 2022-05-30 12:10:32,072 INFO SenderThread:2797740 [dir_watcher.py:_on_file_modified():226] file/dir modified: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/wandb-summary.json
306
+ 2022-05-30 12:10:32,072 INFO SenderThread:2797740 [dir_watcher.py:finish():309] scan: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files
307
+ 2022-05-30 12:10:32,072 INFO SenderThread:2797740 [dir_watcher.py:finish():323] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log output.log
308
+ 2022-05-30 12:10:32,073 INFO SenderThread:2797740 [dir_watcher.py:finish():323] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/wandb-metadata.json wandb-metadata.json
309
+ 2022-05-30 12:10:32,073 INFO SenderThread:2797740 [dir_watcher.py:finish():323] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/config.yaml config.yaml
310
+ 2022-05-30 12:10:32,073 INFO SenderThread:2797740 [dir_watcher.py:finish():323] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/requirements.txt requirements.txt
311
+ 2022-05-30 12:10:32,073 INFO SenderThread:2797740 [dir_watcher.py:finish():323] scan save: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/wandb-summary.json wandb-summary.json
312
+ 2022-05-30 12:10:32,073 INFO SenderThread:2797740 [sender.py:transition_state():389] send defer: 7
313
+ 2022-05-30 12:10:32,073 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
314
+ 2022-05-30 12:10:32,074 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: defer
315
+ 2022-05-30 12:10:32,081 INFO HandlerThread:2797740 [handler.py:handle_request_defer():164] handle defer: 7
316
+ 2022-05-30 12:10:32,084 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: defer
317
+ 2022-05-30 12:10:32,084 INFO SenderThread:2797740 [sender.py:send_request_defer():385] handle sender defer: 7
318
+ 2022-05-30 12:10:32,084 INFO SenderThread:2797740 [file_pusher.py:finish():145] shutting down file pusher
319
+ 2022-05-30 12:10:32,175 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
320
+ 2022-05-30 12:10:32,175 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
321
+ 2022-05-30 12:10:32,276 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
322
+ 2022-05-30 12:10:32,276 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
323
+ 2022-05-30 12:10:32,378 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
324
+ 2022-05-30 12:10:32,378 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
325
+ 2022-05-30 12:10:32,479 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
326
+ 2022-05-30 12:10:32,480 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
327
+ 2022-05-30 12:10:32,557 INFO Thread-15 :2797740 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/wandb-summary.json
328
+ 2022-05-30 12:10:32,581 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
329
+ 2022-05-30 12:10:32,581 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
330
+ 2022-05-30 12:10:32,613 INFO Thread-13 :2797740 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/config.yaml
331
+ 2022-05-30 12:10:32,615 INFO Thread-12 :2797740 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/output.log
332
+ 2022-05-30 12:10:32,682 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
333
+ 2022-05-30 12:10:32,682 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
334
+ 2022-05-30 12:10:32,742 INFO Thread-14 :2797740 [upload_job.py:push():137] Uploaded file /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/files/requirements.txt
335
+ 2022-05-30 12:10:32,784 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
336
+ 2022-05-30 12:10:32,784 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
337
+ 2022-05-30 12:10:32,885 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
338
+ 2022-05-30 12:10:32,885 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
339
+ 2022-05-30 12:10:32,943 INFO Thread-6 :2797740 [sender.py:transition_state():389] send defer: 8
340
+ 2022-05-30 12:10:32,943 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: defer
341
+ 2022-05-30 12:10:32,943 INFO HandlerThread:2797740 [handler.py:handle_request_defer():164] handle defer: 8
342
+ 2022-05-30 12:10:32,944 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: defer
343
+ 2022-05-30 12:10:32,944 INFO SenderThread:2797740 [sender.py:send_request_defer():385] handle sender defer: 8
344
+ 2022-05-30 12:10:32,987 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
345
+ 2022-05-30 12:10:34,992 INFO SenderThread:2797740 [sender.py:transition_state():389] send defer: 9
346
+ 2022-05-30 12:10:34,992 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
347
+ 2022-05-30 12:10:34,992 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: defer
348
+ 2022-05-30 12:10:34,993 INFO HandlerThread:2797740 [handler.py:handle_request_defer():164] handle defer: 9
349
+ 2022-05-30 12:10:34,993 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: defer
350
+ 2022-05-30 12:10:34,993 INFO SenderThread:2797740 [sender.py:send_request_defer():385] handle sender defer: 9
351
+ 2022-05-30 12:10:34,993 INFO SenderThread:2797740 [sender.py:transition_state():389] send defer: 10
352
+ 2022-05-30 12:10:34,993 DEBUG SenderThread:2797740 [sender.py:send():232] send: final
353
+ 2022-05-30 12:10:34,994 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: defer
354
+ 2022-05-30 12:10:34,994 INFO HandlerThread:2797740 [handler.py:handle_request_defer():164] handle defer: 10
355
+ 2022-05-30 12:10:34,994 DEBUG SenderThread:2797740 [sender.py:send():232] send: footer
356
+ 2022-05-30 12:10:34,994 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: defer
357
+ 2022-05-30 12:10:34,994 INFO SenderThread:2797740 [sender.py:send_request_defer():385] handle sender defer: 10
358
+ 2022-05-30 12:10:35,094 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: poll_exit
359
+ 2022-05-30 12:10:35,094 DEBUG SenderThread:2797740 [sender.py:send_request():246] send_request: poll_exit
360
+ 2022-05-30 12:10:35,094 INFO SenderThread:2797740 [file_pusher.py:join():150] waiting for file pusher
361
+ 2022-05-30 12:10:35,469 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: sampled_history
362
+ 2022-05-30 12:10:35,470 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: get_summary
363
+ 2022-05-30 12:10:35,471 DEBUG HandlerThread:2797740 [handler.py:handle_request():141] handle_request: shutdown
364
+ 2022-05-30 12:10:35,471 INFO HandlerThread:2797740 [handler.py:finish():806] shutting down handler
365
+ 2022-05-30 12:10:35,994 INFO WriterThread:2797740 [datastore.py:close():279] close: /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/run-2k01y1ky.wandb
366
+ 2022-05-30 12:10:36,368 INFO SenderThread:2797740 [sender.py:finish():1106] shutting down sender
367
+ 2022-05-30 12:10:36,368 INFO SenderThread:2797740 [file_pusher.py:finish():145] shutting down file pusher
368
+ 2022-05-30 12:10:36,368 INFO SenderThread:2797740 [file_pusher.py:join():150] waiting for file pusher
369
+ 2022-05-30 12:10:36,370 INFO MainThread:2797740 [internal.py:handle_exit():80] Internal process exited
wandb/run-20220530_120145-2k01y1ky/logs/debug.log ADDED
@@ -0,0 +1,139 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2022-05-30 12:01:45,820 INFO MainThread:2796655 [wandb_setup.py:_flush():75] Loading settings from /home/sanchitgandhi/.config/wandb/settings
2
+ 2022-05-30 12:01:45,820 INFO MainThread:2796655 [wandb_setup.py:_flush():75] Loading settings from /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/settings
3
+ 2022-05-30 12:01:45,820 INFO MainThread:2796655 [wandb_setup.py:_flush():75] Loading settings from environment variables: {}
4
+ 2022-05-30 12:01:45,820 INFO MainThread:2796655 [wandb_setup.py:_flush():75] Inferring run settings from compute environment: {'program_relpath': 'run_flax_speech_recognition_seq2seq.py', 'program': 'run_flax_speech_recognition_seq2seq.py'}
5
+ 2022-05-30 12:01:45,820 INFO MainThread:2796655 [wandb_init.py:_log_setup():437] Logging user logs to /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/logs/debug.log
6
+ 2022-05-30 12:01:45,821 INFO MainThread:2796655 [wandb_init.py:_log_setup():438] Logging internal logs to /home/sanchitgandhi/flax-wav2vec2-2-bart-large-ls-960h-feature-encoder/wandb/run-20220530_120145-2k01y1ky/logs/debug-internal.log
7
+ 2022-05-30 12:01:45,821 INFO MainThread:2796655 [wandb_init.py:init():471] calling init triggers
8
+ 2022-05-30 12:01:45,821 INFO MainThread:2796655 [wandb_init.py:init():474] wandb.init called with sweep_config: {}
9
+ config: {}
10
+ 2022-05-30 12:01:45,821 INFO MainThread:2796655 [wandb_init.py:init():524] starting backend
11
+ 2022-05-30 12:01:45,821 INFO MainThread:2796655 [backend.py:_multiprocessing_setup():97] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
12
+ 2022-05-30 12:01:45,876 INFO MainThread:2796655 [backend.py:ensure_launched():217] starting backend process...
13
+ 2022-05-30 12:01:45,928 INFO MainThread:2796655 [backend.py:ensure_launched():222] started backend process with pid: 2797740
14
+ 2022-05-30 12:01:45,930 INFO MainThread:2796655 [wandb_init.py:init():533] backend started and connected
15
+ 2022-05-30 12:01:45,940 INFO MainThread:2796655 [wandb_init.py:init():597] updated telemetry
16
+ 2022-05-30 12:01:46,075 INFO MainThread:2796655 [wandb_init.py:init():628] communicating run to backend with 30 second timeout
17
+ 2022-05-30 12:01:46,892 INFO MainThread:2796655 [wandb_run.py:_on_init():1923] communicating current version
18
+ 2022-05-30 12:01:46,967 INFO MainThread:2796655 [wandb_run.py:_on_init():1927] got version response upgrade_message: "wandb version 0.12.17 is available! To upgrade, please run:\n $ pip install wandb --upgrade"
19
+
20
+ 2022-05-30 12:01:46,967 INFO MainThread:2796655 [wandb_init.py:init():659] starting run threads in backend
21
+ 2022-05-30 12:01:47,006 INFO MainThread:2796655 [wandb_run.py:_console_start():1897] atexit reg
22
+ 2022-05-30 12:01:47,007 INFO MainThread:2796655 [wandb_run.py:_redirect():1770] redirect: SettingsConsole.REDIRECT
23
+ 2022-05-30 12:01:47,007 INFO MainThread:2796655 [wandb_run.py:_redirect():1775] Redirecting console.
24
+ 2022-05-30 12:01:47,009 INFO MainThread:2796655 [wandb_run.py:_redirect():1831] Redirects installed.
25
+ 2022-05-30 12:01:47,010 INFO MainThread:2796655 [wandb_init.py:init():684] run started, returning control to user process
26
+ 2022-05-30 12:10:28,302 INFO MainThread:2796655 [wandb_run.py:_atexit_cleanup():1866] got exitcode: 1
27
+ 2022-05-30 12:10:28,349 INFO MainThread:2796655 [wandb_run.py:_restore():1838] restore
28
+ 2022-05-30 12:10:31,178 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
29
+ wandb_count: 1
30
+ }
31
+ pusher_stats {
32
+ uploaded_bytes: 2402
33
+ total_bytes: 2402
34
+ }
35
+
36
+ 2022-05-30 12:10:31,396 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
37
+ wandb_count: 1
38
+ }
39
+ pusher_stats {
40
+ uploaded_bytes: 2402
41
+ total_bytes: 2402
42
+ }
43
+
44
+ 2022-05-30 12:10:32,074 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
45
+ wandb_count: 4
46
+ }
47
+ pusher_stats {
48
+ uploaded_bytes: 2402
49
+ total_bytes: 21698
50
+ }
51
+
52
+ 2022-05-30 12:10:32,175 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
53
+ wandb_count: 5
54
+ }
55
+ pusher_stats {
56
+ uploaded_bytes: 2402
57
+ total_bytes: 21726
58
+ }
59
+
60
+ 2022-05-30 12:10:32,277 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
61
+ wandb_count: 5
62
+ }
63
+ pusher_stats {
64
+ uploaded_bytes: 18945
65
+ total_bytes: 21726
66
+ }
67
+
68
+ 2022-05-30 12:10:32,379 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
69
+ wandb_count: 5
70
+ }
71
+ pusher_stats {
72
+ uploaded_bytes: 18945
73
+ total_bytes: 21726
74
+ }
75
+
76
+ 2022-05-30 12:10:32,480 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
77
+ wandb_count: 5
78
+ }
79
+ pusher_stats {
80
+ uploaded_bytes: 21726
81
+ total_bytes: 21726
82
+ }
83
+
84
+ 2022-05-30 12:10:32,582 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
85
+ wandb_count: 5
86
+ }
87
+ pusher_stats {
88
+ uploaded_bytes: 21726
89
+ total_bytes: 21726
90
+ }
91
+
92
+ 2022-05-30 12:10:32,683 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
93
+ wandb_count: 5
94
+ }
95
+ pusher_stats {
96
+ uploaded_bytes: 21726
97
+ total_bytes: 21726
98
+ }
99
+
100
+ 2022-05-30 12:10:32,785 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
101
+ wandb_count: 5
102
+ }
103
+ pusher_stats {
104
+ uploaded_bytes: 21726
105
+ total_bytes: 21726
106
+ }
107
+
108
+ 2022-05-30 12:10:32,886 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
109
+ wandb_count: 5
110
+ }
111
+ pusher_stats {
112
+ uploaded_bytes: 21726
113
+ total_bytes: 21726
114
+ }
115
+
116
+ 2022-05-30 12:10:34,993 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: file_counts {
117
+ wandb_count: 5
118
+ }
119
+ pusher_stats {
120
+ uploaded_bytes: 21726
121
+ total_bytes: 21726
122
+ }
123
+
124
+ 2022-05-30 12:10:35,368 INFO MainThread:2796655 [wandb_run.py:_on_finish():1995] got exit ret: done: true
125
+ exit_result {
126
+ }
127
+ file_counts {
128
+ wandb_count: 5
129
+ }
130
+ pusher_stats {
131
+ uploaded_bytes: 21726
132
+ total_bytes: 21726
133
+ }
134
+ local_info {
135
+ }
136
+
137
+ 2022-05-30 12:10:36,532 INFO MainThread:2796655 [wandb_run.py:_footer_history_summary_info():3102] rendering history
138
+ 2022-05-30 12:10:36,532 INFO MainThread:2796655 [wandb_run.py:_footer_history_summary_info():3134] rendering summary
139
+ 2022-05-30 12:10:36,535 INFO MainThread:2796655 [wandb_run.py:_footer_sync_info():3057] logging synced files
wandb/run-20220530_120145-2k01y1ky/run-2k01y1ky.wandb ADDED
Binary file (33.6 kB). View file