marinone94 commited on
Commit
e3e5711
1 Parent(s): 66aded1

Training in progress, step 16500

Browse files
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ad4852619b29fc668b4b69a0e3357536f27d90643d8278d135ac5db93b2a06ee
3
  size 1262075377
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82acadfcbc2d17d2b17d8b2c485efc413432cafbc0a5ea2b838a3d2652a4fdc0
3
  size 1262075377
wandb/run-20220127_103723-scy0vyln/files/output.log CHANGED
@@ -12410,3 +12410,387 @@ Configuration saved in ./checkpoint-12000/preprocessor_config.json
12410
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12411
  {'eval_loss': 0.22073601186275482, 'eval_wer': 0.177904913418589, 'eval_runtime': 130.9629, 'eval_samples_per_second': 35.277, 'eval_steps_per_second': 4.413, 'epoch': 46.51}
12412
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12410
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12411
  {'eval_loss': 0.22073601186275482, 'eval_wer': 0.177904913418589, 'eval_runtime': 130.9629, 'eval_samples_per_second': 35.277, 'eval_steps_per_second': 4.413, 'epoch': 46.51}
12412
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12413
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12414
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12415
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12416
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12417
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12418
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12419
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12420
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12421
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12422
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12423
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12424
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12425
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12426
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12427
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12428
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12429
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12430
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12431
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12432
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12433
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12434
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12435
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12436
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12437
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12438
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12439
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12440
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12441
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12442
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12443
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12444
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12445
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12446
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12447
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12448
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12449
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12450
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12451
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12452
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12453
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12454
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12455
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12456
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12457
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12458
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12459
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12460
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12461
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12462
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12463
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12464
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12465
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12466
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12467
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12468
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12469
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12470
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12471
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12472
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12473
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12474
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12475
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12476
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12477
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12478
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12479
+ {'loss': 1.0231, 'learning_rate': 5.47203947368421e-06, 'epoch': 46.8}
12480
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12481
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12482
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12483
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12484
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12485
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12486
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12487
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12488
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12489
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12490
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12491
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12492
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12493
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12494
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12495
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12496
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12497
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12498
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12499
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12500
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12501
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12502
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12503
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12504
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12505
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12506
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12507
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12508
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12509
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12510
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12511
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12512
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12513
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12514
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12515
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12516
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12517
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12518
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12519
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12520
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12521
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12522
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12523
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12524
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12525
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12526
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12527
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12528
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12529
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12530
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12531
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12532
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12533
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12534
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12535
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12536
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12537
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12538
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12539
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12540
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12541
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12542
+ {'loss': 1.0161, 'learning_rate': 4.978618421052631e-06, 'epoch': 47.09}
12543
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12544
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12545
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12546
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12547
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12548
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12549
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12550
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12551
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12552
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12553
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12554
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12555
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12556
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12557
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12558
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12559
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12560
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12561
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12562
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12563
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12564
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12565
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12566
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12567
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12568
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12569
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12570
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12571
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12572
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12573
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12574
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12575
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12576
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12577
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12578
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12579
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12580
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12581
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12582
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12583
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12584
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12585
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12586
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12587
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12588
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12589
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12590
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12591
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12592
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12593
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12594
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12595
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12596
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12597
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12598
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12599
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12600
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12601
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12602
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12603
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12604
+ {'loss': 0.9842, 'learning_rate': 4.485197368421052e-06, 'epoch': 47.38}
12605
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12606
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12607
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12608
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12609
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12610
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12611
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12612
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12613
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12614
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12615
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12616
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12617
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12618
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12619
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12620
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12621
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12622
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12623
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12624
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12625
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12626
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12627
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12628
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12629
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12630
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12631
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12632
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12633
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12634
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12635
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12636
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12637
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12638
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12639
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12640
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12641
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12642
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12643
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12644
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12645
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12646
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12647
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12648
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12649
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12650
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12651
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12652
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12653
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12654
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12655
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12656
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12657
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12658
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12659
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12660
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12661
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12662
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12663
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12664
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12665
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12666
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12667
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12668
+ {'loss': 0.9901, 'learning_rate': 3.991776315789474e-06, 'epoch': 47.67}
12669
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12670
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12671
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12672
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12673
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12674
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12675
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12676
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12677
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12678
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12679
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12680
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12681
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12682
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12683
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12684
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12685
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12686
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12687
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12688
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12689
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12690
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12691
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12692
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12693
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12694
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12695
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12696
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12697
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12698
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12699
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12700
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12701
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12702
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12703
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12704
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12705
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12706
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12707
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12708
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12709
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12710
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12711
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12712
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12713
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12714
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12715
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12716
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12717
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12718
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12719
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12720
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12721
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12722
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12723
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12724
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12725
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12726
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12727
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12728
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12729
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12730
+ {'loss': 1.0071, 'learning_rate': 3.498355263157895e-06, 'epoch': 47.96}
12731
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12732
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12733
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12734
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12735
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12736
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12737
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12738
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12739
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12740
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12741
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12742
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12743
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12744
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12745
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12746
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12747
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12748
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12749
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12750
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12751
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12752
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12753
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12754
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12755
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12756
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12757
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12758
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12759
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12760
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12761
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12762
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12763
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12764
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12765
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12766
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12767
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12768
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12769
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12770
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12771
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12772
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12773
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12774
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12775
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12776
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12777
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12778
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12779
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12780
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12781
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12782
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12783
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12784
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12785
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12786
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12787
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12788
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12789
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12790
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12791
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12792
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12793
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12794
+ {'eval_loss': 0.2204526960849762, 'eval_wer': 0.1783638254910359, 'eval_runtime': 130.0967, 'eval_samples_per_second': 35.512, 'eval_steps_per_second': 4.443, 'epoch': 47.96}
12795
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12796
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20220127_103723-scy0vyln/logs/debug-internal.log CHANGED
@@ -18785,3 +18785,552 @@
18785
  2022-01-27 18:14:21,535 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18786
  2022-01-27 18:14:25,038 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18787
  2022-01-27 18:14:25,039 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18785
  2022-01-27 18:14:21,535 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18786
  2022-01-27 18:14:25,038 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18787
  2022-01-27 18:14:25,039 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18788
+ 2022-01-27 18:14:40,232 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18789
+ 2022-01-27 18:14:40,233 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18790
+ 2022-01-27 18:14:45,975 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18791
+ 2022-01-27 18:14:47,977 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18792
+ 2022-01-27 18:14:49,978 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18793
+ 2022-01-27 18:14:51,760 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18794
+ 2022-01-27 18:14:51,980 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18795
+ 2022-01-27 18:14:53,981 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18796
+ 2022-01-27 18:14:55,416 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18797
+ 2022-01-27 18:14:55,417 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18798
+ 2022-01-27 18:14:55,984 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18799
+ 2022-01-27 18:14:57,985 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18800
+ 2022-01-27 18:14:59,987 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18801
+ 2022-01-27 18:15:01,989 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18802
+ 2022-01-27 18:15:03,991 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18803
+ 2022-01-27 18:15:05,992 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18804
+ 2022-01-27 18:15:07,994 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18805
+ 2022-01-27 18:15:09,996 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18806
+ 2022-01-27 18:15:10,661 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18807
+ 2022-01-27 18:15:10,662 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18808
+ 2022-01-27 18:15:11,998 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18809
+ 2022-01-27 18:15:14,000 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18810
+ 2022-01-27 18:15:16,002 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18811
+ 2022-01-27 18:15:18,005 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18812
+ 2022-01-27 18:15:21,007 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18813
+ 2022-01-27 18:15:22,005 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18814
+ 2022-01-27 18:15:23,012 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18815
+ 2022-01-27 18:15:25,014 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18816
+ 2022-01-27 18:15:26,367 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18817
+ 2022-01-27 18:15:26,367 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18818
+ 2022-01-27 18:15:27,016 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18819
+ 2022-01-27 18:15:29,019 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18820
+ 2022-01-27 18:15:31,020 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18821
+ 2022-01-27 18:15:33,022 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18822
+ 2022-01-27 18:15:35,023 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18823
+ 2022-01-27 18:15:37,025 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18824
+ 2022-01-27 18:15:39,027 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18825
+ 2022-01-27 18:15:41,030 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18826
+ 2022-01-27 18:15:41,540 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18827
+ 2022-01-27 18:15:41,540 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18828
+ 2022-01-27 18:15:43,032 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18829
+ 2022-01-27 18:15:45,034 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18830
+ 2022-01-27 18:15:47,035 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18831
+ 2022-01-27 18:15:49,037 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18832
+ 2022-01-27 18:15:51,039 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18833
+ 2022-01-27 18:15:52,263 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18834
+ 2022-01-27 18:15:53,042 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18835
+ 2022-01-27 18:15:55,045 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18836
+ 2022-01-27 18:15:56,732 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18837
+ 2022-01-27 18:15:56,732 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18838
+ 2022-01-27 18:15:57,047 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18839
+ 2022-01-27 18:15:59,049 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18840
+ 2022-01-27 18:16:01,051 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18841
+ 2022-01-27 18:16:03,052 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18842
+ 2022-01-27 18:16:05,054 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18843
+ 2022-01-27 18:16:07,055 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18844
+ 2022-01-27 18:16:09,057 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18845
+ 2022-01-27 18:16:11,059 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18846
+ 2022-01-27 18:16:11,972 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18847
+ 2022-01-27 18:16:11,972 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18848
+ 2022-01-27 18:16:13,063 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18849
+ 2022-01-27 18:16:15,067 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18850
+ 2022-01-27 18:16:17,069 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18851
+ 2022-01-27 18:16:19,071 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18852
+ 2022-01-27 18:16:21,072 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18853
+ 2022-01-27 18:16:22,497 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18854
+ 2022-01-27 18:16:23,074 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18855
+ 2022-01-27 18:16:25,077 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18856
+ 2022-01-27 18:16:27,079 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18857
+ 2022-01-27 18:16:27,187 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18858
+ 2022-01-27 18:16:27,188 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18859
+ 2022-01-27 18:16:29,081 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18860
+ 2022-01-27 18:16:31,083 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18861
+ 2022-01-27 18:16:33,085 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18862
+ 2022-01-27 18:16:35,087 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18863
+ 2022-01-27 18:16:37,088 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18864
+ 2022-01-27 18:16:39,090 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18865
+ 2022-01-27 18:16:41,091 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18866
+ 2022-01-27 18:16:42,368 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18867
+ 2022-01-27 18:16:42,368 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18868
+ 2022-01-27 18:16:43,093 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18869
+ 2022-01-27 18:16:45,095 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18870
+ 2022-01-27 18:16:47,097 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18871
+ 2022-01-27 18:16:49,100 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18872
+ 2022-01-27 18:16:51,101 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18873
+ 2022-01-27 18:16:52,747 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18874
+ 2022-01-27 18:16:53,101 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18875
+ 2022-01-27 18:16:54,976 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
18876
+ 2022-01-27 18:16:55,046 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
18877
+ 2022-01-27 18:16:55,101 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
18878
+ 2022-01-27 18:16:55,102 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
18879
+ 2022-01-27 18:16:55,103 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18880
+ 2022-01-27 18:16:56,103 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18881
+ 2022-01-27 18:16:57,104 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18882
+ 2022-01-27 18:16:57,581 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18883
+ 2022-01-27 18:16:57,582 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18884
+ 2022-01-27 18:16:59,105 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18885
+ 2022-01-27 18:17:01,106 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18886
+ 2022-01-27 18:17:03,107 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18887
+ 2022-01-27 18:17:05,108 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18888
+ 2022-01-27 18:17:07,109 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18889
+ 2022-01-27 18:17:09,110 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18890
+ 2022-01-27 18:17:11,111 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18891
+ 2022-01-27 18:17:12,769 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18892
+ 2022-01-27 18:17:12,770 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18893
+ 2022-01-27 18:17:13,112 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18894
+ 2022-01-27 18:17:15,115 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18895
+ 2022-01-27 18:17:17,116 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18896
+ 2022-01-27 18:17:19,117 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18897
+ 2022-01-27 18:17:21,119 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18898
+ 2022-01-27 18:17:22,953 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18899
+ 2022-01-27 18:17:25,121 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18900
+ 2022-01-27 18:17:27,123 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18901
+ 2022-01-27 18:17:27,947 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18902
+ 2022-01-27 18:17:27,948 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18903
+ 2022-01-27 18:17:29,124 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18904
+ 2022-01-27 18:17:31,125 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18905
+ 2022-01-27 18:17:34,127 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18906
+ 2022-01-27 18:17:36,128 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18907
+ 2022-01-27 18:17:38,129 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18908
+ 2022-01-27 18:17:40,131 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18909
+ 2022-01-27 18:17:42,131 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18910
+ 2022-01-27 18:17:43,292 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18911
+ 2022-01-27 18:17:43,293 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18912
+ 2022-01-27 18:17:44,132 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18913
+ 2022-01-27 18:17:46,133 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18914
+ 2022-01-27 18:17:48,135 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18915
+ 2022-01-27 18:17:50,137 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18916
+ 2022-01-27 18:17:52,138 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18917
+ 2022-01-27 18:17:53,156 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18918
+ 2022-01-27 18:17:54,139 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18919
+ 2022-01-27 18:17:56,141 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18920
+ 2022-01-27 18:17:58,141 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18921
+ 2022-01-27 18:17:58,469 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18922
+ 2022-01-27 18:17:58,469 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18923
+ 2022-01-27 18:18:00,143 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18924
+ 2022-01-27 18:18:02,144 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18925
+ 2022-01-27 18:18:04,145 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18926
+ 2022-01-27 18:18:06,147 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18927
+ 2022-01-27 18:18:08,148 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18928
+ 2022-01-27 18:18:10,149 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18929
+ 2022-01-27 18:18:12,150 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18930
+ 2022-01-27 18:18:13,679 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18931
+ 2022-01-27 18:18:13,680 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18932
+ 2022-01-27 18:18:14,151 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18933
+ 2022-01-27 18:18:16,153 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18934
+ 2022-01-27 18:18:18,154 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18935
+ 2022-01-27 18:18:22,156 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18936
+ 2022-01-27 18:18:23,381 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18937
+ 2022-01-27 18:18:24,157 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18938
+ 2022-01-27 18:18:26,158 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18939
+ 2022-01-27 18:18:28,160 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18940
+ 2022-01-27 18:18:28,862 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18941
+ 2022-01-27 18:18:28,863 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18942
+ 2022-01-27 18:18:30,161 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18943
+ 2022-01-27 18:18:32,162 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18944
+ 2022-01-27 18:18:34,163 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18945
+ 2022-01-27 18:18:36,165 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18946
+ 2022-01-27 18:18:38,166 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18947
+ 2022-01-27 18:18:40,167 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18948
+ 2022-01-27 18:18:42,168 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18949
+ 2022-01-27 18:18:44,032 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18950
+ 2022-01-27 18:18:44,033 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18951
+ 2022-01-27 18:18:44,169 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18952
+ 2022-01-27 18:18:46,171 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18953
+ 2022-01-27 18:18:48,172 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18954
+ 2022-01-27 18:18:50,174 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18955
+ 2022-01-27 18:18:52,175 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18956
+ 2022-01-27 18:18:53,584 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18957
+ 2022-01-27 18:18:54,176 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18958
+ 2022-01-27 18:18:56,178 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18959
+ 2022-01-27 18:18:58,179 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18960
+ 2022-01-27 18:18:59,244 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18961
+ 2022-01-27 18:18:59,245 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18962
+ 2022-01-27 18:19:00,180 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18963
+ 2022-01-27 18:19:02,182 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18964
+ 2022-01-27 18:19:03,701 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
18965
+ 2022-01-27 18:19:03,789 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
18966
+ 2022-01-27 18:19:03,824 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
18967
+ 2022-01-27 18:19:04,183 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
18968
+ 2022-01-27 18:19:04,183 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18969
+ 2022-01-27 18:19:05,184 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18970
+ 2022-01-27 18:19:06,185 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18971
+ 2022-01-27 18:19:08,186 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18972
+ 2022-01-27 18:19:10,187 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18973
+ 2022-01-27 18:19:12,188 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18974
+ 2022-01-27 18:19:14,189 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18975
+ 2022-01-27 18:19:14,450 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18976
+ 2022-01-27 18:19:14,450 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18977
+ 2022-01-27 18:19:16,190 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18978
+ 2022-01-27 18:19:18,191 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18979
+ 2022-01-27 18:19:20,192 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18980
+ 2022-01-27 18:19:22,194 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18981
+ 2022-01-27 18:19:23,983 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
18982
+ 2022-01-27 18:19:24,195 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18983
+ 2022-01-27 18:19:26,197 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18984
+ 2022-01-27 18:19:28,197 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18985
+ 2022-01-27 18:19:29,706 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18986
+ 2022-01-27 18:19:29,707 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18987
+ 2022-01-27 18:19:30,199 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18988
+ 2022-01-27 18:19:32,200 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18989
+ 2022-01-27 18:19:34,201 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18990
+ 2022-01-27 18:19:36,202 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18991
+ 2022-01-27 18:19:39,204 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18992
+ 2022-01-27 18:19:41,205 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18993
+ 2022-01-27 18:19:43,207 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18994
+ 2022-01-27 18:19:44,876 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
18995
+ 2022-01-27 18:19:44,876 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
18996
+ 2022-01-27 18:19:45,208 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18997
+ 2022-01-27 18:19:47,209 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18998
+ 2022-01-27 18:19:49,211 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
18999
+ 2022-01-27 18:19:51,212 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19000
+ 2022-01-27 18:19:53,213 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19001
+ 2022-01-27 18:19:54,198 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19002
+ 2022-01-27 18:19:55,215 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19003
+ 2022-01-27 18:19:57,216 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19004
+ 2022-01-27 18:19:59,218 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19005
+ 2022-01-27 18:20:00,081 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19006
+ 2022-01-27 18:20:00,081 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19007
+ 2022-01-27 18:20:01,219 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19008
+ 2022-01-27 18:20:03,220 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19009
+ 2022-01-27 18:20:05,223 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19010
+ 2022-01-27 18:20:07,224 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19011
+ 2022-01-27 18:20:09,226 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19012
+ 2022-01-27 18:20:11,227 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19013
+ 2022-01-27 18:20:13,228 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19014
+ 2022-01-27 18:20:15,230 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19015
+ 2022-01-27 18:20:15,348 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19016
+ 2022-01-27 18:20:15,348 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19017
+ 2022-01-27 18:20:17,231 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19018
+ 2022-01-27 18:20:19,232 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19019
+ 2022-01-27 18:20:21,234 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19020
+ 2022-01-27 18:20:23,235 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19021
+ 2022-01-27 18:20:24,429 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19022
+ 2022-01-27 18:20:25,236 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19023
+ 2022-01-27 18:20:29,239 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19024
+ 2022-01-27 18:20:30,584 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19025
+ 2022-01-27 18:20:30,584 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19026
+ 2022-01-27 18:20:31,240 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19027
+ 2022-01-27 18:20:33,242 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19028
+ 2022-01-27 18:20:35,243 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19029
+ 2022-01-27 18:20:37,244 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19030
+ 2022-01-27 18:20:39,246 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19031
+ 2022-01-27 18:20:41,247 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19032
+ 2022-01-27 18:20:43,248 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19033
+ 2022-01-27 18:20:45,250 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19034
+ 2022-01-27 18:20:45,745 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19035
+ 2022-01-27 18:20:45,745 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19036
+ 2022-01-27 18:20:47,251 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19037
+ 2022-01-27 18:20:49,252 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19038
+ 2022-01-27 18:20:51,254 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19039
+ 2022-01-27 18:20:53,255 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19040
+ 2022-01-27 18:20:54,679 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19041
+ 2022-01-27 18:20:55,257 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19042
+ 2022-01-27 18:20:57,258 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19043
+ 2022-01-27 18:20:59,259 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19044
+ 2022-01-27 18:21:00,925 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19045
+ 2022-01-27 18:21:00,926 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19046
+ 2022-01-27 18:21:01,261 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19047
+ 2022-01-27 18:21:03,263 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19048
+ 2022-01-27 18:21:05,265 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19049
+ 2022-01-27 18:21:07,266 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19050
+ 2022-01-27 18:21:09,268 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19051
+ 2022-01-27 18:21:10,127 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
19052
+ 2022-01-27 18:21:10,266 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
19053
+ 2022-01-27 18:21:10,311 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
19054
+ 2022-01-27 18:21:11,288 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
19055
+ 2022-01-27 18:21:11,289 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19056
+ 2022-01-27 18:21:13,290 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19057
+ 2022-01-27 18:21:15,292 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19058
+ 2022-01-27 18:21:16,120 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19059
+ 2022-01-27 18:21:16,121 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19060
+ 2022-01-27 18:21:17,294 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19061
+ 2022-01-27 18:21:19,295 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19062
+ 2022-01-27 18:21:21,297 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19063
+ 2022-01-27 18:21:23,299 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19064
+ 2022-01-27 18:21:24,972 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19065
+ 2022-01-27 18:21:25,301 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19066
+ 2022-01-27 18:21:27,303 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19067
+ 2022-01-27 18:21:29,304 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19068
+ 2022-01-27 18:21:31,358 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19069
+ 2022-01-27 18:21:31,359 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19070
+ 2022-01-27 18:21:32,307 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19071
+ 2022-01-27 18:21:34,309 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19072
+ 2022-01-27 18:21:36,311 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19073
+ 2022-01-27 18:21:38,313 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19074
+ 2022-01-27 18:21:40,315 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19075
+ 2022-01-27 18:21:42,317 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19076
+ 2022-01-27 18:21:44,319 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19077
+ 2022-01-27 18:21:46,321 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19078
+ 2022-01-27 18:21:46,577 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19079
+ 2022-01-27 18:21:46,577 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19080
+ 2022-01-27 18:21:48,322 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19081
+ 2022-01-27 18:21:50,324 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19082
+ 2022-01-27 18:21:52,326 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19083
+ 2022-01-27 18:21:54,328 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19084
+ 2022-01-27 18:21:55,214 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19085
+ 2022-01-27 18:21:56,330 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19086
+ 2022-01-27 18:21:58,332 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19087
+ 2022-01-27 18:22:00,334 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19088
+ 2022-01-27 18:22:01,751 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19089
+ 2022-01-27 18:22:01,752 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19090
+ 2022-01-27 18:22:02,335 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19091
+ 2022-01-27 18:22:04,337 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19092
+ 2022-01-27 18:22:06,339 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19093
+ 2022-01-27 18:22:08,341 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19094
+ 2022-01-27 18:22:10,343 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19095
+ 2022-01-27 18:22:12,345 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19096
+ 2022-01-27 18:22:14,348 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19097
+ 2022-01-27 18:22:16,350 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19098
+ 2022-01-27 18:22:16,961 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19099
+ 2022-01-27 18:22:16,962 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19100
+ 2022-01-27 18:22:18,353 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19101
+ 2022-01-27 18:22:20,355 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19102
+ 2022-01-27 18:22:22,357 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19103
+ 2022-01-27 18:22:24,359 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19104
+ 2022-01-27 18:22:25,441 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19105
+ 2022-01-27 18:22:26,361 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19106
+ 2022-01-27 18:22:28,363 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19107
+ 2022-01-27 18:22:30,365 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19108
+ 2022-01-27 18:22:32,201 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19109
+ 2022-01-27 18:22:32,201 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19110
+ 2022-01-27 18:22:32,369 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19111
+ 2022-01-27 18:22:34,370 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19112
+ 2022-01-27 18:22:36,371 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19113
+ 2022-01-27 18:22:38,373 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19114
+ 2022-01-27 18:22:40,375 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19115
+ 2022-01-27 18:22:42,377 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19116
+ 2022-01-27 18:22:44,379 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19117
+ 2022-01-27 18:22:46,381 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19118
+ 2022-01-27 18:22:47,375 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19119
+ 2022-01-27 18:22:47,376 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19120
+ 2022-01-27 18:22:48,382 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19121
+ 2022-01-27 18:22:50,384 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19122
+ 2022-01-27 18:22:52,385 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19123
+ 2022-01-27 18:22:54,388 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19124
+ 2022-01-27 18:22:55,680 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19125
+ 2022-01-27 18:22:56,390 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19126
+ 2022-01-27 18:22:58,392 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19127
+ 2022-01-27 18:23:00,393 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19128
+ 2022-01-27 18:23:02,395 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19129
+ 2022-01-27 18:23:02,555 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19130
+ 2022-01-27 18:23:02,556 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19131
+ 2022-01-27 18:23:04,397 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19132
+ 2022-01-27 18:23:06,399 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19133
+ 2022-01-27 18:23:08,401 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19134
+ 2022-01-27 18:23:10,403 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19135
+ 2022-01-27 18:23:12,405 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19136
+ 2022-01-27 18:23:14,406 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19137
+ 2022-01-27 18:23:16,085 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
19138
+ 2022-01-27 18:23:16,195 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
19139
+ 2022-01-27 18:23:16,241 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
19140
+ 2022-01-27 18:23:16,408 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
19141
+ 2022-01-27 18:23:16,408 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19142
+ 2022-01-27 18:23:17,409 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19143
+ 2022-01-27 18:23:17,763 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19144
+ 2022-01-27 18:23:17,764 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19145
+ 2022-01-27 18:23:18,410 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19146
+ 2022-01-27 18:23:20,411 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19147
+ 2022-01-27 18:23:22,413 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19148
+ 2022-01-27 18:23:24,415 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19149
+ 2022-01-27 18:23:25,915 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19150
+ 2022-01-27 18:23:27,418 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19151
+ 2022-01-27 18:23:29,420 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19152
+ 2022-01-27 18:23:31,421 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19153
+ 2022-01-27 18:23:33,010 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19154
+ 2022-01-27 18:23:33,010 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19155
+ 2022-01-27 18:23:33,423 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19156
+ 2022-01-27 18:23:35,425 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19157
+ 2022-01-27 18:23:37,427 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19158
+ 2022-01-27 18:23:39,429 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19159
+ 2022-01-27 18:23:41,431 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19160
+ 2022-01-27 18:23:43,433 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19161
+ 2022-01-27 18:23:45,434 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19162
+ 2022-01-27 18:23:47,436 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19163
+ 2022-01-27 18:23:48,208 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19164
+ 2022-01-27 18:23:48,209 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19165
+ 2022-01-27 18:23:49,438 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19166
+ 2022-01-27 18:23:51,440 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19167
+ 2022-01-27 18:23:53,442 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19168
+ 2022-01-27 18:23:55,444 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19169
+ 2022-01-27 18:23:56,133 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19170
+ 2022-01-27 18:23:57,446 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19171
+ 2022-01-27 18:23:59,448 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19172
+ 2022-01-27 18:24:01,450 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19173
+ 2022-01-27 18:24:03,422 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19174
+ 2022-01-27 18:24:03,423 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19175
+ 2022-01-27 18:24:03,452 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19176
+ 2022-01-27 18:24:05,454 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19177
+ 2022-01-27 18:24:07,456 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19178
+ 2022-01-27 18:24:09,457 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19179
+ 2022-01-27 18:24:11,459 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19180
+ 2022-01-27 18:24:13,461 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19181
+ 2022-01-27 18:24:15,462 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19182
+ 2022-01-27 18:24:17,464 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19183
+ 2022-01-27 18:24:18,593 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19184
+ 2022-01-27 18:24:18,594 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19185
+ 2022-01-27 18:24:19,466 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19186
+ 2022-01-27 18:24:21,467 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19187
+ 2022-01-27 18:24:23,468 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19188
+ 2022-01-27 18:24:25,470 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19189
+ 2022-01-27 18:24:26,357 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19190
+ 2022-01-27 18:24:27,471 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19191
+ 2022-01-27 18:24:29,473 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19192
+ 2022-01-27 18:24:31,475 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19193
+ 2022-01-27 18:24:33,477 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19194
+ 2022-01-27 18:24:33,766 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19195
+ 2022-01-27 18:24:33,767 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19196
+ 2022-01-27 18:24:35,479 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19197
+ 2022-01-27 18:24:37,481 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19198
+ 2022-01-27 18:24:39,483 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19199
+ 2022-01-27 18:24:41,485 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19200
+ 2022-01-27 18:24:43,487 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19201
+ 2022-01-27 18:24:45,489 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19202
+ 2022-01-27 18:24:47,491 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19203
+ 2022-01-27 18:24:48,967 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19204
+ 2022-01-27 18:24:48,967 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19205
+ 2022-01-27 18:24:49,493 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19206
+ 2022-01-27 18:24:51,495 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19207
+ 2022-01-27 18:24:53,496 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19208
+ 2022-01-27 18:24:55,499 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19209
+ 2022-01-27 18:24:56,576 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19210
+ 2022-01-27 18:24:57,500 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19211
+ 2022-01-27 18:24:59,502 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19212
+ 2022-01-27 18:25:01,503 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19213
+ 2022-01-27 18:25:03,505 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19214
+ 2022-01-27 18:25:04,203 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19215
+ 2022-01-27 18:25:04,203 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19216
+ 2022-01-27 18:25:05,507 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19217
+ 2022-01-27 18:25:07,509 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19218
+ 2022-01-27 18:25:09,511 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19219
+ 2022-01-27 18:25:12,514 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19220
+ 2022-01-27 18:25:14,516 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19221
+ 2022-01-27 18:25:16,517 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19222
+ 2022-01-27 18:25:18,519 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19223
+ 2022-01-27 18:25:19,368 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19224
+ 2022-01-27 18:25:19,369 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19225
+ 2022-01-27 18:25:19,572 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
19226
+ 2022-01-27 18:25:19,688 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
19227
+ 2022-01-27 18:25:19,724 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
19228
+ 2022-01-27 18:25:20,520 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
19229
+ 2022-01-27 18:25:20,520 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19230
+ 2022-01-27 18:25:22,522 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19231
+ 2022-01-27 18:25:24,524 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19232
+ 2022-01-27 18:25:26,526 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19233
+ 2022-01-27 18:25:26,834 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19234
+ 2022-01-27 18:25:28,527 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19235
+ 2022-01-27 18:25:30,529 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19236
+ 2022-01-27 18:25:32,531 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19237
+ 2022-01-27 18:25:34,533 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19238
+ 2022-01-27 18:25:34,540 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19239
+ 2022-01-27 18:25:34,541 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19240
+ 2022-01-27 18:25:36,535 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19241
+ 2022-01-27 18:25:38,537 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19242
+ 2022-01-27 18:25:40,539 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19243
+ 2022-01-27 18:25:42,541 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19244
+ 2022-01-27 18:25:44,543 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19245
+ 2022-01-27 18:25:46,545 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19246
+ 2022-01-27 18:25:48,547 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19247
+ 2022-01-27 18:25:49,732 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19248
+ 2022-01-27 18:25:49,733 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19249
+ 2022-01-27 18:25:50,549 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19250
+ 2022-01-27 18:25:52,551 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19251
+ 2022-01-27 18:25:54,553 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19252
+ 2022-01-27 18:25:56,555 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19253
+ 2022-01-27 18:25:57,055 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19254
+ 2022-01-27 18:25:58,557 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19255
+ 2022-01-27 18:26:00,559 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19256
+ 2022-01-27 18:26:02,561 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19257
+ 2022-01-27 18:26:04,563 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19258
+ 2022-01-27 18:26:04,965 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19259
+ 2022-01-27 18:26:04,966 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19260
+ 2022-01-27 18:26:06,565 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19261
+ 2022-01-27 18:26:08,567 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19262
+ 2022-01-27 18:26:10,569 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19263
+ 2022-01-27 18:26:12,571 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19264
+ 2022-01-27 18:26:14,572 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19265
+ 2022-01-27 18:26:16,573 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19266
+ 2022-01-27 18:26:18,575 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19267
+ 2022-01-27 18:26:20,353 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19268
+ 2022-01-27 18:26:20,353 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19269
+ 2022-01-27 18:26:20,576 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19270
+ 2022-01-27 18:26:22,578 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19271
+ 2022-01-27 18:26:24,580 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19272
+ 2022-01-27 18:26:26,581 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19273
+ 2022-01-27 18:26:27,264 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19274
+ 2022-01-27 18:26:28,583 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19275
+ 2022-01-27 18:26:30,584 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19276
+ 2022-01-27 18:26:32,586 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19277
+ 2022-01-27 18:26:34,588 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19278
+ 2022-01-27 18:26:35,583 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19279
+ 2022-01-27 18:26:35,584 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19280
+ 2022-01-27 18:26:36,590 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19281
+ 2022-01-27 18:26:38,592 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19282
+ 2022-01-27 18:26:40,594 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19283
+ 2022-01-27 18:26:42,596 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19284
+ 2022-01-27 18:26:44,598 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19285
+ 2022-01-27 18:26:46,599 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19286
+ 2022-01-27 18:26:49,602 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19287
+ 2022-01-27 18:26:50,872 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19288
+ 2022-01-27 18:26:50,872 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19289
+ 2022-01-27 18:26:51,604 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19290
+ 2022-01-27 18:26:53,606 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19291
+ 2022-01-27 18:26:55,608 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19292
+ 2022-01-27 18:26:57,484 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19293
+ 2022-01-27 18:26:57,610 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19294
+ 2022-01-27 18:26:59,612 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19295
+ 2022-01-27 18:27:01,614 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19296
+ 2022-01-27 18:27:03,616 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19297
+ 2022-01-27 18:27:05,618 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19298
+ 2022-01-27 18:27:06,119 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19299
+ 2022-01-27 18:27:06,120 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19300
+ 2022-01-27 18:27:07,620 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19301
+ 2022-01-27 18:27:09,621 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19302
+ 2022-01-27 18:27:11,623 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19303
+ 2022-01-27 18:27:13,625 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19304
+ 2022-01-27 18:27:15,627 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19305
+ 2022-01-27 18:27:17,629 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19306
+ 2022-01-27 18:27:19,631 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19307
+ 2022-01-27 18:27:21,323 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19308
+ 2022-01-27 18:27:21,323 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19309
+ 2022-01-27 18:27:21,633 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19310
+ 2022-01-27 18:27:23,635 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19311
+ 2022-01-27 18:27:25,637 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19312
+ 2022-01-27 18:27:27,638 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19313
+ 2022-01-27 18:27:27,731 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19314
+ 2022-01-27 18:27:29,643 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
19315
+ 2022-01-27 18:27:29,680 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
19316
+ 2022-01-27 18:27:29,727 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
19317
+ 2022-01-27 18:27:30,682 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
19318
+ 2022-01-27 18:27:30,682 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19319
+ 2022-01-27 18:27:31,683 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19320
+ 2022-01-27 18:27:33,685 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19321
+ 2022-01-27 18:27:36,500 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19322
+ 2022-01-27 18:27:36,502 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19323
+ 2022-01-27 18:27:41,691 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19324
+ 2022-01-27 18:27:51,662 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19325
+ 2022-01-27 18:27:51,663 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19326
+ 2022-01-27 18:27:57,992 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19327
+ 2022-01-27 18:28:06,843 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19328
+ 2022-01-27 18:28:06,843 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19329
+ 2022-01-27 18:28:22,019 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19330
+ 2022-01-27 18:28:22,019 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19331
+ 2022-01-27 18:28:28,229 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19332
+ 2022-01-27 18:28:37,197 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19333
+ 2022-01-27 18:28:37,197 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19334
+ 2022-01-27 18:28:52,368 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19335
+ 2022-01-27 18:28:52,369 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19336
+ 2022-01-27 18:28:58,464 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
wandb/run-20220127_103723-scy0vyln/run-scy0vyln.wandb CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:60bb1b9dc0d87e0ba0373148f9904912db3bb3b909114b01d9af6064ef39b245
3
- size 109617286
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f9addee8f5f1227e21f96c82846c96ef50ee61ebe9d97fef99bec9766f6c2d0
3
+ size 112988181