marinone94 commited on
Commit
21f544f
1 Parent(s): e3e5711

Training in progress, step 17000

Browse files
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:82acadfcbc2d17d2b17d8b2c485efc413432cafbc0a5ea2b838a3d2652a4fdc0
3
  size 1262075377
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ca6429a1126cd992ffb89b88bfccfe4888011768d0b78a5db3fa094e3f1fec6
3
  size 1262075377
wandb/run-20220127_103723-scy0vyln/files/output.log CHANGED
@@ -12794,3 +12794,382 @@ Configuration saved in ./checkpoint-12000/preprocessor_config.json
12794
  {'eval_loss': 0.2204526960849762, 'eval_wer': 0.1783638254910359, 'eval_runtime': 130.0967, 'eval_samples_per_second': 35.512, 'eval_steps_per_second': 4.443, 'epoch': 47.96}
12795
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12796
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12794
  {'eval_loss': 0.2204526960849762, 'eval_wer': 0.1783638254910359, 'eval_runtime': 130.0967, 'eval_samples_per_second': 35.512, 'eval_steps_per_second': 4.443, 'epoch': 47.96}
12795
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12796
  Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12797
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12798
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12799
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12800
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12801
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12802
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12803
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12804
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12805
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12806
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12807
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12808
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12809
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12810
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12811
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12812
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12813
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12814
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12815
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12816
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12817
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12818
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12819
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12820
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12821
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12822
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12823
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12824
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12825
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12826
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12827
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12828
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12829
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12830
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12831
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12832
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12833
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12834
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12835
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12836
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12837
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12838
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12839
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12840
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12841
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12842
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12843
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12844
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12845
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12846
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12847
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12848
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12849
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12850
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12851
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12852
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12853
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12854
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12855
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12856
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12857
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12858
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12859
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12860
+ {'loss': 1.0114, 'learning_rate': 3.0049342105263154e-06, 'epoch': 48.26}
12861
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12862
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12863
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12864
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12865
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12866
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12867
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12868
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12869
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12870
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12871
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12872
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12873
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12874
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12875
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12876
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12877
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12878
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12879
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12880
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12881
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12882
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12883
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12884
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12885
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12886
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12887
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12888
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12889
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12890
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12891
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12892
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12893
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12894
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12895
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12896
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12897
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12898
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12899
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12900
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12901
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12902
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12903
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12904
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12905
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12906
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12907
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12908
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12909
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12910
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12911
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12912
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12913
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12914
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12915
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12916
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12917
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12918
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12919
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12920
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12921
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12922
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12923
+ {'loss': 1.0035, 'learning_rate': 2.5115131578947363e-06, 'epoch': 48.55}
12924
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12925
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12926
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12927
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12928
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12929
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12930
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12931
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12932
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12933
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12934
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12935
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12936
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12937
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12938
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12939
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12940
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12941
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12942
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12943
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12944
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12945
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12946
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12947
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12948
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12949
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12950
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12951
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12952
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12953
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12954
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12955
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12956
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12957
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12958
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12959
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12960
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12961
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12962
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12963
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12964
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12965
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12966
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12967
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12968
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12969
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12970
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12971
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12972
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12973
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12974
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12975
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12976
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12977
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12978
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12979
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12980
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12981
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12982
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12983
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12984
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12985
+ {'loss': 1.0091, 'learning_rate': 2.0180921052631577e-06, 'epoch': 48.84}
12986
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12987
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12988
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12989
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12990
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12991
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12992
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12993
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12994
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12995
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12996
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12997
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12998
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
12999
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13000
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13001
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13002
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13003
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13004
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13005
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13006
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13007
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13008
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13009
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13010
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13011
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13012
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13013
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13014
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13015
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13016
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13017
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13018
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13019
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13020
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13021
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13022
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13023
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13024
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13025
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13026
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13027
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13028
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13029
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13030
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13031
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13032
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13033
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13034
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13035
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13036
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13037
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13038
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13039
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13040
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13041
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13042
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13043
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13044
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13045
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13046
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13047
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13048
+ {'loss': 1.0022, 'learning_rate': 1.524671052631579e-06, 'epoch': 49.13}
13049
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13050
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13051
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13052
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13053
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13054
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13055
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13056
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13057
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13058
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13059
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13060
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13061
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13062
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13063
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13064
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13065
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13066
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13067
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13068
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13069
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13070
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13071
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13072
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13073
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13074
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13075
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13076
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13077
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13078
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13079
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13080
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13081
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13082
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13083
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13084
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13085
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13086
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13087
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13088
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13089
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13090
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13091
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13092
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13093
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13094
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13095
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13096
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13097
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13098
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13099
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13100
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13101
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13102
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13103
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13104
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13105
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13106
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13107
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13108
+ {'loss': 0.9729, 'learning_rate': 1.0312499999999999e-06, 'epoch': 49.42}
13109
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13110
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13111
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13112
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13113
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13114
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13115
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13116
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13117
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13118
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13119
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13120
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13121
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13122
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13123
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13124
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13125
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13126
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13127
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13128
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13129
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13130
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13131
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13132
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13133
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13134
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13135
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13136
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13137
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13138
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13139
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13140
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13141
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13142
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13143
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13144
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13145
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13146
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13147
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13148
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13149
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13150
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13151
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13152
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13153
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13154
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13155
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13156
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13157
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13158
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13159
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13160
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13161
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13162
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13163
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13164
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13165
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13166
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13167
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13168
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13169
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13170
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13171
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13172
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13173
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
13174
+ {'eval_loss': 0.22042310237884521, 'eval_wer': 0.17766016031328397, 'eval_runtime': 130.006, 'eval_samples_per_second': 35.537, 'eval_steps_per_second': 4.446, 'epoch': 49.42}
13175
+ Batch size = 8ved in ./checkpoint-12000/preprocessor_config.json | 217/578 [00:52<01:54, 3.14it/s]
wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20220127_103723-scy0vyln/logs/debug-internal.log CHANGED
@@ -19334,3 +19334,542 @@
19334
  2022-01-27 18:28:52,368 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19335
  2022-01-27 18:28:52,369 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19336
  2022-01-27 18:28:58,464 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19334
  2022-01-27 18:28:52,368 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19335
  2022-01-27 18:28:52,369 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19336
  2022-01-27 18:28:58,464 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19337
+ 2022-01-27 18:29:05,751 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19338
+ 2022-01-27 18:29:07,598 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19339
+ 2022-01-27 18:29:07,599 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19340
+ 2022-01-27 18:29:07,752 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19341
+ 2022-01-27 18:29:09,753 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19342
+ 2022-01-27 18:29:11,754 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19343
+ 2022-01-27 18:29:13,756 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19344
+ 2022-01-27 18:29:15,757 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19345
+ 2022-01-27 18:29:17,758 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19346
+ 2022-01-27 18:29:21,761 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19347
+ 2022-01-27 18:29:22,775 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19348
+ 2022-01-27 18:29:22,775 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19349
+ 2022-01-27 18:29:23,762 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19350
+ 2022-01-27 18:29:25,764 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19351
+ 2022-01-27 18:29:27,766 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19352
+ 2022-01-27 18:29:28,699 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19353
+ 2022-01-27 18:29:29,767 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19354
+ 2022-01-27 18:29:31,768 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19355
+ 2022-01-27 18:29:33,770 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19356
+ 2022-01-27 18:29:35,771 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19357
+ 2022-01-27 18:29:37,772 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19358
+ 2022-01-27 18:29:37,996 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19359
+ 2022-01-27 18:29:37,997 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19360
+ 2022-01-27 18:29:39,774 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19361
+ 2022-01-27 18:29:41,775 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19362
+ 2022-01-27 18:29:43,776 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19363
+ 2022-01-27 18:29:45,778 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19364
+ 2022-01-27 18:29:47,779 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19365
+ 2022-01-27 18:29:49,781 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19366
+ 2022-01-27 18:29:51,783 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19367
+ 2022-01-27 18:29:53,158 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19368
+ 2022-01-27 18:29:53,158 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19369
+ 2022-01-27 18:29:53,785 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19370
+ 2022-01-27 18:29:55,786 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19371
+ 2022-01-27 18:29:57,788 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19372
+ 2022-01-27 18:29:58,913 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19373
+ 2022-01-27 18:30:00,790 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19374
+ 2022-01-27 18:30:02,791 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19375
+ 2022-01-27 18:30:04,792 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19376
+ 2022-01-27 18:30:06,793 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19377
+ 2022-01-27 18:30:08,322 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19378
+ 2022-01-27 18:30:08,323 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19379
+ 2022-01-27 18:30:08,795 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19380
+ 2022-01-27 18:30:10,797 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19381
+ 2022-01-27 18:30:12,799 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19382
+ 2022-01-27 18:30:14,801 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19383
+ 2022-01-27 18:30:16,803 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19384
+ 2022-01-27 18:30:18,805 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19385
+ 2022-01-27 18:30:20,807 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19386
+ 2022-01-27 18:30:23,502 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19387
+ 2022-01-27 18:30:23,503 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19388
+ 2022-01-27 18:30:24,810 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19389
+ 2022-01-27 18:30:26,812 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19390
+ 2022-01-27 18:30:28,814 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19391
+ 2022-01-27 18:30:29,132 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19392
+ 2022-01-27 18:30:30,816 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19393
+ 2022-01-27 18:30:32,818 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19394
+ 2022-01-27 18:30:34,820 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19395
+ 2022-01-27 18:30:36,822 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19396
+ 2022-01-27 18:30:38,727 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19397
+ 2022-01-27 18:30:38,727 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19398
+ 2022-01-27 18:30:38,824 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19399
+ 2022-01-27 18:30:40,826 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19400
+ 2022-01-27 18:30:42,828 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19401
+ 2022-01-27 18:30:44,830 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19402
+ 2022-01-27 18:30:46,832 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19403
+ 2022-01-27 18:30:48,834 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19404
+ 2022-01-27 18:30:50,836 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19405
+ 2022-01-27 18:30:52,838 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19406
+ 2022-01-27 18:30:53,937 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19407
+ 2022-01-27 18:30:53,937 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19408
+ 2022-01-27 18:30:54,840 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19409
+ 2022-01-27 18:30:56,842 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19410
+ 2022-01-27 18:30:58,843 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19411
+ 2022-01-27 18:30:59,330 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19412
+ 2022-01-27 18:31:00,845 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19413
+ 2022-01-27 18:31:02,846 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19414
+ 2022-01-27 18:31:04,848 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19415
+ 2022-01-27 18:31:06,849 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19416
+ 2022-01-27 18:31:08,851 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19417
+ 2022-01-27 18:31:09,156 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19418
+ 2022-01-27 18:31:09,157 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19419
+ 2022-01-27 18:31:10,853 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19420
+ 2022-01-27 18:31:11,664 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
19421
+ 2022-01-27 18:31:11,789 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
19422
+ 2022-01-27 18:31:11,833 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
19423
+ 2022-01-27 18:31:11,854 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
19424
+ 2022-01-27 18:31:12,855 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19425
+ 2022-01-27 18:31:13,856 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19426
+ 2022-01-27 18:31:14,856 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19427
+ 2022-01-27 18:31:16,858 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19428
+ 2022-01-27 18:31:18,859 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19429
+ 2022-01-27 18:31:20,861 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19430
+ 2022-01-27 18:31:22,862 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19431
+ 2022-01-27 18:31:24,745 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19432
+ 2022-01-27 18:31:24,746 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19433
+ 2022-01-27 18:31:24,863 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19434
+ 2022-01-27 18:31:26,864 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19435
+ 2022-01-27 18:31:28,866 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19436
+ 2022-01-27 18:31:29,567 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19437
+ 2022-01-27 18:31:30,868 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19438
+ 2022-01-27 18:31:32,870 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19439
+ 2022-01-27 18:31:34,873 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19440
+ 2022-01-27 18:31:36,875 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19441
+ 2022-01-27 18:31:38,877 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19442
+ 2022-01-27 18:31:39,919 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19443
+ 2022-01-27 18:31:39,920 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19444
+ 2022-01-27 18:31:40,879 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19445
+ 2022-01-27 18:31:42,881 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19446
+ 2022-01-27 18:31:44,883 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19447
+ 2022-01-27 18:31:46,885 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19448
+ 2022-01-27 18:31:48,887 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19449
+ 2022-01-27 18:31:50,889 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19450
+ 2022-01-27 18:31:53,891 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19451
+ 2022-01-27 18:31:55,136 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19452
+ 2022-01-27 18:31:55,136 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19453
+ 2022-01-27 18:31:55,893 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19454
+ 2022-01-27 18:31:57,894 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19455
+ 2022-01-27 18:31:59,789 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19456
+ 2022-01-27 18:31:59,896 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19457
+ 2022-01-27 18:32:01,898 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19458
+ 2022-01-27 18:32:03,900 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19459
+ 2022-01-27 18:32:05,901 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19460
+ 2022-01-27 18:32:07,903 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19461
+ 2022-01-27 18:32:09,905 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19462
+ 2022-01-27 18:32:10,364 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19463
+ 2022-01-27 18:32:10,365 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19464
+ 2022-01-27 18:32:11,907 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19465
+ 2022-01-27 18:32:13,908 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19466
+ 2022-01-27 18:32:15,910 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19467
+ 2022-01-27 18:32:17,913 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19468
+ 2022-01-27 18:32:19,914 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19469
+ 2022-01-27 18:32:21,916 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19470
+ 2022-01-27 18:32:23,917 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19471
+ 2022-01-27 18:32:25,695 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19472
+ 2022-01-27 18:32:25,696 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19473
+ 2022-01-27 18:32:25,919 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19474
+ 2022-01-27 18:32:27,921 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19475
+ 2022-01-27 18:32:29,923 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19476
+ 2022-01-27 18:32:30,030 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19477
+ 2022-01-27 18:32:31,925 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19478
+ 2022-01-27 18:32:33,927 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19479
+ 2022-01-27 18:32:35,930 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19480
+ 2022-01-27 18:32:37,932 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19481
+ 2022-01-27 18:32:39,933 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19482
+ 2022-01-27 18:32:40,898 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19483
+ 2022-01-27 18:32:40,899 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19484
+ 2022-01-27 18:32:41,935 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19485
+ 2022-01-27 18:32:43,937 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19486
+ 2022-01-27 18:32:45,939 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19487
+ 2022-01-27 18:32:47,941 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19488
+ 2022-01-27 18:32:49,943 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19489
+ 2022-01-27 18:32:51,945 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19490
+ 2022-01-27 18:32:53,947 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19491
+ 2022-01-27 18:32:55,949 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19492
+ 2022-01-27 18:32:56,069 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19493
+ 2022-01-27 18:32:56,069 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19494
+ 2022-01-27 18:32:57,951 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19495
+ 2022-01-27 18:32:59,952 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19496
+ 2022-01-27 18:33:00,285 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19497
+ 2022-01-27 18:33:01,954 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19498
+ 2022-01-27 18:33:03,956 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19499
+ 2022-01-27 18:33:05,957 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19500
+ 2022-01-27 18:33:07,959 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19501
+ 2022-01-27 18:33:09,961 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19502
+ 2022-01-27 18:33:11,280 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19503
+ 2022-01-27 18:33:11,280 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19504
+ 2022-01-27 18:33:11,962 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19505
+ 2022-01-27 18:33:13,963 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19506
+ 2022-01-27 18:33:15,965 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19507
+ 2022-01-27 18:33:17,745 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
19508
+ 2022-01-27 18:33:17,820 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
19509
+ 2022-01-27 18:33:17,850 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
19510
+ 2022-01-27 18:33:17,967 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
19511
+ 2022-01-27 18:33:17,967 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19512
+ 2022-01-27 18:33:19,969 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19513
+ 2022-01-27 18:33:21,970 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19514
+ 2022-01-27 18:33:23,972 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19515
+ 2022-01-27 18:33:25,974 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19516
+ 2022-01-27 18:33:26,495 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19517
+ 2022-01-27 18:33:26,496 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19518
+ 2022-01-27 18:33:27,976 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19519
+ 2022-01-27 18:33:29,978 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19520
+ 2022-01-27 18:33:30,513 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19521
+ 2022-01-27 18:33:31,980 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19522
+ 2022-01-27 18:33:33,981 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19523
+ 2022-01-27 18:33:35,983 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19524
+ 2022-01-27 18:33:37,985 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19525
+ 2022-01-27 18:33:39,987 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19526
+ 2022-01-27 18:33:41,731 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19527
+ 2022-01-27 18:33:41,731 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19528
+ 2022-01-27 18:33:41,989 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19529
+ 2022-01-27 18:33:43,991 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19530
+ 2022-01-27 18:33:45,993 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19531
+ 2022-01-27 18:33:47,995 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19532
+ 2022-01-27 18:33:49,997 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19533
+ 2022-01-27 18:33:51,999 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19534
+ 2022-01-27 18:33:54,001 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19535
+ 2022-01-27 18:33:56,003 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19536
+ 2022-01-27 18:33:56,900 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19537
+ 2022-01-27 18:33:56,901 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19538
+ 2022-01-27 18:33:58,005 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19539
+ 2022-01-27 18:34:00,007 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19540
+ 2022-01-27 18:34:00,731 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19541
+ 2022-01-27 18:34:02,009 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19542
+ 2022-01-27 18:34:04,011 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19543
+ 2022-01-27 18:34:06,012 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19544
+ 2022-01-27 18:34:08,014 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19545
+ 2022-01-27 18:34:11,017 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19546
+ 2022-01-27 18:34:12,077 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19547
+ 2022-01-27 18:34:12,077 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19548
+ 2022-01-27 18:34:13,019 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19549
+ 2022-01-27 18:34:15,021 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19550
+ 2022-01-27 18:34:17,023 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19551
+ 2022-01-27 18:34:19,025 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19552
+ 2022-01-27 18:34:21,027 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19553
+ 2022-01-27 18:34:23,029 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19554
+ 2022-01-27 18:34:25,031 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19555
+ 2022-01-27 18:34:27,033 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19556
+ 2022-01-27 18:34:27,266 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19557
+ 2022-01-27 18:34:27,267 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19558
+ 2022-01-27 18:34:29,035 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19559
+ 2022-01-27 18:34:30,948 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19560
+ 2022-01-27 18:34:31,037 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19561
+ 2022-01-27 18:34:33,039 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19562
+ 2022-01-27 18:34:35,041 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19563
+ 2022-01-27 18:34:39,044 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19564
+ 2022-01-27 18:34:41,046 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19565
+ 2022-01-27 18:34:42,509 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19566
+ 2022-01-27 18:34:42,510 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19567
+ 2022-01-27 18:34:43,048 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19568
+ 2022-01-27 18:34:45,050 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19569
+ 2022-01-27 18:34:47,053 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19570
+ 2022-01-27 18:34:49,055 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19571
+ 2022-01-27 18:34:51,056 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19572
+ 2022-01-27 18:34:53,058 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19573
+ 2022-01-27 18:34:55,061 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19574
+ 2022-01-27 18:34:57,062 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19575
+ 2022-01-27 18:34:57,681 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19576
+ 2022-01-27 18:34:57,681 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19577
+ 2022-01-27 18:34:59,064 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19578
+ 2022-01-27 18:35:01,066 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19579
+ 2022-01-27 18:35:01,164 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19580
+ 2022-01-27 18:35:03,068 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19581
+ 2022-01-27 18:35:05,069 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19582
+ 2022-01-27 18:35:07,071 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19583
+ 2022-01-27 18:35:09,073 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19584
+ 2022-01-27 18:35:11,074 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19585
+ 2022-01-27 18:35:12,916 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19586
+ 2022-01-27 18:35:12,916 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19587
+ 2022-01-27 18:35:13,076 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19588
+ 2022-01-27 18:35:15,077 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19589
+ 2022-01-27 18:35:17,079 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19590
+ 2022-01-27 18:35:19,080 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19591
+ 2022-01-27 18:35:21,082 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19592
+ 2022-01-27 18:35:23,084 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19593
+ 2022-01-27 18:35:23,634 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
19594
+ 2022-01-27 18:35:23,737 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
19595
+ 2022-01-27 18:35:23,767 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
19596
+ 2022-01-27 18:35:24,085 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
19597
+ 2022-01-27 18:35:24,085 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19598
+ 2022-01-27 18:35:25,086 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19599
+ 2022-01-27 18:35:27,088 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19600
+ 2022-01-27 18:35:28,100 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19601
+ 2022-01-27 18:35:28,101 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19602
+ 2022-01-27 18:35:29,089 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19603
+ 2022-01-27 18:35:31,091 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19604
+ 2022-01-27 18:35:31,389 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19605
+ 2022-01-27 18:35:33,093 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19606
+ 2022-01-27 18:35:35,095 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19607
+ 2022-01-27 18:35:37,097 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19608
+ 2022-01-27 18:35:39,099 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19609
+ 2022-01-27 18:35:41,100 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19610
+ 2022-01-27 18:35:43,103 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19611
+ 2022-01-27 18:35:43,290 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19612
+ 2022-01-27 18:35:43,291 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19613
+ 2022-01-27 18:35:45,105 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19614
+ 2022-01-27 18:35:47,107 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19615
+ 2022-01-27 18:35:49,109 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19616
+ 2022-01-27 18:35:51,110 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19617
+ 2022-01-27 18:35:53,112 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19618
+ 2022-01-27 18:35:55,114 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19619
+ 2022-01-27 18:35:57,116 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19620
+ 2022-01-27 18:35:58,455 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19621
+ 2022-01-27 18:35:58,456 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19622
+ 2022-01-27 18:36:00,119 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19623
+ 2022-01-27 18:36:01,623 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19624
+ 2022-01-27 18:36:02,120 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19625
+ 2022-01-27 18:36:04,122 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19626
+ 2022-01-27 18:36:06,123 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19627
+ 2022-01-27 18:36:08,125 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19628
+ 2022-01-27 18:36:10,126 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19629
+ 2022-01-27 18:36:12,128 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19630
+ 2022-01-27 18:36:13,638 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19631
+ 2022-01-27 18:36:13,639 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19632
+ 2022-01-27 18:36:14,129 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19633
+ 2022-01-27 18:36:16,129 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19634
+ 2022-01-27 18:36:18,131 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19635
+ 2022-01-27 18:36:20,132 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19636
+ 2022-01-27 18:36:22,141 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19637
+ 2022-01-27 18:36:24,142 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19638
+ 2022-01-27 18:36:26,144 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19639
+ 2022-01-27 18:36:28,145 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19640
+ 2022-01-27 18:36:28,816 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19641
+ 2022-01-27 18:36:28,816 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19642
+ 2022-01-27 18:36:30,146 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19643
+ 2022-01-27 18:36:31,918 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19644
+ 2022-01-27 18:36:32,148 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19645
+ 2022-01-27 18:36:36,150 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19646
+ 2022-01-27 18:36:38,152 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19647
+ 2022-01-27 18:36:40,153 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19648
+ 2022-01-27 18:36:42,155 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19649
+ 2022-01-27 18:36:43,993 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19650
+ 2022-01-27 18:36:43,994 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19651
+ 2022-01-27 18:36:44,157 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19652
+ 2022-01-27 18:36:46,158 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19653
+ 2022-01-27 18:36:48,160 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19654
+ 2022-01-27 18:36:50,162 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19655
+ 2022-01-27 18:36:52,164 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19656
+ 2022-01-27 18:36:54,165 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19657
+ 2022-01-27 18:36:56,167 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19658
+ 2022-01-27 18:36:58,169 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19659
+ 2022-01-27 18:36:59,194 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19660
+ 2022-01-27 18:36:59,195 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19661
+ 2022-01-27 18:37:00,171 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19662
+ 2022-01-27 18:37:02,148 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19663
+ 2022-01-27 18:37:02,173 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19664
+ 2022-01-27 18:37:04,175 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19665
+ 2022-01-27 18:37:06,178 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19666
+ 2022-01-27 18:37:08,180 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19667
+ 2022-01-27 18:37:10,182 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19668
+ 2022-01-27 18:37:12,184 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19669
+ 2022-01-27 18:37:14,186 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19670
+ 2022-01-27 18:37:14,364 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19671
+ 2022-01-27 18:37:14,364 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19672
+ 2022-01-27 18:37:16,188 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19673
+ 2022-01-27 18:37:18,190 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19674
+ 2022-01-27 18:37:20,192 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19675
+ 2022-01-27 18:37:22,193 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19676
+ 2022-01-27 18:37:24,195 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19677
+ 2022-01-27 18:37:26,196 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19678
+ 2022-01-27 18:37:28,197 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19679
+ 2022-01-27 18:37:28,660 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
19680
+ 2022-01-27 18:37:28,712 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
19681
+ 2022-01-27 18:37:28,740 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
19682
+ 2022-01-27 18:37:29,198 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
19683
+ 2022-01-27 18:37:29,572 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19684
+ 2022-01-27 18:37:29,573 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19685
+ 2022-01-27 18:37:30,199 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19686
+ 2022-01-27 18:37:32,200 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19687
+ 2022-01-27 18:37:32,380 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19688
+ 2022-01-27 18:37:34,201 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19689
+ 2022-01-27 18:37:38,204 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19690
+ 2022-01-27 18:37:40,206 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19691
+ 2022-01-27 18:37:42,208 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19692
+ 2022-01-27 18:37:44,210 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19693
+ 2022-01-27 18:37:44,818 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19694
+ 2022-01-27 18:37:44,819 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19695
+ 2022-01-27 18:37:46,212 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19696
+ 2022-01-27 18:37:48,214 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19697
+ 2022-01-27 18:37:50,216 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19698
+ 2022-01-27 18:37:52,217 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19699
+ 2022-01-27 18:37:54,219 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19700
+ 2022-01-27 18:37:57,222 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19701
+ 2022-01-27 18:37:59,224 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19702
+ 2022-01-27 18:38:00,033 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19703
+ 2022-01-27 18:38:00,034 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19704
+ 2022-01-27 18:38:01,226 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19705
+ 2022-01-27 18:38:02,603 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19706
+ 2022-01-27 18:38:03,228 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19707
+ 2022-01-27 18:38:05,230 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19708
+ 2022-01-27 18:38:07,232 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19709
+ 2022-01-27 18:38:09,234 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19710
+ 2022-01-27 18:38:11,235 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19711
+ 2022-01-27 18:38:13,236 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19712
+ 2022-01-27 18:38:15,201 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19713
+ 2022-01-27 18:38:15,201 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19714
+ 2022-01-27 18:38:15,237 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19715
+ 2022-01-27 18:38:17,238 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19716
+ 2022-01-27 18:38:19,239 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19717
+ 2022-01-27 18:38:21,240 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19718
+ 2022-01-27 18:38:23,241 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19719
+ 2022-01-27 18:38:25,242 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19720
+ 2022-01-27 18:38:27,244 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19721
+ 2022-01-27 18:38:29,245 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19722
+ 2022-01-27 18:38:30,369 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19723
+ 2022-01-27 18:38:30,370 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19724
+ 2022-01-27 18:38:31,246 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19725
+ 2022-01-27 18:38:32,826 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19726
+ 2022-01-27 18:38:33,248 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19727
+ 2022-01-27 18:38:35,249 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19728
+ 2022-01-27 18:38:37,251 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19729
+ 2022-01-27 18:38:41,252 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19730
+ 2022-01-27 18:38:43,254 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19731
+ 2022-01-27 18:38:45,255 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19732
+ 2022-01-27 18:38:45,539 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19733
+ 2022-01-27 18:38:45,540 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19734
+ 2022-01-27 18:38:47,257 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19735
+ 2022-01-27 18:38:49,258 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19736
+ 2022-01-27 18:38:51,259 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19737
+ 2022-01-27 18:38:53,260 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19738
+ 2022-01-27 18:38:55,261 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19739
+ 2022-01-27 18:38:57,263 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19740
+ 2022-01-27 18:38:59,264 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19741
+ 2022-01-27 18:39:00,758 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19742
+ 2022-01-27 18:39:00,759 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19743
+ 2022-01-27 18:39:01,266 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19744
+ 2022-01-27 18:39:03,042 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19745
+ 2022-01-27 18:39:03,267 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19746
+ 2022-01-27 18:39:05,268 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19747
+ 2022-01-27 18:39:07,269 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19748
+ 2022-01-27 18:39:09,271 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19749
+ 2022-01-27 18:39:11,272 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19750
+ 2022-01-27 18:39:13,274 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19751
+ 2022-01-27 18:39:15,275 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19752
+ 2022-01-27 18:39:15,974 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19753
+ 2022-01-27 18:39:15,975 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19754
+ 2022-01-27 18:39:17,276 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19755
+ 2022-01-27 18:39:19,278 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19756
+ 2022-01-27 18:39:21,279 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19757
+ 2022-01-27 18:39:23,281 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19758
+ 2022-01-27 18:39:25,283 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19759
+ 2022-01-27 18:39:27,284 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19760
+ 2022-01-27 18:39:29,286 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19761
+ 2022-01-27 18:39:31,157 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19762
+ 2022-01-27 18:39:31,157 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19763
+ 2022-01-27 18:39:31,287 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19764
+ 2022-01-27 18:39:33,242 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19765
+ 2022-01-27 18:39:33,288 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19766
+ 2022-01-27 18:39:33,580 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
19767
+ 2022-01-27 18:39:33,668 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
19768
+ 2022-01-27 18:39:33,698 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
19769
+ 2022-01-27 18:39:34,289 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
19770
+ 2022-01-27 18:39:35,289 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19771
+ 2022-01-27 18:39:37,291 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19772
+ 2022-01-27 18:39:39,292 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19773
+ 2022-01-27 18:39:41,293 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19774
+ 2022-01-27 18:39:43,294 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19775
+ 2022-01-27 18:39:45,296 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19776
+ 2022-01-27 18:39:46,339 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19777
+ 2022-01-27 18:39:46,340 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19778
+ 2022-01-27 18:39:47,298 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19779
+ 2022-01-27 18:39:49,300 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19780
+ 2022-01-27 18:39:51,302 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19781
+ 2022-01-27 18:39:53,304 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19782
+ 2022-01-27 18:39:55,306 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19783
+ 2022-01-27 18:39:57,308 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19784
+ 2022-01-27 18:39:59,309 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19785
+ 2022-01-27 18:40:01,594 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19786
+ 2022-01-27 18:40:01,594 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19787
+ 2022-01-27 18:40:02,311 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19788
+ 2022-01-27 18:40:03,473 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19789
+ 2022-01-27 18:40:04,312 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19790
+ 2022-01-27 18:40:06,314 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19791
+ 2022-01-27 18:40:08,315 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19792
+ 2022-01-27 18:40:10,317 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19793
+ 2022-01-27 18:40:12,319 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19794
+ 2022-01-27 18:40:14,320 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19795
+ 2022-01-27 18:40:16,322 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19796
+ 2022-01-27 18:40:16,788 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19797
+ 2022-01-27 18:40:16,788 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19798
+ 2022-01-27 18:40:18,324 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19799
+ 2022-01-27 18:40:20,326 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19800
+ 2022-01-27 18:40:22,328 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19801
+ 2022-01-27 18:40:24,330 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19802
+ 2022-01-27 18:40:26,332 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19803
+ 2022-01-27 18:40:28,334 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19804
+ 2022-01-27 18:40:30,336 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19805
+ 2022-01-27 18:40:31,984 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19806
+ 2022-01-27 18:40:31,985 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19807
+ 2022-01-27 18:40:32,338 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19808
+ 2022-01-27 18:40:33,715 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19809
+ 2022-01-27 18:40:34,340 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19810
+ 2022-01-27 18:40:36,342 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19811
+ 2022-01-27 18:40:38,343 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19812
+ 2022-01-27 18:40:40,345 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19813
+ 2022-01-27 18:40:42,347 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19814
+ 2022-01-27 18:40:44,349 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19815
+ 2022-01-27 18:40:46,351 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19816
+ 2022-01-27 18:40:47,227 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19817
+ 2022-01-27 18:40:47,228 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19818
+ 2022-01-27 18:40:48,353 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19819
+ 2022-01-27 18:40:50,356 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19820
+ 2022-01-27 18:40:52,357 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19821
+ 2022-01-27 18:40:54,359 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19822
+ 2022-01-27 18:40:56,361 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19823
+ 2022-01-27 18:40:58,363 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19824
+ 2022-01-27 18:41:00,365 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19825
+ 2022-01-27 18:41:02,367 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19826
+ 2022-01-27 18:41:02,408 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19827
+ 2022-01-27 18:41:02,409 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19828
+ 2022-01-27 18:41:03,989 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19829
+ 2022-01-27 18:41:04,368 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19830
+ 2022-01-27 18:41:06,370 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19831
+ 2022-01-27 18:41:08,372 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19832
+ 2022-01-27 18:41:10,373 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19833
+ 2022-01-27 18:41:12,375 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19834
+ 2022-01-27 18:41:14,377 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19835
+ 2022-01-27 18:41:16,379 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19836
+ 2022-01-27 18:41:17,618 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19837
+ 2022-01-27 18:41:17,619 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19838
+ 2022-01-27 18:41:18,381 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19839
+ 2022-01-27 18:41:20,383 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19840
+ 2022-01-27 18:41:22,385 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19841
+ 2022-01-27 18:41:24,387 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19842
+ 2022-01-27 18:41:26,389 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19843
+ 2022-01-27 18:41:28,391 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19844
+ 2022-01-27 18:41:31,394 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19845
+ 2022-01-27 18:41:32,847 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19846
+ 2022-01-27 18:41:32,848 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19847
+ 2022-01-27 18:41:33,396 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19848
+ 2022-01-27 18:41:34,262 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19849
+ 2022-01-27 18:41:35,398 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19850
+ 2022-01-27 18:41:37,400 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19851
+ 2022-01-27 18:41:39,402 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19852
+ 2022-01-27 18:41:41,404 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19853
+ 2022-01-27 18:41:43,406 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19854
+ 2022-01-27 18:41:43,569 DEBUG SenderThread:1977561 [sender.py:send():234] send: history
19855
+ 2022-01-27 18:41:43,603 DEBUG SenderThread:1977561 [sender.py:send():234] send: summary
19856
+ 2022-01-27 18:41:43,647 INFO SenderThread:1977561 [sender.py:_save_file():939] saving file wandb-summary.json with policy end
19857
+ 2022-01-27 18:41:44,407 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/wandb-summary.json
19858
+ 2022-01-27 18:41:45,408 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19859
+ 2022-01-27 18:41:47,410 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19860
+ 2022-01-27 18:41:48,082 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19861
+ 2022-01-27 18:41:48,084 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19862
+ 2022-01-27 18:41:55,416 INFO Thread-8 :1977561 [dir_watcher.py:_on_file_modified():230] file/dir modified: /workspace/xls-r-300m-sv-robust/wandb/run-20220127_103723-scy0vyln/files/output.log
19863
+ 2022-01-27 18:42:03,255 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19864
+ 2022-01-27 18:42:03,256 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19865
+ 2022-01-27 18:42:04,504 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19866
+ 2022-01-27 18:42:18,430 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19867
+ 2022-01-27 18:42:18,430 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19868
+ 2022-01-27 18:42:33,605 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19869
+ 2022-01-27 18:42:33,605 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19870
+ 2022-01-27 18:42:34,733 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
19871
+ 2022-01-27 18:42:48,784 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19872
+ 2022-01-27 18:42:48,784 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19873
+ 2022-01-27 18:43:03,958 DEBUG HandlerThread:1977561 [handler.py:handle_request():130] handle_request: stop_status
19874
+ 2022-01-27 18:43:03,958 DEBUG SenderThread:1977561 [sender.py:send_request():248] send_request: stop_status
19875
+ 2022-01-27 18:43:04,956 DEBUG SenderThread:1977561 [sender.py:send():234] send: stats
wandb/run-20220127_103723-scy0vyln/run-scy0vyln.wandb CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7f9addee8f5f1227e21f96c82846c96ef50ee61ebe9d97fef99bec9766f6c2d0
3
- size 112988181
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29b63e3899b328d9159cd9ee6e876a5619e86e3b459ce75243329b27d04af164
3
+ size 116375847