hf-test commited on
Commit
c4cb3ed
1 Parent(s): 9d4de48

Training in progress, step 2000

Browse files
.gitattributes CHANGED
@@ -25,3 +25,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
25
  *.zip filter=lfs diff=lfs merge=lfs -text
26
  *.zstandard filter=lfs diff=lfs merge=lfs -text
27
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
25
  *.zip filter=lfs diff=lfs merge=lfs -text
26
  *.zstandard filter=lfs diff=lfs merge=lfs -text
27
  *tfevents* filter=lfs diff=lfs merge=lfs -text
28
+ wandb/run-20220109_220240-1g372i3v/run-1g372i3v.wandb filter=lfs diff=lfs merge=lfs -text
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cf7e3f5f04c6f8f239d7c52edf050af109a843d72183237787fc3438afd897c1
3
  size 1262075377
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7916347afbc1f12825df8dbd1d41e44150bfdd90f965ffaa410cfb4e5c8fe60b
3
  size 1262075377
runs/Jan09_22-00-50_brutasse/events.out.tfevents.1641765760.brutasse.31164.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4dd4b35898cffe3895a85b9924d08e49287cc7b3224beebb236d07417952570d
3
- size 7964
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed1cd753346517710778a82ed1a9169ac2af607e84d52880cf75f53f490db34a
3
+ size 9067
wandb/run-20220109_220240-1g372i3v/files/output.log CHANGED
@@ -1167,3 +1167,397 @@ Configuration saved in ./preprocessor_config.json
1167
  Configuration saved in ./checkpoint-1500/config.json
1168
  Model weights saved in ./checkpoint-1500/pytorch_model.bin
1169
  Configuration saved in ./checkpoint-1500/preprocessor_config.json
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1167
  Configuration saved in ./checkpoint-1500/config.json
1168
  Model weights saved in ./checkpoint-1500/pytorch_model.bin
1169
  Configuration saved in ./checkpoint-1500/preprocessor_config.json
1170
+ Configuration saved in ./preprocessor_config.json
1171
+ /home/patrick/python_bin/transformers/models/wav2vec2/modeling_wav2vec2.py:1107: UserWarning: __floordiv__ is deprecated, and its behavior will change in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor').
1172
+ return (input_length - kernel_size) // stride + 1
1173
+
1174
+
1175
+
1176
+
1177
+
1178
+
1179
+
1180
+
1181
+
1182
+
1183
+
1184
+
1185
+
1186
+
1187
+
1188
+
1189
+
1190
+
1191
+
1192
+
1193
+
1194
+
1195
+
1196
+
1197
+
1198
+
1199
+
1200
+
1201
+
1202
+
1203
+
1204
+
1205
+
1206
+
1207
+
1208
+
1209
+
1210
+
1211
+
1212
+
1213
+
1214
+
1215
+
1216
+
1217
+
1218
+
1219
+
1220
+
1221
+
1222
+
1223
+
1224
+
1225
+
1226
+
1227
+
1228
+
1229
+
1230
+
1231
+
1232
+
1233
+
1234
+ 9%|████▋ | 1601/17200 [42:34<4:05:44, 1.06it/s]
1235
+
1236
+
1237
+
1238
+
1239
+
1240
+
1241
+
1242
+
1243
+
1244
+
1245
+
1246
+
1247
+
1248
+
1249
+
1250
+
1251
+
1252
+
1253
+
1254
+
1255
+
1256
+
1257
+
1258
+
1259
+
1260
+
1261
+
1262
+
1263
+
1264
+
1265
+
1266
+
1267
+
1268
+
1269
+
1270
+
1271
+
1272
+
1273
+
1274
+
1275
+
1276
+
1277
+
1278
+
1279
+
1280
+
1281
+
1282
+
1283
+
1284
+
1285
+
1286
+
1287
+
1288
+
1289
+
1290
+
1291
+
1292
+
1293
+
1294
+
1295
+ 10%|█████ | 1699/17200 [44:37<4:54:18, 1.14s/it]
1296
+
1297
+
1298
+
1299
+
1300
+
1301
+
1302
+
1303
+
1304
+
1305
+
1306
+
1307
+
1308
+
1309
+
1310
+
1311
+
1312
+
1313
+
1314
+
1315
+
1316
+
1317
+
1318
+
1319
+
1320
+
1321
+
1322
+
1323
+
1324
+
1325
+
1326
+
1327
+
1328
+
1329
+
1330
+
1331
+
1332
+
1333
+
1334
+
1335
+
1336
+
1337
+
1338
+
1339
+
1340
+
1341
+
1342
+
1343
+
1344
+
1345
+
1346
+
1347
+
1348
+
1349
+
1350
+
1351
+
1352
+
1353
+
1354
+
1355
+
1356
+
1357
+
1358
+
1359
+ 10%|█████▎ | 1800/17200 [46:44<5:56:45, 1.39s/it]
1360
+
1361
+
1362
+
1363
+
1364
+
1365
+
1366
+
1367
+
1368
+
1369
+
1370
+
1371
+
1372
+
1373
+
1374
+
1375
+
1376
+
1377
+
1378
+
1379
+
1380
+
1381
+
1382
+
1383
+
1384
+
1385
+
1386
+
1387
+
1388
+
1389
+
1390
+
1391
+
1392
+
1393
+
1394
+
1395
+
1396
+
1397
+
1398
+
1399
+
1400
+
1401
+
1402
+
1403
+
1404
+
1405
+
1406
+
1407
+
1408
+
1409
+
1410
+
1411
+
1412
+
1413
+
1414
+
1415
+
1416
+
1417
+
1418
+
1419
+
1420
+
1421
+ 11%|█████▋ | 1899/17200 [48:47<5:59:17, 1.41s/it]
1422
+
1423
+
1424
+
1425
+
1426
+
1427
+
1428
+
1429
+
1430
+
1431
+
1432
+
1433
+
1434
+
1435
+
1436
+
1437
+
1438
+
1439
+
1440
+
1441
+
1442
+
1443
+
1444
+
1445
+
1446
+
1447
+
1448
+
1449
+
1450
+
1451
+
1452
+
1453
+
1454
+
1455
+
1456
+
1457
+
1458
+
1459
+
1460
+
1461
+
1462
+
1463
+
1464
+
1465
+
1466
+
1467
+
1468
+
1469
+
1470
+
1471
+
1472
+
1473
+
1474
+
1475
+
1476
+
1477
+
1478
+
1479
+
1480
+
1481
+
1482
+
1483
+ 12%|█████▉ | 2000/17200 [50:52<5:47:30, 1.37s/it]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length.
1484
+ ***** Running Evaluation *****
1485
+ Num examples = 4620
1486
+ Batch size = 8
1487
+ 0%| | 0/578 [00:00<?, ?it/s]
1488
+
1489
+
1490
+
1491
+
1492
+
1493
+
1494
+
1495
+
1496
+
1497
+
1498
+
1499
+
1500
+
1501
+
1502
+
1503
+
1504
+
1505
+
1506
+
1507
+
1508
+
1509
+
1510
+
1511
+
1512
+
1513
+
1514
+
1515
+
1516
+
1517
+
1518
+
1519
+
1520
+
1521
+
1522
+
1523
+
1524
+
1525
+
1526
+
1527
+
1528
+
1529
+
1530
+
1531
+
1532
+
1533
+
1534
+
1535
+
1536
+
1537
+
1538
+
1539
+
1540
+
1541
+
1542
+
1543
+
1544
+
1545
+
1546
+
1547
+
1548
+
1549
+
1550
+
1551
+
1552
+
1553
+
1554
+
1555
+
1556
+
1557
+ 100%|████████████████████████████████████████████████████████| 578/578 [02:19<00:00, 4.30it/s]
1558
+
1559
+ Configuration saved in ./checkpoint-2000/config.json
1560
+ Model weights saved in ./checkpoint-2000/pytorch_model.bin
1561
+ Configuration saved in ./checkpoint-2000/preprocessor_config.json
1562
+ Configuration saved in ./preprocessor_config.json
1563
+ Adding files tracked by Git LFS: ['wandb/run-20220109_220240-1g372i3v/run-1g372i3v.wandb']. This may take a bit of time if the files are large.
wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json CHANGED
The diff for this file is too large to render. See raw diff
wandb/run-20220109_220240-1g372i3v/logs/debug-internal.log CHANGED
@@ -2850,3 +2850,543 @@
2850
  2022-01-09 22:43:00,077 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
2851
  2022-01-09 22:43:05,154 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2852
  2022-01-09 22:43:05,155 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2850
  2022-01-09 22:43:00,077 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
2851
  2022-01-09 22:43:05,154 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2852
  2022-01-09 22:43:05,155 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2853
+ 2022-01-09 22:43:19,102 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2854
+ 2022-01-09 22:43:20,229 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2855
+ 2022-01-09 22:43:20,229 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2856
+ 2022-01-09 22:43:21,103 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2857
+ 2022-01-09 22:43:23,103 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2858
+ 2022-01-09 22:43:25,103 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2859
+ 2022-01-09 22:43:27,103 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2860
+ 2022-01-09 22:43:29,104 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2861
+ 2022-01-09 22:43:30,337 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
2862
+ 2022-01-09 22:43:31,104 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2863
+ 2022-01-09 22:43:33,104 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2864
+ 2022-01-09 22:43:35,105 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2865
+ 2022-01-09 22:43:35,309 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2866
+ 2022-01-09 22:43:35,309 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2867
+ 2022-01-09 22:43:37,105 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2868
+ 2022-01-09 22:43:39,105 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2869
+ 2022-01-09 22:43:41,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2870
+ 2022-01-09 22:43:43,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2871
+ 2022-01-09 22:43:45,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2872
+ 2022-01-09 22:43:47,106 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2873
+ 2022-01-09 22:43:49,107 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2874
+ 2022-01-09 22:43:50,498 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2875
+ 2022-01-09 22:43:50,498 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2876
+ 2022-01-09 22:43:51,107 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2877
+ 2022-01-09 22:43:53,108 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2878
+ 2022-01-09 22:43:55,108 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2879
+ 2022-01-09 22:43:57,108 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2880
+ 2022-01-09 22:43:59,109 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2881
+ 2022-01-09 22:44:00,569 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
2882
+ 2022-01-09 22:44:01,109 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2883
+ 2022-01-09 22:44:03,109 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2884
+ 2022-01-09 22:44:05,110 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2885
+ 2022-01-09 22:44:05,667 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2886
+ 2022-01-09 22:44:05,668 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2887
+ 2022-01-09 22:44:07,110 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2888
+ 2022-01-09 22:44:09,110 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2889
+ 2022-01-09 22:44:11,111 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2890
+ 2022-01-09 22:44:13,111 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2891
+ 2022-01-09 22:44:16,111 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2892
+ 2022-01-09 22:44:18,112 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2893
+ 2022-01-09 22:44:20,112 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2894
+ 2022-01-09 22:44:20,737 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2895
+ 2022-01-09 22:44:20,737 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2896
+ 2022-01-09 22:44:22,113 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2897
+ 2022-01-09 22:44:24,113 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2898
+ 2022-01-09 22:44:26,113 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2899
+ 2022-01-09 22:44:28,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2900
+ 2022-01-09 22:44:30,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2901
+ 2022-01-09 22:44:30,798 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
2902
+ 2022-01-09 22:44:32,114 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2903
+ 2022-01-09 22:44:34,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2904
+ 2022-01-09 22:44:35,804 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2905
+ 2022-01-09 22:44:35,804 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2906
+ 2022-01-09 22:44:36,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2907
+ 2022-01-09 22:44:38,115 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2908
+ 2022-01-09 22:44:40,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2909
+ 2022-01-09 22:44:42,116 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2910
+ 2022-01-09 22:44:44,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2911
+ 2022-01-09 22:44:46,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2912
+ 2022-01-09 22:44:48,117 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2913
+ 2022-01-09 22:44:50,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2914
+ 2022-01-09 22:44:50,991 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2915
+ 2022-01-09 22:44:50,991 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2916
+ 2022-01-09 22:44:52,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2917
+ 2022-01-09 22:44:54,118 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2918
+ 2022-01-09 22:44:56,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2919
+ 2022-01-09 22:44:58,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2920
+ 2022-01-09 22:45:00,119 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2921
+ 2022-01-09 22:45:01,043 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
2922
+ 2022-01-09 22:45:02,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2923
+ 2022-01-09 22:45:04,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2924
+ 2022-01-09 22:45:06,101 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2925
+ 2022-01-09 22:45:06,101 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2926
+ 2022-01-09 22:45:06,120 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2927
+ 2022-01-09 22:45:08,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2928
+ 2022-01-09 22:45:10,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2929
+ 2022-01-09 22:45:12,121 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2930
+ 2022-01-09 22:45:14,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2931
+ 2022-01-09 22:45:16,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2932
+ 2022-01-09 22:45:18,122 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2933
+ 2022-01-09 22:45:20,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2934
+ 2022-01-09 22:45:20,896 DEBUG SenderThread:31514 [sender.py:send():182] send: history
2935
+ 2022-01-09 22:45:20,940 DEBUG SenderThread:31514 [sender.py:send():182] send: summary
2936
+ 2022-01-09 22:45:20,970 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
2937
+ 2022-01-09 22:45:21,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json
2938
+ 2022-01-09 22:45:21,175 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2939
+ 2022-01-09 22:45:21,175 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2940
+ 2022-01-09 22:45:22,123 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2941
+ 2022-01-09 22:45:24,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2942
+ 2022-01-09 22:45:26,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2943
+ 2022-01-09 22:45:28,124 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2944
+ 2022-01-09 22:45:30,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2945
+ 2022-01-09 22:45:31,282 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
2946
+ 2022-01-09 22:45:32,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2947
+ 2022-01-09 22:45:34,125 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2948
+ 2022-01-09 22:45:36,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2949
+ 2022-01-09 22:45:36,270 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2950
+ 2022-01-09 22:45:36,270 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2951
+ 2022-01-09 22:45:38,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2952
+ 2022-01-09 22:45:40,126 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2953
+ 2022-01-09 22:45:42,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2954
+ 2022-01-09 22:45:44,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2955
+ 2022-01-09 22:45:46,127 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2956
+ 2022-01-09 22:45:48,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2957
+ 2022-01-09 22:45:50,128 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2958
+ 2022-01-09 22:45:51,337 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2959
+ 2022-01-09 22:45:51,337 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2960
+ 2022-01-09 22:45:53,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2961
+ 2022-01-09 22:45:55,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2962
+ 2022-01-09 22:45:57,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2963
+ 2022-01-09 22:45:59,129 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2964
+ 2022-01-09 22:46:01,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2965
+ 2022-01-09 22:46:01,519 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
2966
+ 2022-01-09 22:46:03,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2967
+ 2022-01-09 22:46:05,130 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2968
+ 2022-01-09 22:46:06,448 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2969
+ 2022-01-09 22:46:06,448 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2970
+ 2022-01-09 22:46:07,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2971
+ 2022-01-09 22:46:09,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2972
+ 2022-01-09 22:46:11,131 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2973
+ 2022-01-09 22:46:13,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2974
+ 2022-01-09 22:46:15,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2975
+ 2022-01-09 22:46:17,132 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2976
+ 2022-01-09 22:46:19,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2977
+ 2022-01-09 22:46:21,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2978
+ 2022-01-09 22:46:21,557 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2979
+ 2022-01-09 22:46:21,557 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2980
+ 2022-01-09 22:46:23,133 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2981
+ 2022-01-09 22:46:25,134 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2982
+ 2022-01-09 22:46:29,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2983
+ 2022-01-09 22:46:31,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2984
+ 2022-01-09 22:46:31,760 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
2985
+ 2022-01-09 22:46:33,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2986
+ 2022-01-09 22:46:35,135 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2987
+ 2022-01-09 22:46:36,647 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2988
+ 2022-01-09 22:46:36,647 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2989
+ 2022-01-09 22:46:37,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2990
+ 2022-01-09 22:46:39,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2991
+ 2022-01-09 22:46:41,136 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2992
+ 2022-01-09 22:46:43,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2993
+ 2022-01-09 22:46:45,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2994
+ 2022-01-09 22:46:47,137 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2995
+ 2022-01-09 22:46:49,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2996
+ 2022-01-09 22:46:51,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
2997
+ 2022-01-09 22:46:51,770 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
2998
+ 2022-01-09 22:46:51,770 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
2999
+ 2022-01-09 22:46:53,138 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3000
+ 2022-01-09 22:46:55,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3001
+ 2022-01-09 22:46:57,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3002
+ 2022-01-09 22:46:59,139 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3003
+ 2022-01-09 22:47:01,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3004
+ 2022-01-09 22:47:01,996 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3005
+ 2022-01-09 22:47:03,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3006
+ 2022-01-09 22:47:05,140 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3007
+ 2022-01-09 22:47:06,879 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3008
+ 2022-01-09 22:47:06,879 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3009
+ 2022-01-09 22:47:07,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3010
+ 2022-01-09 22:47:09,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3011
+ 2022-01-09 22:47:11,141 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3012
+ 2022-01-09 22:47:13,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3013
+ 2022-01-09 22:47:15,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3014
+ 2022-01-09 22:47:17,142 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3015
+ 2022-01-09 22:47:19,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3016
+ 2022-01-09 22:47:21,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3017
+ 2022-01-09 22:47:21,964 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3018
+ 2022-01-09 22:47:21,964 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3019
+ 2022-01-09 22:47:23,143 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3020
+ 2022-01-09 22:47:25,087 DEBUG SenderThread:31514 [sender.py:send():182] send: history
3021
+ 2022-01-09 22:47:25,129 DEBUG SenderThread:31514 [sender.py:send():182] send: summary
3022
+ 2022-01-09 22:47:25,152 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json
3023
+ 2022-01-09 22:47:25,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3024
+ 2022-01-09 22:47:25,153 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
3025
+ 2022-01-09 22:47:27,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3026
+ 2022-01-09 22:47:29,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3027
+ 2022-01-09 22:47:31,153 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3028
+ 2022-01-09 22:47:32,231 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3029
+ 2022-01-09 22:47:33,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3030
+ 2022-01-09 22:47:35,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3031
+ 2022-01-09 22:47:37,043 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3032
+ 2022-01-09 22:47:37,044 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3033
+ 2022-01-09 22:47:37,154 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3034
+ 2022-01-09 22:47:39,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3035
+ 2022-01-09 22:47:41,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3036
+ 2022-01-09 22:47:43,155 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3037
+ 2022-01-09 22:47:45,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3038
+ 2022-01-09 22:47:47,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3039
+ 2022-01-09 22:47:49,156 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3040
+ 2022-01-09 22:47:52,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3041
+ 2022-01-09 22:47:52,297 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3042
+ 2022-01-09 22:47:52,297 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3043
+ 2022-01-09 22:47:54,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3044
+ 2022-01-09 22:47:56,157 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3045
+ 2022-01-09 22:47:58,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3046
+ 2022-01-09 22:48:00,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3047
+ 2022-01-09 22:48:02,158 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3048
+ 2022-01-09 22:48:02,467 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3049
+ 2022-01-09 22:48:04,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3050
+ 2022-01-09 22:48:06,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3051
+ 2022-01-09 22:48:07,454 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3052
+ 2022-01-09 22:48:07,454 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3053
+ 2022-01-09 22:48:08,159 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3054
+ 2022-01-09 22:48:10,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3055
+ 2022-01-09 22:48:12,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3056
+ 2022-01-09 22:48:14,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3057
+ 2022-01-09 22:48:16,160 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3058
+ 2022-01-09 22:48:18,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3059
+ 2022-01-09 22:48:20,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3060
+ 2022-01-09 22:48:22,161 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3061
+ 2022-01-09 22:48:22,529 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3062
+ 2022-01-09 22:48:22,529 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3063
+ 2022-01-09 22:48:24,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3064
+ 2022-01-09 22:48:26,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3065
+ 2022-01-09 22:48:28,162 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3066
+ 2022-01-09 22:48:30,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3067
+ 2022-01-09 22:48:32,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3068
+ 2022-01-09 22:48:32,698 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3069
+ 2022-01-09 22:48:34,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3070
+ 2022-01-09 22:48:36,163 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3071
+ 2022-01-09 22:48:37,644 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3072
+ 2022-01-09 22:48:37,645 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3073
+ 2022-01-09 22:48:38,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3074
+ 2022-01-09 22:48:40,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3075
+ 2022-01-09 22:48:42,164 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3076
+ 2022-01-09 22:48:44,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3077
+ 2022-01-09 22:48:46,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3078
+ 2022-01-09 22:48:48,165 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3079
+ 2022-01-09 22:48:50,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3080
+ 2022-01-09 22:48:52,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3081
+ 2022-01-09 22:48:52,714 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3082
+ 2022-01-09 22:48:52,714 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3083
+ 2022-01-09 22:48:54,166 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3084
+ 2022-01-09 22:48:56,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3085
+ 2022-01-09 22:48:58,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3086
+ 2022-01-09 22:49:00,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3087
+ 2022-01-09 22:49:02,167 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3088
+ 2022-01-09 22:49:02,921 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3089
+ 2022-01-09 22:49:04,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3090
+ 2022-01-09 22:49:06,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3091
+ 2022-01-09 22:49:07,789 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3092
+ 2022-01-09 22:49:07,789 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3093
+ 2022-01-09 22:49:08,168 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3094
+ 2022-01-09 22:49:11,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3095
+ 2022-01-09 22:49:13,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3096
+ 2022-01-09 22:49:15,169 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3097
+ 2022-01-09 22:49:17,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3098
+ 2022-01-09 22:49:19,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3099
+ 2022-01-09 22:49:21,170 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3100
+ 2022-01-09 22:49:22,906 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3101
+ 2022-01-09 22:49:22,906 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3102
+ 2022-01-09 22:49:23,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3103
+ 2022-01-09 22:49:25,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3104
+ 2022-01-09 22:49:27,171 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3105
+ 2022-01-09 22:49:29,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3106
+ 2022-01-09 22:49:31,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3107
+ 2022-01-09 22:49:31,564 DEBUG SenderThread:31514 [sender.py:send():182] send: history
3108
+ 2022-01-09 22:49:31,612 DEBUG SenderThread:31514 [sender.py:send():182] send: summary
3109
+ 2022-01-09 22:49:31,634 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
3110
+ 2022-01-09 22:49:32,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json
3111
+ 2022-01-09 22:49:33,157 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3112
+ 2022-01-09 22:49:33,172 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3113
+ 2022-01-09 22:49:35,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3114
+ 2022-01-09 22:49:37,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3115
+ 2022-01-09 22:49:38,027 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3116
+ 2022-01-09 22:49:38,027 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3117
+ 2022-01-09 22:49:39,173 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3118
+ 2022-01-09 22:49:41,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3119
+ 2022-01-09 22:49:43,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3120
+ 2022-01-09 22:49:45,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3121
+ 2022-01-09 22:49:47,174 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3122
+ 2022-01-09 22:49:49,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3123
+ 2022-01-09 22:49:51,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3124
+ 2022-01-09 22:49:53,116 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3125
+ 2022-01-09 22:49:53,116 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3126
+ 2022-01-09 22:49:53,175 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3127
+ 2022-01-09 22:49:55,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3128
+ 2022-01-09 22:49:57,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3129
+ 2022-01-09 22:49:59,176 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3130
+ 2022-01-09 22:50:01,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3131
+ 2022-01-09 22:50:03,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3132
+ 2022-01-09 22:50:03,392 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3133
+ 2022-01-09 22:50:05,177 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3134
+ 2022-01-09 22:50:07,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3135
+ 2022-01-09 22:50:08,209 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3136
+ 2022-01-09 22:50:08,209 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3137
+ 2022-01-09 22:50:09,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3138
+ 2022-01-09 22:50:11,178 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3139
+ 2022-01-09 22:50:13,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3140
+ 2022-01-09 22:50:15,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3141
+ 2022-01-09 22:50:17,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3142
+ 2022-01-09 22:50:19,179 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3143
+ 2022-01-09 22:50:21,180 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3144
+ 2022-01-09 22:50:23,180 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3145
+ 2022-01-09 22:50:23,315 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3146
+ 2022-01-09 22:50:23,315 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3147
+ 2022-01-09 22:50:25,180 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3148
+ 2022-01-09 22:50:27,181 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3149
+ 2022-01-09 22:50:29,181 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3150
+ 2022-01-09 22:50:31,181 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3151
+ 2022-01-09 22:50:33,182 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3152
+ 2022-01-09 22:50:33,624 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3153
+ 2022-01-09 22:50:35,182 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3154
+ 2022-01-09 22:50:37,182 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3155
+ 2022-01-09 22:50:38,393 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3156
+ 2022-01-09 22:50:38,393 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3157
+ 2022-01-09 22:50:39,183 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3158
+ 2022-01-09 22:50:41,183 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3159
+ 2022-01-09 22:50:43,183 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3160
+ 2022-01-09 22:50:45,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3161
+ 2022-01-09 22:50:47,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3162
+ 2022-01-09 22:50:49,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3163
+ 2022-01-09 22:50:51,184 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3164
+ 2022-01-09 22:50:53,185 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3165
+ 2022-01-09 22:50:53,479 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3166
+ 2022-01-09 22:50:53,479 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3167
+ 2022-01-09 22:50:55,185 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3168
+ 2022-01-09 22:50:57,185 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3169
+ 2022-01-09 22:50:59,186 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3170
+ 2022-01-09 22:51:01,186 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3171
+ 2022-01-09 22:51:03,186 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3172
+ 2022-01-09 22:51:03,858 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3173
+ 2022-01-09 22:51:05,187 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3174
+ 2022-01-09 22:51:07,187 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3175
+ 2022-01-09 22:51:08,559 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3176
+ 2022-01-09 22:51:08,559 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3177
+ 2022-01-09 22:51:09,187 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3178
+ 2022-01-09 22:51:11,188 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3179
+ 2022-01-09 22:51:13,188 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3180
+ 2022-01-09 22:51:15,188 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3181
+ 2022-01-09 22:51:18,189 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3182
+ 2022-01-09 22:51:20,189 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3183
+ 2022-01-09 22:51:22,189 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3184
+ 2022-01-09 22:51:23,631 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3185
+ 2022-01-09 22:51:23,631 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3186
+ 2022-01-09 22:51:24,190 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3187
+ 2022-01-09 22:51:26,190 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3188
+ 2022-01-09 22:51:28,190 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3189
+ 2022-01-09 22:51:30,191 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3190
+ 2022-01-09 22:51:32,191 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3191
+ 2022-01-09 22:51:34,084 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3192
+ 2022-01-09 22:51:34,191 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3193
+ 2022-01-09 22:51:35,340 DEBUG SenderThread:31514 [sender.py:send():182] send: history
3194
+ 2022-01-09 22:51:35,381 DEBUG SenderThread:31514 [sender.py:send():182] send: summary
3195
+ 2022-01-09 22:51:35,403 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
3196
+ 2022-01-09 22:51:36,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json
3197
+ 2022-01-09 22:51:36,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3198
+ 2022-01-09 22:51:37,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3199
+ 2022-01-09 22:51:38,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3200
+ 2022-01-09 22:51:38,727 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3201
+ 2022-01-09 22:51:38,728 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3202
+ 2022-01-09 22:51:40,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3203
+ 2022-01-09 22:51:42,192 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3204
+ 2022-01-09 22:51:44,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3205
+ 2022-01-09 22:51:46,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3206
+ 2022-01-09 22:51:48,193 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3207
+ 2022-01-09 22:51:50,194 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3208
+ 2022-01-09 22:51:52,194 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3209
+ 2022-01-09 22:51:53,823 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3210
+ 2022-01-09 22:51:53,823 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3211
+ 2022-01-09 22:51:54,194 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3212
+ 2022-01-09 22:51:56,195 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3213
+ 2022-01-09 22:51:58,195 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3214
+ 2022-01-09 22:52:00,195 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3215
+ 2022-01-09 22:52:02,196 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3216
+ 2022-01-09 22:52:04,196 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3217
+ 2022-01-09 22:52:04,315 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3218
+ 2022-01-09 22:52:06,196 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3219
+ 2022-01-09 22:52:08,197 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3220
+ 2022-01-09 22:52:08,927 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3221
+ 2022-01-09 22:52:08,927 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3222
+ 2022-01-09 22:52:10,197 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3223
+ 2022-01-09 22:52:12,197 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3224
+ 2022-01-09 22:52:14,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3225
+ 2022-01-09 22:52:16,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3226
+ 2022-01-09 22:52:18,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3227
+ 2022-01-09 22:52:20,198 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3228
+ 2022-01-09 22:52:22,199 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3229
+ 2022-01-09 22:52:24,035 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3230
+ 2022-01-09 22:52:24,035 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3231
+ 2022-01-09 22:52:24,199 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3232
+ 2022-01-09 22:52:26,199 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3233
+ 2022-01-09 22:52:28,200 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3234
+ 2022-01-09 22:52:30,200 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3235
+ 2022-01-09 22:52:32,200 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3236
+ 2022-01-09 22:52:34,201 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3237
+ 2022-01-09 22:52:34,545 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3238
+ 2022-01-09 22:52:36,201 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3239
+ 2022-01-09 22:52:38,201 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3240
+ 2022-01-09 22:52:39,117 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3241
+ 2022-01-09 22:52:39,117 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3242
+ 2022-01-09 22:52:40,202 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3243
+ 2022-01-09 22:52:42,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3244
+ 2022-01-09 22:52:44,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3245
+ 2022-01-09 22:52:46,203 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3246
+ 2022-01-09 22:52:48,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3247
+ 2022-01-09 22:52:50,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3248
+ 2022-01-09 22:52:52,204 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3249
+ 2022-01-09 22:52:54,203 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3250
+ 2022-01-09 22:52:54,203 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3251
+ 2022-01-09 22:52:54,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3252
+ 2022-01-09 22:52:56,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3253
+ 2022-01-09 22:52:58,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3254
+ 2022-01-09 22:53:00,205 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3255
+ 2022-01-09 22:53:02,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3256
+ 2022-01-09 22:53:04,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3257
+ 2022-01-09 22:53:04,774 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3258
+ 2022-01-09 22:53:06,206 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3259
+ 2022-01-09 22:53:08,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3260
+ 2022-01-09 22:53:09,276 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3261
+ 2022-01-09 22:53:09,276 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3262
+ 2022-01-09 22:53:10,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3263
+ 2022-01-09 22:53:12,207 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3264
+ 2022-01-09 22:53:14,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3265
+ 2022-01-09 22:53:16,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3266
+ 2022-01-09 22:53:18,208 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3267
+ 2022-01-09 22:53:20,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3268
+ 2022-01-09 22:53:22,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3269
+ 2022-01-09 22:53:24,209 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3270
+ 2022-01-09 22:53:24,375 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3271
+ 2022-01-09 22:53:24,375 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3272
+ 2022-01-09 22:53:27,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3273
+ 2022-01-09 22:53:29,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3274
+ 2022-01-09 22:53:31,210 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3275
+ 2022-01-09 22:53:33,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3276
+ 2022-01-09 22:53:35,003 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3277
+ 2022-01-09 22:53:35,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3278
+ 2022-01-09 22:53:37,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3279
+ 2022-01-09 22:53:39,211 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3280
+ 2022-01-09 22:53:39,484 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3281
+ 2022-01-09 22:53:39,485 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3282
+ 2022-01-09 22:53:39,618 DEBUG SenderThread:31514 [sender.py:send():182] send: history
3283
+ 2022-01-09 22:53:39,659 DEBUG SenderThread:31514 [sender.py:send():182] send: summary
3284
+ 2022-01-09 22:53:39,681 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
3285
+ 2022-01-09 22:53:40,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json
3286
+ 2022-01-09 22:53:41,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3287
+ 2022-01-09 22:53:42,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3288
+ 2022-01-09 22:53:43,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3289
+ 2022-01-09 22:53:45,212 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3290
+ 2022-01-09 22:53:47,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3291
+ 2022-01-09 22:53:49,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3292
+ 2022-01-09 22:53:51,213 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3293
+ 2022-01-09 22:53:53,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3294
+ 2022-01-09 22:53:54,612 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3295
+ 2022-01-09 22:53:54,612 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3296
+ 2022-01-09 22:53:55,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3297
+ 2022-01-09 22:53:57,214 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3298
+ 2022-01-09 22:53:59,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3299
+ 2022-01-09 22:54:01,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3300
+ 2022-01-09 22:54:03,215 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3301
+ 2022-01-09 22:54:05,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3302
+ 2022-01-09 22:54:05,236 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3303
+ 2022-01-09 22:54:07,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3304
+ 2022-01-09 22:54:09,216 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3305
+ 2022-01-09 22:54:09,686 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3306
+ 2022-01-09 22:54:09,686 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3307
+ 2022-01-09 22:54:11,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3308
+ 2022-01-09 22:54:13,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3309
+ 2022-01-09 22:54:15,217 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3310
+ 2022-01-09 22:54:17,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3311
+ 2022-01-09 22:54:19,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3312
+ 2022-01-09 22:54:21,218 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3313
+ 2022-01-09 22:54:23,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3314
+ 2022-01-09 22:54:25,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3315
+ 2022-01-09 22:54:25,796 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3316
+ 2022-01-09 22:54:25,796 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3317
+ 2022-01-09 22:54:27,219 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3318
+ 2022-01-09 22:54:29,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3319
+ 2022-01-09 22:54:31,220 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3320
+ 2022-01-09 22:54:34,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3321
+ 2022-01-09 22:54:35,488 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3322
+ 2022-01-09 22:54:36,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3323
+ 2022-01-09 22:54:38,221 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3324
+ 2022-01-09 22:54:40,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3325
+ 2022-01-09 22:54:40,949 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3326
+ 2022-01-09 22:54:40,949 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3327
+ 2022-01-09 22:54:42,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3328
+ 2022-01-09 22:54:44,222 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3329
+ 2022-01-09 22:54:46,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3330
+ 2022-01-09 22:54:48,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3331
+ 2022-01-09 22:54:50,223 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3332
+ 2022-01-09 22:54:52,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3333
+ 2022-01-09 22:54:54,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3334
+ 2022-01-09 22:54:56,023 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3335
+ 2022-01-09 22:54:56,023 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3336
+ 2022-01-09 22:54:56,224 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3337
+ 2022-01-09 22:54:58,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3338
+ 2022-01-09 22:55:00,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3339
+ 2022-01-09 22:55:02,225 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3340
+ 2022-01-09 22:55:04,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3341
+ 2022-01-09 22:55:05,732 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3342
+ 2022-01-09 22:55:06,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3343
+ 2022-01-09 22:55:08,226 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3344
+ 2022-01-09 22:55:10,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3345
+ 2022-01-09 22:55:11,167 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3346
+ 2022-01-09 22:55:11,168 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3347
+ 2022-01-09 22:55:12,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3348
+ 2022-01-09 22:55:14,227 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3349
+ 2022-01-09 22:55:16,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3350
+ 2022-01-09 22:55:18,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3351
+ 2022-01-09 22:55:20,228 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3352
+ 2022-01-09 22:55:22,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3353
+ 2022-01-09 22:55:24,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3354
+ 2022-01-09 22:55:26,229 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3355
+ 2022-01-09 22:55:26,239 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3356
+ 2022-01-09 22:55:26,239 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3357
+ 2022-01-09 22:55:28,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3358
+ 2022-01-09 22:55:30,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3359
+ 2022-01-09 22:55:32,230 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3360
+ 2022-01-09 22:55:34,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3361
+ 2022-01-09 22:55:35,978 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3362
+ 2022-01-09 22:55:36,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3363
+ 2022-01-09 22:55:38,231 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3364
+ 2022-01-09 22:55:40,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3365
+ 2022-01-09 22:55:41,724 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3366
+ 2022-01-09 22:55:41,724 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3367
+ 2022-01-09 22:55:42,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3368
+ 2022-01-09 22:55:44,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3369
+ 2022-01-09 22:55:46,232 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3370
+ 2022-01-09 22:55:48,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3371
+ 2022-01-09 22:55:50,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3372
+ 2022-01-09 22:55:52,233 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3373
+ 2022-01-09 22:55:54,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3374
+ 2022-01-09 22:55:56,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3375
+ 2022-01-09 22:55:56,797 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3376
+ 2022-01-09 22:55:56,798 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3377
+ 2022-01-09 22:55:58,234 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3378
+ 2022-01-09 22:56:00,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3379
+ 2022-01-09 22:56:01,632 DEBUG SenderThread:31514 [sender.py:send():182] send: history
3380
+ 2022-01-09 22:56:01,649 DEBUG SenderThread:31514 [sender.py:send():182] send: summary
3381
+ 2022-01-09 22:56:01,678 INFO SenderThread:31514 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
3382
+ 2022-01-09 22:56:02,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/wandb-summary.json
3383
+ 2022-01-09 22:56:02,235 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3384
+ 2022-01-09 22:56:04,236 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3385
+ 2022-01-09 22:56:06,221 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
3386
+ 2022-01-09 22:56:11,920 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3387
+ 2022-01-09 22:56:11,921 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3388
+ 2022-01-09 22:56:14,239 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3389
+ 2022-01-09 22:56:27,032 DEBUG HandlerThread:31514 [handler.py:handle_request():126] handle_request: stop_status
3390
+ 2022-01-09 22:56:27,032 DEBUG SenderThread:31514 [sender.py:send_request():196] send_request: stop_status
3391
+ 2022-01-09 22:56:36,245 INFO Thread-8 :31514 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/hugging_face/examples/xls-r-300m-sv/wandb/run-20220109_220240-1g372i3v/files/output.log
3392
+ 2022-01-09 22:56:36,504 DEBUG SenderThread:31514 [sender.py:send():182] send: stats
wandb/run-20220109_220240-1g372i3v/run-1g372i3v.wandb CHANGED
Binary files a/wandb/run-20220109_220240-1g372i3v/run-1g372i3v.wandb and b/wandb/run-20220109_220240-1g372i3v/run-1g372i3v.wandb differ