File size: 5,008 Bytes
5abc4dc |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 |
2021-05-22 19:56:24,477 INFO __main__ Namespace(adjust_lr=False, config='torchdistill/configs/sample/glue/wnli/ce/bert_large_uncased.yaml', log='log/glue/wnli/ce/bert_large_uncased.txt', private_output='leaderboard/glue/standard/bert_large_uncased/', seed=None, student_only=False, task_name='wnli', test_only=False, world_size=1)
2021-05-22 19:56:24,533 INFO __main__ Distributed environment: NO
Num processes: 1
Process index: 0
Local process index: 0
Device: cuda
Use FP16 precision: True
2021-05-22 19:56:48,842 INFO __main__ Start training
2021-05-22 19:56:48,842 INFO torchdistill.models.util [student model]
2021-05-22 19:56:48,843 INFO torchdistill.models.util Using the original student model
2021-05-22 19:56:48,843 INFO torchdistill.core.training Loss = 1.0 * OrgLoss
2021-05-22 19:56:53,550 INFO torchdistill.misc.log Epoch: [0] [ 0/80] eta: 0:00:17 lr: 3.990000000000001e-05 sample/s: 18.767552475088035 loss: 0.6687 (0.6687) time: 0.2162 data: 0.0030 max mem: 5387
2021-05-22 19:57:00,019 INFO torchdistill.misc.log Epoch: [0] [50/80] eta: 0:00:03 lr: 3.490000000000001e-05 sample/s: 30.58460562463654 loss: 0.6938 (0.6991) time: 0.1276 data: 0.0015 max mem: 7070
2021-05-22 19:57:03,804 INFO torchdistill.misc.log Epoch: [0] Total time: 0:00:10
2021-05-22 19:57:03,958 INFO /usr/local/lib/python3.7/dist-packages/datasets/metric.py Removing /root/.cache/huggingface/metrics/glue/wnli/default_experiment-1-0.arrow
2021-05-22 19:57:03,958 INFO __main__ Validation: accuracy = 0.5492957746478874
2021-05-22 19:57:03,958 INFO __main__ Updating ckpt
2021-05-22 19:57:10,821 INFO torchdistill.misc.log Epoch: [1] [ 0/80] eta: 0:00:12 lr: 3.19e-05 sample/s: 29.384120134089486 loss: 0.6909 (0.6909) time: 0.1566 data: 0.0205 max mem: 7186
2021-05-22 19:57:17,272 INFO torchdistill.misc.log Epoch: [1] [50/80] eta: 0:00:03 lr: 2.6900000000000003e-05 sample/s: 32.50642486243509 loss: 0.6932 (0.6934) time: 0.1310 data: 0.0014 max mem: 7188
2021-05-22 19:57:20,973 INFO torchdistill.misc.log Epoch: [1] Total time: 0:00:10
2021-05-22 19:57:21,128 INFO /usr/local/lib/python3.7/dist-packages/datasets/metric.py Removing /root/.cache/huggingface/metrics/glue/wnli/default_experiment-1-0.arrow
2021-05-22 19:57:21,128 INFO __main__ Validation: accuracy = 0.5633802816901409
2021-05-22 19:57:21,128 INFO __main__ Updating ckpt
2021-05-22 19:57:28,122 INFO torchdistill.misc.log Epoch: [2] [ 0/80] eta: 0:00:10 lr: 2.39e-05 sample/s: 30.32127450005874 loss: 0.6824 (0.6824) time: 0.1339 data: 0.0020 max mem: 7188
2021-05-22 19:57:34,515 INFO torchdistill.misc.log Epoch: [2] [50/80] eta: 0:00:03 lr: 1.8900000000000002e-05 sample/s: 31.630715165089583 loss: 0.6937 (0.6948) time: 0.1281 data: 0.0014 max mem: 7188
2021-05-22 19:57:38,235 INFO torchdistill.misc.log Epoch: [2] Total time: 0:00:10
2021-05-22 19:57:38,390 INFO /usr/local/lib/python3.7/dist-packages/datasets/metric.py Removing /root/.cache/huggingface/metrics/glue/wnli/default_experiment-1-0.arrow
2021-05-22 19:57:38,390 INFO __main__ Validation: accuracy = 0.5633802816901409
2021-05-22 19:57:38,521 INFO torchdistill.misc.log Epoch: [3] [ 0/80] eta: 0:00:10 lr: 1.5900000000000004e-05 sample/s: 31.18180821306768 loss: 0.6948 (0.6948) time: 0.1297 data: 0.0014 max mem: 7188
2021-05-22 19:57:44,900 INFO torchdistill.misc.log Epoch: [3] [50/80] eta: 0:00:03 lr: 1.0900000000000002e-05 sample/s: 31.89390759497521 loss: 0.6927 (0.6954) time: 0.1278 data: 0.0014 max mem: 7188
2021-05-22 19:57:48,641 INFO torchdistill.misc.log Epoch: [3] Total time: 0:00:10
2021-05-22 19:57:48,792 INFO /usr/local/lib/python3.7/dist-packages/datasets/metric.py Removing /root/.cache/huggingface/metrics/glue/wnli/default_experiment-1-0.arrow
2021-05-22 19:57:48,793 INFO __main__ Validation: accuracy = 0.5633802816901409
2021-05-22 19:57:48,917 INFO torchdistill.misc.log Epoch: [4] [ 0/80] eta: 0:00:09 lr: 7.9e-06 sample/s: 32.742675586850794 loss: 0.6934 (0.6934) time: 0.1236 data: 0.0014 max mem: 7188
2021-05-22 19:57:55,336 INFO torchdistill.misc.log Epoch: [4] [50/80] eta: 0:00:03 lr: 2.9e-06 sample/s: 31.653093952463426 loss: 0.6926 (0.6938) time: 0.1289 data: 0.0014 max mem: 7188
2021-05-22 19:57:59,112 INFO torchdistill.misc.log Epoch: [4] Total time: 0:00:10
2021-05-22 19:57:59,267 INFO /usr/local/lib/python3.7/dist-packages/datasets/metric.py Removing /root/.cache/huggingface/metrics/glue/wnli/default_experiment-1-0.arrow
2021-05-22 19:57:59,267 INFO __main__ Validation: accuracy = 0.5352112676056338
2021-05-22 19:58:07,747 INFO __main__ [Student: bert-large-uncased]
2021-05-22 19:58:07,913 INFO /usr/local/lib/python3.7/dist-packages/datasets/metric.py Removing /root/.cache/huggingface/metrics/glue/wnli/default_experiment-1-0.arrow
2021-05-22 19:58:07,913 INFO __main__ Test: accuracy = 0.5633802816901409
2021-05-22 19:58:07,913 INFO __main__ Start prediction for private dataset(s)
2021-05-22 19:58:07,914 INFO __main__ wnli/test: 146 samples
|