diff --git "a/wandb/run-20211106_211610-dtkf2u0m/files/output.log" "b/wandb/run-20211106_211610-dtkf2u0m/files/output.log"
--- "a/wandb/run-20211106_211610-dtkf2u0m/files/output.log"
+++ "b/wandb/run-20211106_211610-dtkf2u0m/files/output.log"
@@ -7529,3 +7529,3737 @@ huggingface/tokenizers: The current process just got forked, after parallelism h
 To disable this warning, you can either:
 	- Avoid using `tokenizers` before the fork if possible
 	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+11/07/2021 01:25:22 - INFO - __main__ - Step 29997: {'lr': 0.00045713929813644274, 'samples': 5759424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:28:53 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.9424, 'steps': 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:29:19 - WARNING - huggingface_hub.repository - To https://huggingface.co/lvwerra/codeparrot-small 29996, 'loss/train': 1.537301778793335}}}
+11/07/2021 01:29:19 - WARNING - huggingface_hub.repository - To https://huggingface.co/lvwerra/codeparrot-small 29996, 'loss/train': 1.537301778793335}}}
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+11/07/2021 01:29:21 - INFO - __main__ - Step 30001: {'lr': 0.00045712741231096054, 'samples': 5760192, 'steps': 30000, 'loss/train': 1.1647251844406128}}
+11/07/2021 01:29:24 - INFO - __main__ - Step 30007: {'lr': 0.00045710958077291156, 'samples': 5761344, 'steps': 30006, 'loss/train': 1.6442089080810547}}
+11/07/2021 01:29:24 - INFO - __main__ - Step 30007: {'lr': 0.00045710958077291156, 'samples': 5761344, 'steps': 30006, 'loss/train': 1.6442089080810547}}
+11/07/2021 01:29:27 - INFO - __main__ - Step 30014: {'lr': 0.00045708877306579733, 'samples': 5762688, 'steps': 30013, 'loss/train': 1.8259247541427612}}
+11/07/2021 01:29:29 - INFO - __main__ - Step 30018: {'lr': 0.0004570768808945748, 'samples': 5763456, 'steps': 30017, 'loss/train': 2.3335750102996826}}}
+11/07/2021 01:29:29 - INFO - __main__ - Step 30018: {'lr': 0.0004570768808945748, 'samples': 5763456, 'steps': 30017, 'loss/train': 2.3335750102996826}}}
+11/07/2021 01:29:29 - INFO - __main__ - Step 30018: {'lr': 0.0004570768808945748, 'samples': 5763456, 'steps': 30017, 'loss/train': 2.3335750102996826}}}
+11/07/2021 01:29:35 - INFO - __main__ - Step 30030: {'lr': 0.000457041195423908, 'samples': 5765760, 'steps': 30029, 'loss/train': 0.26046043634414673}}}
+11/07/2021 01:29:37 - INFO - __main__ - Step 30034: {'lr': 0.00045702929728163845, 'samples': 5766528, 'steps': 30033, 'loss/train': 1.5465935468673706}}
+11/07/2021 01:29:40 - INFO - __main__ - Step 30039: {'lr': 0.0004570144225049171, 'samples': 5767488, 'steps': 30038, 'loss/train': 1.7716975212097168}}}
+11/07/2021 01:29:42 - INFO - __main__ - Step 30043: {'lr': 0.0004570025210045368, 'samples': 5768256, 'steps': 30042, 'loss/train': 1.53825044631958}8}}}
+11/07/2021 01:29:42 - INFO - __main__ - Step 30043: {'lr': 0.0004570025210045368, 'samples': 5768256, 'steps': 30042, 'loss/train': 1.53825044631958}8}}}
+11/07/2021 01:29:45 - INFO - __main__ - Step 30050: {'lr': 0.00045698168978794553, 'samples': 5769600, 'steps': 30049, 'loss/train': 1.3786624670028687}}
+11/07/2021 01:29:48 - INFO - __main__ - Step 30055: {'lr': 0.0004569668075496137, 'samples': 5770560, 'steps': 30054, 'loss/train': 0.4359086751937866}}}
+11/07/2021 01:29:50 - INFO - __main__ - Step 30060: {'lr': 0.00045695192297988066, 'samples': 5771520, 'steps': 30059, 'loss/train': 1.5076161623001099}}
+11/07/2021 01:29:52 - INFO - __main__ - Step 30064: {'lr': 0.00045694001364559797, 'samples': 5772288, 'steps': 30063, 'loss/train': 1.5570694208145142}}
+11/07/2021 01:29:52 - INFO - __main__ - Step 30064: {'lr': 0.00045694001364559797, 'samples': 5772288, 'steps': 30063, 'loss/train': 1.5570694208145142}}
+11/07/2021 01:29:56 - INFO - __main__ - Step 30070: {'lr': 0.0004569221468468815, 'samples': 5773440, 'steps': 30069, 'loss/train': 2.7942593097686768}}}
+11/07/2021 01:29:56 - INFO - __main__ - Step 30070: {'lr': 0.0004569221468468815, 'samples': 5773440, 'steps': 30069, 'loss/train': 2.7942593097686768}}}
+11/07/2021 01:30:00 - INFO - __main__ - Step 30079: {'lr': 0.0004568953403554723, 'samples': 5775168, 'steps': 30078, 'loss/train': 2.0979011058807373}}}
+11/07/2021 01:30:02 - INFO - __main__ - Step 30083: {'lr': 0.00045688342393541227, 'samples': 5775936, 'steps': 30082, 'loss/train': 1.5688196420669556}}
+11/07/2021 01:30:04 - INFO - __main__ - Step 30087: {'lr': 0.0004568715060238565, 'samples': 5776704, 'steps': 30086, 'loss/train': 1.9113773107528687}}}
+11/07/2021 01:30:06 - INFO - __main__ - Step 30091: {'lr': 0.00045685958662089113, 'samples': 5777472, 'steps': 30090, 'loss/train': 2.05692195892334}}}}
+11/07/2021 01:30:08 - INFO - __main__ - Step 30097: {'lr': 0.00045684170472023766, 'samples': 5778624, 'steps': 30096, 'loss/train': 1.069875955581665}}}
+11/07/2021 01:30:08 - INFO - __main__ - Step 30097: {'lr': 0.00045684170472023766, 'samples': 5778624, 'steps': 30096, 'loss/train': 1.069875955581665}}}
+11/07/2021 01:30:08 - INFO - __main__ - Step 30097: {'lr': 0.00045684170472023766, 'samples': 5778624, 'steps': 30096, 'loss/train': 1.069875955581665}}}
+11/07/2021 01:30:13 - INFO - __main__ - Step 30107: {'lr': 0.00045681189409665083, 'samples': 5780544, 'steps': 30106, 'loss/train': 1.6340943574905396}}
+11/07/2021 01:30:16 - INFO - __main__ - Step 30112: {'lr': 0.00045679698529028906, 'samples': 5781504, 'steps': 30111, 'loss/train': 1.3997163772583008}}
+11/07/2021 01:30:16 - INFO - __main__ - Step 30112: {'lr': 0.00045679698529028906, 'samples': 5781504, 'steps': 30111, 'loss/train': 1.3997163772583008}}
+11/07/2021 01:30:20 - INFO - __main__ - Step 30120: {'lr': 0.00045677312635484466, 'samples': 5783040, 'steps': 30119, 'loss/train': 1.8276495933532715}}
+11/07/2021 01:30:22 - INFO - __main__ - Step 30124: {'lr': 0.0004567611946510287, 'samples': 5783808, 'steps': 30123, 'loss/train': 1.199395775794983}5}}
+11/07/2021 01:30:22 - INFO - __main__ - Step 30124: {'lr': 0.0004567611946510287, 'samples': 5783808, 'steps': 30123, 'loss/train': 1.199395775794983}5}}
+11/07/2021 01:30:25 - INFO - __main__ - Step 30130: {'lr': 0.0004567432943004296, 'samples': 5784960, 'steps': 30129, 'loss/train': 2.230543375015259}5}}
+11/07/2021 01:30:27 - INFO - __main__ - Step 30134: {'lr': 0.00045673135887023874, 'samples': 5785728, 'steps': 30133, 'loss/train': 1.5163437128067017}}
+11/07/2021 01:30:30 - INFO - __main__ - Step 30140: {'lr': 0.00045671345293048075, 'samples': 5786880, 'steps': 30139, 'loss/train': 2.0110180377960205}}
+11/07/2021 01:30:30 - INFO - __main__ - Step 30140: {'lr': 0.00045671345293048075, 'samples': 5786880, 'steps': 30139, 'loss/train': 2.0110180377960205}}
+11/07/2021 01:30:34 - INFO - __main__ - Step 30147: {'lr': 0.0004566925584294939, 'samples': 5788224, 'steps': 30146, 'loss/train': 1.2389037609100342}}}
+11/07/2021 01:30:36 - INFO - __main__ - Step 30151: {'lr': 0.00045668061666570027, 'samples': 5788992, 'steps': 30150, 'loss/train': 1.859587550163269}}}
+11/07/2021 01:30:38 - INFO - __main__ - Step 30156: {'lr': 0.00045666568736560853, 'samples': 5789952, 'steps': 30155, 'loss/train': 1.7113829851150513}}
+11/07/2021 01:30:40 - INFO - __main__ - Step 30160: {'lr': 0.0004566537422493605, 'samples': 5790720, 'steps': 30159, 'loss/train': 1.5131640434265137}}}
+11/07/2021 01:30:42 - INFO - __main__ - Step 30164: {'lr': 0.00045664179564327266, 'samples': 5791488, 'steps': 30163, 'loss/train': 1.4880365133285522}}
+11/07/2021 01:30:42 - INFO - __main__ - Step 30164: {'lr': 0.00045664179564327266, 'samples': 5791488, 'steps': 30163, 'loss/train': 1.4880365133285522}}
+11/07/2021 01:30:46 - INFO - __main__ - Step 30171: {'lr': 0.00045662088549795087, 'samples': 5792832, 'steps': 30170, 'loss/train': 1.545324444770813}}}
+11/07/2021 01:30:48 - INFO - __main__ - Step 30176: {'lr': 0.00045660594688683154, 'samples': 5793792, 'steps': 30175, 'loss/train': 1.4284133911132812}}
+11/07/2021 01:30:50 - INFO - __main__ - Step 30180: {'lr': 0.00045659399432224583, 'samples': 5794560, 'steps': 30179, 'loss/train': 1.3032660484313965}}
+11/07/2021 01:30:50 - INFO - __main__ - Step 30180: {'lr': 0.00045659399432224583, 'samples': 5794560, 'steps': 30179, 'loss/train': 1.3032660484313965}}
+11/07/2021 01:30:54 - INFO - __main__ - Step 30187: {'lr': 0.00045657307375038226, 'samples': 5795904, 'steps': 30186, 'loss/train': 1.1355433464050293}}
+11/07/2021 01:30:56 - INFO - __main__ - Step 30192: {'lr': 0.00045655812769237927, 'samples': 5796864, 'steps': 30191, 'loss/train': 1.4939942359924316}}
+11/07/2021 01:30:56 - INFO - __main__ - Step 30192: {'lr': 0.00045655812769237927, 'samples': 5796864, 'steps': 30191, 'loss/train': 1.4939942359924316}}
+11/07/2021 01:31:00 - INFO - __main__ - Step 30199: {'lr': 0.0004565371993021927, 'samples': 5798208, 'steps': 30198, 'loss/train': 1.5073283910751343}}}
+11/07/2021 01:31:02 - INFO - __main__ - Step 30203: {'lr': 0.0004565252381746821, 'samples': 5798976, 'steps': 30202, 'loss/train': 1.5877180099487305}}}
+11/07/2021 01:31:04 - INFO - __main__ - Step 30208: {'lr': 0.0004565102846715195, 'samples': 5799936, 'steps': 30207, 'loss/train': 1.5977096557617188}}}
+11/07/2021 01:31:04 - INFO - __main__ - Step 30208: {'lr': 0.0004565102846715195, 'samples': 5799936, 'steps': 30207, 'loss/train': 1.5977096557617188}}}
+11/07/2021 01:31:08 - INFO - __main__ - Step 30216: {'lr': 0.0004564863542279113, 'samples': 5801472, 'steps': 30215, 'loss/train': 1.6348497867584229}}}
+11/07/2021 01:31:10 - INFO - __main__ - Step 30220: {'lr': 0.0004564743867731145, 'samples': 5802240, 'steps': 30219, 'loss/train': 1.4747366905212402}}}
+11/07/2021 01:31:12 - INFO - __main__ - Step 30224: {'lr': 0.000456462417829771, 'samples': 5803008, 'steps': 30223, 'loss/train': 1.4281342029571533}}}}
+11/07/2021 01:31:12 - INFO - __main__ - Step 30224: {'lr': 0.000456462417829771, 'samples': 5803008, 'steps': 30223, 'loss/train': 1.4281342029571533}}}}
+11/07/2021 01:31:16 - INFO - __main__ - Step 30232: {'lr': 0.0004564384754777888, 'samples': 5804544, 'steps': 30231, 'loss/train': 1.618294358253479}7}}
+11/07/2021 01:31:17 - INFO - __main__ - Step 30236: {'lr': 0.0004564265020693227, 'samples': 5805312, 'steps': 30235, 'loss/train': 1.6616016626358032}}}
+11/07/2021 01:31:20 - INFO - __main__ - Step 30240: {'lr': 0.00045641452717265507, 'samples': 5806080, 'steps': 30239, 'loss/train': 1.3447606563568115}}
+11/07/2021 01:31:22 - INFO - __main__ - Step 30245: {'lr': 0.00045639955645916875, 'samples': 5807040, 'steps': 30244, 'loss/train': 0.9178106188774109}}
+11/07/2021 01:31:24 - INFO - __main__ - Step 30249: {'lr': 0.0004563875782143633, 'samples': 5807808, 'steps': 30248, 'loss/train': 1.6026545763015747}}}
+11/07/2021 01:31:26 - INFO - __main__ - Step 30253: {'lr': 0.000456375598481637, 'samples': 5808576, 'steps': 30252, 'loss/train': 1.7426419258117676}}}}
+11/07/2021 01:31:28 - INFO - __main__ - Step 30257: {'lr': 0.0004563636172610761, 'samples': 5809344, 'steps': 30256, 'loss/train': 1.6551815271377563}}}
+11/07/2021 01:31:30 - INFO - __main__ - Step 30261: {'lr': 0.00045635163455276707, 'samples': 5810112, 'steps': 30260, 'loss/train': 1.5694831609725952}}
+11/07/2021 01:31:30 - INFO - __main__ - Step 30261: {'lr': 0.00045635163455276707, 'samples': 5810112, 'steps': 30260, 'loss/train': 1.5694831609725952}}
+11/07/2021 01:31:30 - INFO - __main__ - Step 30261: {'lr': 0.00045635163455276707, 'samples': 5810112, 'steps': 30260, 'loss/train': 1.5694831609725952}}
+11/07/2021 01:31:36 - INFO - __main__ - Step 30272: {'lr': 0.00045631867443442084, 'samples': 5812224, 'steps': 30271, 'loss/train': 1.8668856620788574}}
+11/07/2021 01:31:39 - INFO - __main__ - Step 30278: {'lr': 0.0004563006914467709, 'samples': 5813376, 'steps': 30277, 'loss/train': 1.3554658889770508}}}
+11/07/2021 01:31:39 - INFO - __main__ - Step 30278: {'lr': 0.0004563006914467709, 'samples': 5813376, 'steps': 30277, 'loss/train': 1.3554658889770508}}}
+11/07/2021 01:31:42 - INFO - __main__ - Step 30284: {'lr': 0.0004562827051127082, 'samples': 5814528, 'steps': 30283, 'loss/train': 1.2854667901992798}}}
+11/07/2021 01:31:44 - INFO - __main__ - Step 30288: {'lr': 0.00045627071236435896, 'samples': 5815296, 'steps': 30287, 'loss/train': 1.6247920989990234}}
+11/07/2021 01:31:46 - INFO - __main__ - Step 30293: {'lr': 0.00045625571933772857, 'samples': 5816256, 'steps': 30292, 'loss/train': 1.7130277156829834}}
+11/07/2021 01:31:48 - INFO - __main__ - Step 30297: {'lr': 0.00045624372324357457, 'samples': 5817024, 'steps': 30296, 'loss/train': 1.6591161489486694}}
+11/07/2021 01:31:50 - INFO - __main__ - Step 30301: {'lr': 0.00045623172566253676, 'samples': 5817792, 'steps': 30300, 'loss/train': 1.6559518575668335}}
+11/07/2021 01:31:52 - INFO - __main__ - Step 30305: {'lr': 0.00045621972659470156, 'samples': 5818560, 'steps': 30304, 'loss/train': 1.796301007270813}}}
+11/07/2021 01:31:54 - INFO - __main__ - Step 30309: {'lr': 0.0004562077260401556, 'samples': 5819328, 'steps': 30308, 'loss/train': 1.4213775396347046}}}
+  torch.nn.utils.clip_grad_norm_(parameters, max_norm, norm_type=norm_type)01556, 'samples': 5819328, 'steps': 30308, 'loss/train': 1.4213775396347046}}}
+11/07/2021 01:31:59 - INFO - __main__ - Step 30318: {'lr': 0.0004561807193570888, 'samples': 5821056, 'steps': 30317, 'loss/train': 0.8450649976730347}}}
+11/07/2021 01:31:59 - INFO - __main__ - Step 30318: {'lr': 0.0004561807193570888, 'samples': 5821056, 'steps': 30317, 'loss/train': 0.8450649976730347}}}
+11/07/2021 01:32:02 - INFO - __main__ - Step 30325: {'lr': 0.00045615970895659393, 'samples': 5822400, 'steps': 30324, 'loss/train': 0.860467255115509}}}
+11/07/2021 01:32:05 - INFO - __main__ - Step 30330: {'lr': 0.0004561446987408704, 'samples': 5823360, 'steps': 30329, 'loss/train': 1.852549433708191}}}}
+11/07/2021 01:32:07 - INFO - __main__ - Step 30334: {'lr': 0.0004561326888963423, 'samples': 5824128, 'steps': 30333, 'loss/train': 1.3868197202682495}}}
+11/07/2021 01:32:07 - INFO - __main__ - Step 30334: {'lr': 0.0004561326888963423, 'samples': 5824128, 'steps': 30333, 'loss/train': 1.3868197202682495}}}
+11/07/2021 01:32:10 - INFO - __main__ - Step 30341: {'lr': 0.00045611166809258227, 'samples': 5825472, 'steps': 30340, 'loss/train': 1.75202214717865}}}}
+11/07/2021 01:32:12 - INFO - __main__ - Step 30346: {'lr': 0.0004560966504466044, 'samples': 5826432, 'steps': 30345, 'loss/train': 1.844706416130066}}}}
+11/07/2021 01:32:15 - INFO - __main__ - Step 30351: {'lr': 0.0004560816304790274, 'samples': 5827392, 'steps': 30350, 'loss/train': 1.9288541078567505}}}
+11/07/2021 01:32:15 - INFO - __main__ - Step 30351: {'lr': 0.0004560816304790274, 'samples': 5827392, 'steps': 30350, 'loss/train': 1.9288541078567505}}}
+11/07/2021 01:32:18 - INFO - __main__ - Step 30358: {'lr': 0.00045606059862445485, 'samples': 5828736, 'steps': 30357, 'loss/train': 0.9508589506149292}}
+11/07/2021 01:32:21 - INFO - __main__ - Step 30362: {'lr': 0.00045604857837916224, 'samples': 5829504, 'steps': 30361, 'loss/train': 1.3667658567428589}}
+11/07/2021 01:32:23 - INFO - __main__ - Step 30366: {'lr': 0.0004560365566483927, 'samples': 5830272, 'steps': 30365, 'loss/train': 1.4809709787368774}}}
+11/07/2021 01:32:25 - INFO - __main__ - Step 30370: {'lr': 0.0004560245334322328, 'samples': 5831040, 'steps': 30369, 'loss/train': 1.7748409509658813}}}
+11/07/2021 01:32:26 - INFO - __main__ - Step 30374: {'lr': 0.0004560125087307693, 'samples': 5831808, 'steps': 30373, 'loss/train': 1.8265717029571533}}}
+11/07/2021 01:32:28 - INFO - __main__ - Step 30378: {'lr': 0.0004560004825440889, 'samples': 5832576, 'steps': 30377, 'loss/train': 1.6653149127960205}}}
+11/07/2021 01:32:31 - INFO - __main__ - Step 30383: {'lr': 0.0004559854477222842, 'samples': 5833536, 'steps': 30382, 'loss/train': 1.8445994853973389}}}
+11/07/2021 01:32:33 - INFO - __main__ - Step 30387: {'lr': 0.0004559734181941828, 'samples': 5834304, 'steps': 30386, 'loss/train': 2.4096007347106934}}}
+11/07/2021 01:32:35 - INFO - __main__ - Step 30391: {'lr': 0.00045596138718114626, 'samples': 5835072, 'steps': 30390, 'loss/train': 1.5772721767425537}}
+11/07/2021 01:32:36 - INFO - __main__ - Step 30395: {'lr': 0.00045594935468326137, 'samples': 5835840, 'steps': 30394, 'loss/train': 1.174822211265564}}}
+11/07/2021 01:32:38 - INFO - __main__ - Step 30399: {'lr': 0.00045593732070061484, 'samples': 5836608, 'steps': 30398, 'loss/train': 1.6387768983840942}}
+11/07/2021 01:32:41 - INFO - __main__ - Step 30404: {'lr': 0.0004559222761344928, 'samples': 5837568, 'steps': 30403, 'loss/train': 1.3113209009170532}}}
+11/07/2021 01:32:41 - INFO - __main__ - Step 30404: {'lr': 0.0004559222761344928, 'samples': 5837568, 'steps': 30403, 'loss/train': 1.3113209009170532}}}
+11/07/2021 01:32:44 - INFO - __main__ - Step 30411: {'lr': 0.0004559012098449732, 'samples': 5838912, 'steps': 30410, 'loss/train': 1.7170732021331787}}}
+11/07/2021 01:32:46 - INFO - __main__ - Step 30415: {'lr': 0.00045588916992414784, 'samples': 5839680, 'steps': 30414, 'loss/train': 0.5767570734024048}}
+11/07/2021 01:32:49 - INFO - __main__ - Step 30420: {'lr': 0.00045587411793579047, 'samples': 5840640, 'steps': 30419, 'loss/train': 1.4096364974975586}}
+11/07/2021 01:32:51 - INFO - __main__ - Step 30425: {'lr': 0.00045585906362834063, 'samples': 5841600, 'steps': 30424, 'loss/train': 1.7328251600265503}}
+11/07/2021 01:32:53 - INFO - __main__ - Step 30429: {'lr': 0.00045584701851274814, 'samples': 5842368, 'steps': 30428, 'loss/train': 1.8039371967315674}}
+11/07/2021 01:32:53 - INFO - __main__ - Step 30429: {'lr': 0.00045584701851274814, 'samples': 5842368, 'steps': 30428, 'loss/train': 1.8039371967315674}}
+11/07/2021 01:32:56 - INFO - __main__ - Step 30436: {'lr': 0.00045582593598958107, 'samples': 5843712, 'steps': 30435, 'loss/train': 1.0785267353057861}}
+11/07/2021 01:32:58 - INFO - __main__ - Step 30440: {'lr': 0.00045581388679313194, 'samples': 5844480, 'steps': 30439, 'loss/train': 1.785849928855896}}}
+11/07/2021 01:33:01 - INFO - __main__ - Step 30446: {'lr': 0.00045579581021638855, 'samples': 5845632, 'steps': 30445, 'loss/train': 0.5898078083992004}}
+11/07/2021 01:33:03 - INFO - __main__ - Step 30450: {'lr': 0.0004557837573106399, 'samples': 5846400, 'steps': 30449, 'loss/train': 1.6386229991912842}}}
+11/07/2021 01:33:03 - INFO - __main__ - Step 30450: {'lr': 0.0004557837573106399, 'samples': 5846400, 'steps': 30449, 'loss/train': 1.6386229991912842}}}
+11/07/2021 01:33:06 - INFO - __main__ - Step 30456: {'lr': 0.0004557656751703544, 'samples': 5847552, 'steps': 30455, 'loss/train': 1.2597217559814453}}}
+11/07/2021 01:33:09 - INFO - __main__ - Step 30461: {'lr': 0.00045575060417044614, 'samples': 5848512, 'steps': 30460, 'loss/train': 1.6543169021606445}}
+11/07/2021 01:33:11 - INFO - __main__ - Step 30466: {'lr': 0.0004557355308528366, 'samples': 5849472, 'steps': 30465, 'loss/train': 1.7070040702819824}}}
+11/07/2021 01:33:13 - INFO - __main__ - Step 30470: {'lr': 0.0004557234705301182, 'samples': 5850240, 'steps': 30469, 'loss/train': 1.3435560464859009}}}
+11/07/2021 01:33:15 - INFO - __main__ - Step 30474: {'lr': 0.0004557114087242667, 'samples': 5851008, 'steps': 30473, 'loss/train': 1.2576820850372314}}}
+11/07/2021 01:33:17 - INFO - __main__ - Step 30478: {'lr': 0.000455699345435369, 'samples': 5851776, 'steps': 30477, 'loss/train': 1.789986252784729}4}}}
+11/07/2021 01:33:19 - INFO - __main__ - Step 30482: {'lr': 0.00045568728066351205, 'samples': 5852544, 'steps': 30481, 'loss/train': 1.6299755573272705}}
+11/07/2021 01:33:19 - INFO - __main__ - Step 30482: {'lr': 0.00045568728066351205, 'samples': 5852544, 'steps': 30481, 'loss/train': 1.6299755573272705}}
+11/07/2021 01:33:19 - INFO - __main__ - Step 30482: {'lr': 0.00045568728066351205, 'samples': 5852544, 'steps': 30481, 'loss/train': 1.6299755573272705}}
+11/07/2021 01:33:25 - INFO - __main__ - Step 30493: {'lr': 0.0004556540948951073, 'samples': 5854656, 'steps': 30492, 'loss/train': 1.3986448049545288}}}
+11/07/2021 01:33:27 - INFO - __main__ - Step 30498: {'lr': 0.00045563900674823205, 'samples': 5855616, 'steps': 30497, 'loss/train': 1.3164902925491333}}
+11/07/2021 01:33:29 - INFO - __main__ - Step 30503: {'lr': 0.00045562391628491274, 'samples': 5856576, 'steps': 30502, 'loss/train': 1.3326011896133423}}
+11/07/2021 01:33:29 - INFO - __main__ - Step 30503: {'lr': 0.00045562391628491274, 'samples': 5856576, 'steps': 30502, 'loss/train': 1.3326011896133423}}
+11/07/2021 01:33:33 - INFO - __main__ - Step 30509: {'lr': 0.00045560580467146275, 'samples': 5857728, 'steps': 30508, 'loss/train': 1.6736948490142822}}
+11/07/2021 01:33:35 - INFO - __main__ - Step 30514: {'lr': 0.00045559070911256486, 'samples': 5858688, 'steps': 30513, 'loss/train': 1.4619766473770142}}
+11/07/2021 01:33:37 - INFO - __main__ - Step 30518: {'lr': 0.00045557863099799034, 'samples': 5859456, 'steps': 30517, 'loss/train': 1.5410176515579224}}
+11/07/2021 01:33:39 - INFO - __main__ - Step 30522: {'lr': 0.00045556655140132696, 'samples': 5860224, 'steps': 30521, 'loss/train': 1.1270097494125366}}
+11/07/2021 01:33:41 - INFO - __main__ - Step 30526: {'lr': 0.00045555447032266167, 'samples': 5860992, 'steps': 30525, 'loss/train': 1.9231667518615723}}
+11/07/2021 01:33:43 - INFO - __main__ - Step 30530: {'lr': 0.0004555423877620817, 'samples': 5861760, 'steps': 30529, 'loss/train': 1.6974469423294067}}}
+11/07/2021 01:33:45 - INFO - __main__ - Step 30535: {'lr': 0.00045552728247754673, 'samples': 5862720, 'steps': 30534, 'loss/train': 1.8246897459030151}}
+11/07/2021 01:33:45 - INFO - __main__ - Step 30535: {'lr': 0.00045552728247754673, 'samples': 5862720, 'steps': 30534, 'loss/train': 1.8246897459030151}}
+11/07/2021 01:33:49 - INFO - __main__ - Step 30542: {'lr': 0.0004555061311897241, 'samples': 5864064, 'steps': 30541, 'loss/train': 1.6158738136291504}}}
+11/07/2021 01:33:51 - INFO - __main__ - Step 30546: {'lr': 0.0004554940427023562, 'samples': 5864832, 'steps': 30545, 'loss/train': 1.4866725206375122}}}
+11/07/2021 01:33:51 - INFO - __main__ - Step 30546: {'lr': 0.0004554940427023562, 'samples': 5864832, 'steps': 30545, 'loss/train': 1.4866725206375122}}}
+11/07/2021 01:33:55 - INFO - __main__ - Step 30553: {'lr': 0.00045547288428470574, 'samples': 5866176, 'steps': 30552, 'loss/train': 1.4973241090774536}}
+11/07/2021 01:33:57 - INFO - __main__ - Step 30559: {'lr': 0.00045545474488739693, 'samples': 5867328, 'steps': 30558, 'loss/train': 1.0276840925216675}}
+11/07/2021 01:33:57 - INFO - __main__ - Step 30559: {'lr': 0.00045545474488739693, 'samples': 5867328, 'steps': 30558, 'loss/train': 1.0276840925216675}}
+11/07/2021 01:34:02 - INFO - __main__ - Step 30566: {'lr': 0.00045543357804507344, 'samples': 5868672, 'steps': 30565, 'loss/train': 1.806578516960144}}}
+11/07/2021 01:34:03 - INFO - __main__ - Step 30570: {'lr': 0.0004554214806701384, 'samples': 5869440, 'steps': 30569, 'loss/train': 1.164947748184204}}}}
+11/07/2021 01:34:03 - INFO - __main__ - Step 30570: {'lr': 0.0004554214806701384, 'samples': 5869440, 'steps': 30569, 'loss/train': 1.164947748184204}}}}
+11/07/2021 01:34:06 - INFO - __main__ - Step 30575: {'lr': 0.0004554063568688857, 'samples': 5870400, 'steps': 30574, 'loss/train': 1.8389360904693604}}}
+11/07/2021 01:34:09 - INFO - __main__ - Step 30581: {'lr': 0.0004553882052531504, 'samples': 5871552, 'steps': 30580, 'loss/train': 1.6969722509384155}}}
+11/07/2021 01:34:09 - INFO - __main__ - Step 30581: {'lr': 0.0004553882052531504, 'samples': 5871552, 'steps': 30580, 'loss/train': 1.6969722509384155}}}
+11/07/2021 01:34:12 - INFO - __main__ - Step 30587: {'lr': 0.000455370050305804, 'samples': 5872704, 'steps': 30586, 'loss/train': 1.578984022140503}5}}}
+11/07/2021 01:34:15 - INFO - __main__ - Step 30593: {'lr': 0.0004553518920271408, 'samples': 5873856, 'steps': 30592, 'loss/train': 1.2298734188079834}}}
+11/07/2021 01:34:17 - INFO - __main__ - Step 30597: {'lr': 0.000455339784657446, 'samples': 5874624, 'steps': 30596, 'loss/train': 1.2345815896987915}}}}
+11/07/2021 01:34:17 - INFO - __main__ - Step 30597: {'lr': 0.000455339784657446, 'samples': 5874624, 'steps': 30596, 'loss/train': 1.2345815896987915}}}}
+11/07/2021 01:34:20 - INFO - __main__ - Step 30604: {'lr': 0.0004553185931983994, 'samples': 5875968, 'steps': 30603, 'loss/train': 1.6972366571426392}}}
+11/07/2021 01:34:22 - INFO - __main__ - Step 30608: {'lr': 0.0004553064817579053, 'samples': 5876736, 'steps': 30607, 'loss/train': 1.6638671159744263}}}
+11/07/2021 01:34:25 - INFO - __main__ - Step 30613: {'lr': 0.0004552913403758695, 'samples': 5877696, 'steps': 30612, 'loss/train': 1.6245088577270508}}}
+11/07/2021 01:34:27 - INFO - __main__ - Step 30618: {'lr': 0.0004552761966813059, 'samples': 5878656, 'steps': 30617, 'loss/train': 1.8219928741455078}}}
+11/07/2021 01:34:29 - INFO - __main__ - Step 30622: {'lr': 0.00045526408006074973, 'samples': 5879424, 'steps': 30621, 'loss/train': 1.3899623155593872}}
+11/07/2021 01:34:29 - INFO - __main__ - Step 30622: {'lr': 0.00045526408006074973, 'samples': 5879424, 'steps': 30621, 'loss/train': 1.3899623155593872}}
+11/07/2021 01:34:33 - INFO - __main__ - Step 30629: {'lr': 0.0004552428724140091, 'samples': 5880768, 'steps': 30628, 'loss/train': 0.9583744406700134}}}
+11/07/2021 01:34:33 - INFO - __main__ - Step 30629: {'lr': 0.0004552428724140091, 'samples': 5880768, 'steps': 30628, 'loss/train': 0.9583744406700134}}}
+11/07/2021 01:34:37 - INFO - __main__ - Step 30635: {'lr': 0.0004552246908243792, 'samples': 5881920, 'steps': 30634, 'loss/train': 1.81877601146698}4}}}
+11/07/2021 01:34:39 - INFO - __main__ - Step 30641: {'lr': 0.00045520650590579056, 'samples': 5883072, 'steps': 30640, 'loss/train': 1.666163444519043}}}
+11/07/2021 01:34:42 - INFO - __main__ - Step 30645: {'lr': 0.00045519438077745543, 'samples': 5883840, 'steps': 30644, 'loss/train': 1.3501056432724}3}}}
+11/07/2021 01:34:43 - INFO - __main__ - Step 30649: {'lr': 0.0004551822541698017, 'samples': 5884608, 'steps': 30648, 'loss/train': 1.6494215726852417}}}
+11/07/2021 01:34:45 - INFO - __main__ - Step 30653: {'lr': 0.0004551701260829166, 'samples': 5885376, 'steps': 30652, 'loss/train': 1.7156943082809448}}}
+11/07/2021 01:34:47 - INFO - __main__ - Step 30657: {'lr': 0.0004551579965168876, 'samples': 5886144, 'steps': 30656, 'loss/train': 1.431735634803772}}}}
+11/07/2021 01:34:47 - INFO - __main__ - Step 30657: {'lr': 0.0004551579965168876, 'samples': 5886144, 'steps': 30656, 'loss/train': 1.431735634803772}}}}
+11/07/2021 01:34:52 - INFO - __main__ - Step 30665: {'lr': 0.0004551337329477477, 'samples': 5887680, 'steps': 30664, 'loss/train': 1.2398808002471924}}}
+11/07/2021 01:34:53 - INFO - __main__ - Step 30669: {'lr': 0.00045512159894481183, 'samples': 5888448, 'steps': 30668, 'loss/train': 1.554823637008667}}}
+11/07/2021 01:34:53 - INFO - __main__ - Step 30669: {'lr': 0.00045512159894481183, 'samples': 5888448, 'steps': 30668, 'loss/train': 1.554823637008667}}}
+11/07/2021 01:34:57 - INFO - __main__ - Step 30676: {'lr': 0.0004551003608813784, 'samples': 5889792, 'steps': 30675, 'loss/train': 1.331461787223816}}}}
+11/07/2021 01:34:59 - INFO - __main__ - Step 30680: {'lr': 0.00045508822281196937, 'samples': 5890560, 'steps': 30679, 'loss/train': 1.4626752138137817}}
+11/07/2021 01:35:01 - INFO - __main__ - Step 30685: {'lr': 0.0004550730481460027, 'samples': 5891520, 'steps': 30684, 'loss/train': 1.6096035242080688}}}
+11/07/2021 01:35:03 - INFO - __main__ - Step 30689: {'lr': 0.00045506090674997157, 'samples': 5892288, 'steps': 30688, 'loss/train': 1.6416163444519043}}
+11/07/2021 01:35:05 - INFO - __main__ - Step 30693: {'lr': 0.000455048763875584, 'samples': 5893056, 'steps': 30692, 'loss/train': 1.2560726404190063}3}}
+11/07/2021 01:35:08 - INFO - __main__ - Step 30697: {'lr': 0.0004550366195229274, 'samples': 5893824, 'steps': 30696, 'loss/train': 1.283591628074646}3}}
+11/07/2021 01:35:09 - INFO - __main__ - Step 30701: {'lr': 0.00045502447369208957, 'samples': 5894592, 'steps': 30700, 'loss/train': 0.1268743872642517}}
+11/07/2021 01:35:11 - INFO - __main__ - Step 30705: {'lr': 0.0004550123263831578, 'samples': 5895360, 'steps': 30704, 'loss/train': 2.1430163383483887}}}
+11/07/2021 01:35:13 - INFO - __main__ - Step 30710: {'lr': 0.00045499714016855705, 'samples': 5896320, 'steps': 30709, 'loss/train': 1.656386137008667}}}
+11/07/2021 01:35:13 - INFO - __main__ - Step 30710: {'lr': 0.00045499714016855705, 'samples': 5896320, 'steps': 30709, 'loss/train': 1.656386137008667}}}
+11/07/2021 01:35:17 - INFO - __main__ - Step 30718: {'lr': 0.00045497283742210263, 'samples': 5897856, 'steps': 30717, 'loss/train': 1.0657594203948975}}
+11/07/2021 01:35:19 - INFO - __main__ - Step 30722: {'lr': 0.0004549606838322492, 'samples': 5898624, 'steps': 30721, 'loss/train': 1.3796584606170654}}}
+11/07/2021 01:35:22 - INFO - __main__ - Step 30727: {'lr': 0.00045494548976702, 'samples': 5899584, 'steps': 30726, 'loss/train': 1.3677185773849487}4}}}
+11/07/2021 01:35:24 - INFO - __main__ - Step 30731: {'lr': 0.0004549333328526135, 'samples': 5900352, 'steps': 30730, 'loss/train': 1.7263344526290894}}}
+11/07/2021 01:35:24 - INFO - __main__ - Step 30731: {'lr': 0.0004549333328526135, 'samples': 5900352, 'steps': 30730, 'loss/train': 1.7263344526290894}}}
+11/07/2021 01:35:27 - INFO - __main__ - Step 30738: {'lr': 0.00045491205469737263, 'samples': 5901696, 'steps': 30737, 'loss/train': 1.1181199550628662}}
+11/07/2021 01:35:29 - INFO - __main__ - Step 30742: {'lr': 0.000454899893720226, 'samples': 5902464, 'steps': 30741, 'loss/train': 1.7650607824325562}2}}
+11/07/2021 01:35:32 - INFO - __main__ - Step 30747: {'lr': 0.0004548846904214964, 'samples': 5903424, 'steps': 30746, 'loss/train': 1.4247400760650635}}}
+11/07/2021 01:35:34 - INFO - __main__ - Step 30752: {'lr': 0.0004548694848148199, 'samples': 5904384, 'steps': 30751, 'loss/train': 1.7409619092941284}}}
+11/07/2021 01:35:34 - INFO - __main__ - Step 30752: {'lr': 0.0004548694848148199, 'samples': 5904384, 'steps': 30751, 'loss/train': 1.7409619092941284}}}
+11/07/2021 01:35:37 - INFO - __main__ - Step 30758: {'lr': 0.0004548512350405593, 'samples': 5905536, 'steps': 30757, 'loss/train': 2.074098587036133}}}}
+11/07/2021 01:35:39 - INFO - __main__ - Step 30763: {'lr': 0.00045483602435700233, 'samples': 5906496, 'steps': 30762, 'loss/train': 1.6819427013397217}}
+11/07/2021 01:35:39 - INFO - __main__ - Step 30763: {'lr': 0.00045483602435700233, 'samples': 5906496, 'steps': 30762, 'loss/train': 1.6819427013397217}}
+11/07/2021 01:35:43 - INFO - __main__ - Step 30771: {'lr': 0.0004548116824639931, 'samples': 5908032, 'steps': 30770, 'loss/train': 1.5290954113006592}}}
+11/07/2021 01:35:45 - INFO - __main__ - Step 30775: {'lr': 0.00045479950930260495, 'samples': 5908800, 'steps': 30774, 'loss/train': 1.0466399192810059}}
+11/07/2021 01:35:47 - INFO - __main__ - Step 30779: {'lr': 0.00045478733466474487, 'samples': 5909568, 'steps': 30778, 'loss/train': 1.6353005170822144}}
+11/07/2021 01:35:49 - INFO - __main__ - Step 30784: {'lr': 0.0004547721142912647, 'samples': 5910528, 'steps': 30783, 'loss/train': 1.5956065654754639}}}
+11/07/2021 01:35:49 - INFO - __main__ - Step 30784: {'lr': 0.0004547721142912647, 'samples': 5910528, 'steps': 30783, 'loss/train': 1.5956065654754639}}}
+11/07/2021 01:35:53 - INFO - __main__ - Step 30792: {'lr': 0.00045474775689587576, 'samples': 5912064, 'steps': 30791, 'loss/train': 1.1766566038131714}}
+11/07/2021 01:35:55 - INFO - __main__ - Step 30796: {'lr': 0.0004547355759839891, 'samples': 5912832, 'steps': 30795, 'loss/train': 1.5019656419754028}}}
+11/07/2021 01:35:57 - INFO - __main__ - Step 30800: {'lr': 0.0004547233935960914, 'samples': 5913600, 'steps': 30799, 'loss/train': 1.9017813205718994}}}
+11/07/2021 01:35:59 - INFO - __main__ - Step 30805: {'lr': 0.00045470816353571244, 'samples': 5914560, 'steps': 30804, 'loss/train': 1.770569920539856}}}
+11/07/2021 01:35:59 - INFO - __main__ - Step 30805: {'lr': 0.00045470816353571244, 'samples': 5914560, 'steps': 30804, 'loss/train': 1.770569920539856}}}
+11/07/2021 01:36:04 - INFO - __main__ - Step 30813: {'lr': 0.0004546837906427839, 'samples': 5916096, 'steps': 30812, 'loss/train': 1.618916392326355}}}}
+11/07/2021 01:36:05 - INFO - __main__ - Step 30817: {'lr': 0.0004546716019828191, 'samples': 5916864, 'steps': 30816, 'loss/train': 1.5973073244094849}}}
+11/07/2021 01:36:07 - INFO - __main__ - Step 30821: {'lr': 0.0004546594118473044, 'samples': 5917632, 'steps': 30820, 'loss/train': 1.6678979396820068}}}
+11/07/2021 01:36:09 - INFO - __main__ - Step 30826: {'lr': 0.00045464417210305303, 'samples': 5918592, 'steps': 30825, 'loss/train': 0.868805468082428}}}
+11/07/2021 01:36:12 - INFO - __main__ - Step 30830: {'lr': 0.0004546319786478726, 'samples': 5919360, 'steps': 30829, 'loss/train': 1.4833358526229858}}}
+11/07/2021 01:36:14 - INFO - __main__ - Step 30834: {'lr': 0.00045461978371742794, 'samples': 5920128, 'steps': 30833, 'loss/train': 2.1018025875091553}}
+11/07/2021 01:36:15 - INFO - __main__ - Step 30838: {'lr': 0.000454607587311807, 'samples': 5920896, 'steps': 30837, 'loss/train': 1.4543534517288208}3}}
+11/07/2021 01:36:17 - INFO - __main__ - Step 30842: {'lr': 0.00045459538943109774, 'samples': 5921664, 'steps': 30841, 'loss/train': 1.5130547285079956}}
+11/07/2021 01:36:20 - INFO - __main__ - Step 30847: {'lr': 0.00045458014000600213, 'samples': 5922624, 'steps': 30846, 'loss/train': 1.7849777936935425}}
+11/07/2021 01:36:20 - INFO - __main__ - Step 30847: {'lr': 0.00045458014000600213, 'samples': 5922624, 'steps': 30846, 'loss/train': 1.7849777936935425}}
+11/07/2021 01:36:23 - INFO - __main__ - Step 30854: {'lr': 0.0004545587869393193, 'samples': 5923968, 'steps': 30853, 'loss/train': 0.9640048742294312}}}
+11/07/2021 01:36:25 - INFO - __main__ - Step 30858: {'lr': 0.00045454658315913617, 'samples': 5924736, 'steps': 30857, 'loss/train': 1.4153854846954346}}
+11/07/2021 01:36:28 - INFO - __main__ - Step 30863: {'lr': 0.000454531326360193, 'samples': 5925696, 'steps': 30862, 'loss/train': 1.8231418132781982}6}}
+11/07/2021 01:36:30 - INFO - __main__ - Step 30868: {'lr': 0.00045451606725728337, 'samples': 5926656, 'steps': 30867, 'loss/train': 1.2515405416488647}}
+11/07/2021 01:36:32 - INFO - __main__ - Step 30872: {'lr': 0.00045450385831621534, 'samples': 5927424, 'steps': 30871, 'loss/train': 1.7874201536178589}}
+11/07/2021 01:36:32 - INFO - __main__ - Step 30872: {'lr': 0.00045450385831621534, 'samples': 5927424, 'steps': 30871, 'loss/train': 1.7874201536178589}}
+11/07/2021 01:36:35 - INFO - __main__ - Step 30879: {'lr': 0.00045448248912176726, 'samples': 5928768, 'steps': 30878, 'loss/train': 1.218980312347412}}}
+11/07/2021 01:36:38 - INFO - __main__ - Step 30884: {'lr': 0.0004544672226473201, 'samples': 5929728, 'steps': 30883, 'loss/train': 1.5864168405532837}}}
+11/07/2021 01:36:40 - INFO - __main__ - Step 30888: {'lr': 0.0004544550078094182, 'samples': 5930496, 'steps': 30887, 'loss/train': 1.7455068826675415}}}
+11/07/2021 01:36:42 - INFO - __main__ - Step 30892: {'lr': 0.0004544427914975279, 'samples': 5931264, 'steps': 30891, 'loss/train': 1.3994450569152832}}}
+11/07/2021 01:36:43 - INFO - __main__ - Step 30896: {'lr': 0.00045443057371173727, 'samples': 5932032, 'steps': 30895, 'loss/train': 1.4993561506271362}}
+11/07/2021 01:36:45 - INFO - __main__ - Step 30900: {'lr': 0.0004544183544521345, 'samples': 5932800, 'steps': 30899, 'loss/train': 2.022730827331543}2}}
+11/07/2021 01:36:48 - INFO - __main__ - Step 30905: {'lr': 0.0004544030783052169, 'samples': 5933760, 'steps': 30904, 'loss/train': 1.6024492979049683}}}
+11/07/2021 01:36:50 - INFO - __main__ - Step 30909: {'lr': 0.0004543908557298588, 'samples': 5934528, 'steps': 30908, 'loss/train': 1.8101469278335571}}}
+11/07/2021 01:36:52 - INFO - __main__ - Step 30913: {'lr': 0.0004543786316809749, 'samples': 5935296, 'steps': 30912, 'loss/train': 1.6242061853408813}}}
+11/07/2021 01:36:54 - INFO - __main__ - Step 30917: {'lr': 0.0004543664061586532, 'samples': 5936064, 'steps': 30916, 'loss/train': 1.454323649406433}}}}
+11/07/2021 01:36:56 - INFO - __main__ - Step 30921: {'lr': 0.00045435417916298205, 'samples': 5936832, 'steps': 30920, 'loss/train': 1.4937081336975098}}
+11/07/2021 01:36:58 - INFO - __main__ - Step 30925: {'lr': 0.0004543419506940494, 'samples': 5937600, 'steps': 30924, 'loss/train': 1.425700306892395}8}}
+11/07/2021 01:37:00 - INFO - __main__ - Step 30930: {'lr': 0.0004543266630362439, 'samples': 5938560, 'steps': 30929, 'loss/train': 1.2183094024658203}}}
+11/07/2021 01:37:00 - INFO - __main__ - Step 30930: {'lr': 0.0004543266630362439, 'samples': 5938560, 'steps': 30929, 'loss/train': 1.2183094024658203}}}
+11/07/2021 01:37:03 - INFO - __main__ - Step 30937: {'lr': 0.0004543052564485644, 'samples': 5939904, 'steps': 30936, 'loss/train': 1.327895164489746}}}}
+11/07/2021 01:37:06 - INFO - __main__ - Step 30941: {'lr': 0.0004542930220874677, 'samples': 5940672, 'steps': 30940, 'loss/train': 1.8650132417678833}}}
+11/07/2021 01:37:08 - INFO - __main__ - Step 30946: {'lr': 0.0004542777270649533, 'samples': 5941632, 'steps': 30945, 'loss/train': 1.518599033355713}}}}
+11/07/2021 01:37:08 - INFO - __main__ - Step 30946: {'lr': 0.0004542777270649533, 'samples': 5941632, 'steps': 30945, 'loss/train': 1.518599033355713}}}}
+11/07/2021 01:37:12 - INFO - __main__ - Step 30954: {'lr': 0.0004542532502426935, 'samples': 5943168, 'steps': 30953, 'loss/train': 1.6398005485534668}}}
+11/07/2021 01:37:13 - INFO - __main__ - Step 30958: {'lr': 0.00045424100962271883, 'samples': 5943936, 'steps': 30957, 'loss/train': 1.5568513870239258}}
+11/07/2021 01:37:16 - INFO - __main__ - Step 30962: {'lr': 0.00045422876753029853, 'samples': 5944704, 'steps': 30961, 'loss/train': 1.60807466506958}8}}
+11/07/2021 01:37:18 - INFO - __main__ - Step 30966: {'lr': 0.00045421652396552094, 'samples': 5945472, 'steps': 30965, 'loss/train': 1.6757169961929321}}
+11/07/2021 01:37:20 - INFO - __main__ - Step 30970: {'lr': 0.0004542042789284744, 'samples': 5946240, 'steps': 30969, 'loss/train': 1.701396107673645}1}}
+11/07/2021 01:37:22 - INFO - __main__ - Step 30974: {'lr': 0.00045419203241924705, 'samples': 5947008, 'steps': 30973, 'loss/train': 1.4163742065429688}}
+11/07/2021 01:37:23 - INFO - __main__ - Step 30978: {'lr': 0.0004541797844379273, 'samples': 5947776, 'steps': 30977, 'loss/train': 1.4600822925567627}}}
+11/07/2021 01:37:25 - INFO - __main__ - Step 30982: {'lr': 0.0004541675349846033, 'samples': 5948544, 'steps': 30981, 'loss/train': 1.3606353998184204}}}
+11/07/2021 01:37:28 - INFO - __main__ - Step 30987: {'lr': 0.000454152221098077, 'samples': 5949504, 'steps': 30986, 'loss/train': 1.2379319667816162}}}}
+11/07/2021 01:37:30 - INFO - __main__ - Step 30991: {'lr': 0.0004541399683330666, 'samples': 5950272, 'steps': 30990, 'loss/train': 1.38321053981781}}}}}
+11/07/2021 01:37:32 - INFO - __main__ - Step 30995: {'lr': 0.00045412771409633905, 'samples': 5951040, 'steps': 30994, 'loss/train': 1.0903595685958862}}
+11/07/2021 01:37:33 - INFO - __main__ - Step 30999: {'lr': 0.00045411545838798273, 'samples': 5951808, 'steps': 30998, 'loss/train': 1.1896541118621826}}
+11/07/2021 01:37:35 - INFO - __main__ - Step 31003: {'lr': 0.000454103201208086, 'samples': 5952576, 'steps': 31002, 'loss/train': 1.9771652221679688}6}}
+11/07/2021 01:37:38 - INFO - __main__ - Step 31008: {'lr': 0.00045408787766399605, 'samples': 5953536, 'steps': 31007, 'loss/train': 1.7356077432632446}}
+11/07/2021 01:37:40 - INFO - __main__ - Step 31012: {'lr': 0.0004540756171734565, 'samples': 5954304, 'steps': 31011, 'loss/train': 1.0137343406677246}}}
+11/07/2021 01:37:42 - INFO - __main__ - Step 31016: {'lr': 0.0004540633552116638, 'samples': 5955072, 'steps': 31015, 'loss/train': 1.128483772277832}}}}
+11/07/2021 01:37:44 - INFO - __main__ - Step 31020: {'lr': 0.0004540510917787063, 'samples': 5955840, 'steps': 31019, 'loss/train': 1.4873820543289185}}}
+11/07/2021 01:37:46 - INFO - __main__ - Step 31024: {'lr': 0.0004540388268746724, 'samples': 5956608, 'steps': 31023, 'loss/train': 1.7353435754776}85}}}
+11/07/2021 01:37:48 - INFO - __main__ - Step 31029: {'lr': 0.0004540234936760636, 'samples': 5957568, 'steps': 31028, 'loss/train': 1.6700613498687744}}}
+11/07/2021 01:37:50 - INFO - __main__ - Step 31033: {'lr': 0.0004540112254624312, 'samples': 5958336, 'steps': 31032, 'loss/train': 1.4836091995239258}}}
+11/07/2021 01:37:50 - INFO - __main__ - Step 31033: {'lr': 0.0004540112254624312, 'samples': 5958336, 'steps': 31032, 'loss/train': 1.4836091995239258}}}
+11/07/2021 01:37:53 - INFO - __main__ - Step 31040: {'lr': 0.0004539897525495418, 'samples': 5959680, 'steps': 31039, 'loss/train': 1.6444486379623413}}}
+11/07/2021 01:37:56 - INFO - __main__ - Step 31045: {'lr': 0.00045397441199715406, 'samples': 5960640, 'steps': 31044, 'loss/train': 1.871448040008545}}}
+11/07/2021 01:37:58 - INFO - __main__ - Step 31050: {'lr': 0.0004539590691470733, 'samples': 5961600, 'steps': 31049, 'loss/train': 1.3571999073028564}}}
+11/07/2021 01:37:58 - INFO - __main__ - Step 31050: {'lr': 0.0004539590691470733, 'samples': 5961600, 'steps': 31049, 'loss/train': 1.3571999073028564}}}
+11/07/2021 01:38:02 - INFO - __main__ - Step 31057: {'lr': 0.00045393758529716497, 'samples': 5962944, 'steps': 31056, 'loss/train': 1.5746870040893555}}
+11/07/2021 01:38:03 - INFO - __main__ - Step 31061: {'lr': 0.00045392530678986775, 'samples': 5963712, 'steps': 31060, 'loss/train': 1.517366647720337}}}
+11/07/2021 01:38:06 - INFO - __main__ - Step 31066: {'lr': 0.0004539099565883308, 'samples': 5964672, 'steps': 31065, 'loss/train': 1.4995030164718628}}}
+11/07/2021 01:38:06 - INFO - __main__ - Step 31066: {'lr': 0.0004539099565883308, 'samples': 5964672, 'steps': 31065, 'loss/train': 1.4995030164718628}}}
+11/07/2021 01:38:10 - INFO - __main__ - Step 31074: {'lr': 0.00045388539148825214, 'samples': 5966208, 'steps': 31073, 'loss/train': 1.272490382194519}}}
+11/07/2021 01:38:12 - INFO - __main__ - Step 31078: {'lr': 0.0004538731067333459, 'samples': 5966976, 'steps': 31077, 'loss/train': 1.8784071207046509}}}
+11/07/2021 01:38:14 - INFO - __main__ - Step 31082: {'lr': 0.0004538608205086464, 'samples': 5967744, 'steps': 31081, 'loss/train': 1.457392692565918}}}}
+11/07/2021 01:38:16 - INFO - __main__ - Step 31087: {'lr': 0.0004538454606610103, 'samples': 5968704, 'steps': 31086, 'loss/train': 1.311660647392273}}}}
+11/07/2021 01:38:19 - INFO - __main__ - Step 31091: {'lr': 0.00045383317112959997, 'samples': 5969472, 'steps': 31090, 'loss/train': 0.956122636795044}}}
+11/07/2021 01:38:21 - INFO - __main__ - Step 31095: {'lr': 0.0004538208801286843, 'samples': 5970240, 'steps': 31094, 'loss/train': 1.6640911102294922}}}
+11/07/2021 01:38:22 - INFO - __main__ - Step 31099: {'lr': 0.000453808587658352, 'samples': 5971008, 'steps': 31098, 'loss/train': 1.3138790130615234}}}}
+11/07/2021 01:38:24 - INFO - __main__ - Step 31103: {'lr': 0.0004537962937186916, 'samples': 5971776, 'steps': 31102, 'loss/train': 1.065061092376709}}}}
+11/07/2021 01:38:24 - INFO - __main__ - Step 31103: {'lr': 0.0004537962937186916, 'samples': 5971776, 'steps': 31102, 'loss/train': 1.065061092376709}}}}
+11/07/2021 01:38:28 - INFO - __main__ - Step 31111: {'lr': 0.0004537717014317411, 'samples': 5973312, 'steps': 31110, 'loss/train': 1.3271428346633911}}}
+11/07/2021 01:38:30 - INFO - __main__ - Step 31115: {'lr': 0.00045375940308462826, 'samples': 5974080, 'steps': 31114, 'loss/train': 1.6915082931518555}}
+11/07/2021 01:38:32 - INFO - __main__ - Step 31119: {'lr': 0.00045374710326854194, 'samples': 5974848, 'steps': 31118, 'loss/train': 1.8023872375488281}}
+11/07/2021 01:38:34 - INFO - __main__ - Step 31123: {'lr': 0.0004537348019835709, 'samples': 5975616, 'steps': 31122, 'loss/train': 1.7239537239074707}}}
+11/07/2021 01:38:36 - INFO - __main__ - Step 31128: {'lr': 0.00045371942331187286, 'samples': 5976576, 'steps': 31127, 'loss/train': 1.8973110914230347}}
+11/07/2021 01:38:36 - INFO - __main__ - Step 31128: {'lr': 0.00045371942331187286, 'samples': 5976576, 'steps': 31127, 'loss/train': 1.8973110914230347}}
+11/07/2021 01:38:40 - INFO - __main__ - Step 31134: {'lr': 0.00045370096587668714, 'samples': 5977728, 'steps': 31133, 'loss/train': 1.3561971187591553}}
+11/07/2021 01:38:40 - INFO - __main__ - Step 31134: {'lr': 0.00045370096587668714, 'samples': 5977728, 'steps': 31133, 'loss/train': 1.3561971187591553}}
+11/07/2021 01:38:44 - INFO - __main__ - Step 31143: {'lr': 0.0004536732735285476, 'samples': 5979456, 'steps': 31142, 'loss/train': 1.359701156616211}3}}
+11/07/2021 01:38:44 - INFO - __main__ - Step 31143: {'lr': 0.0004536732735285476, 'samples': 5979456, 'steps': 31142, 'loss/train': 1.359701156616211}3}}
+11/07/2021 01:38:48 - INFO - __main__ - Step 31150: {'lr': 0.0004536517298962645, 'samples': 5980800, 'steps': 31149, 'loss/train': 2.274333953857422}3}}
+11/07/2021 01:38:50 - INFO - __main__ - Step 31154: {'lr': 0.00045363941723044386, 'samples': 5981568, 'steps': 31153, 'loss/train': 1.6942732334136963}}
+11/07/2021 01:38:52 - INFO - __main__ - Step 31158: {'lr': 0.0004536271030965148, 'samples': 5982336, 'steps': 31157, 'loss/train': 1.5780308246612549}}}
+11/07/2021 01:38:54 - INFO - __main__ - Step 31162: {'lr': 0.00045361478749456595, 'samples': 5983104, 'steps': 31161, 'loss/train': 1.8032037019729614}}
+11/07/2021 01:38:56 - INFO - __main__ - Step 31168: {'lr': 0.00045359631133930016, 'samples': 5984256, 'steps': 31167, 'loss/train': 1.7573238611221313}}
+11/07/2021 01:38:56 - INFO - __main__ - Step 31168: {'lr': 0.00045359631133930016, 'samples': 5984256, 'steps': 31167, 'loss/train': 1.7573238611221313}}
+11/07/2021 01:39:01 - INFO - __main__ - Step 31175: {'lr': 0.0004535747516507947, 'samples': 5985600, 'steps': 31174, 'loss/train': 1.1287404298782349}}}
+11/07/2021 01:39:02 - INFO - __main__ - Step 31179: {'lr': 0.0004535624298107529, 'samples': 5986368, 'steps': 31178, 'loss/train': 1.567328929901123}}}}
+11/07/2021 01:39:04 - INFO - __main__ - Step 31183: {'lr': 0.0004535501065031577, 'samples': 5987136, 'steps': 31182, 'loss/train': 1.4410059452056885}}}
+11/07/2021 01:39:04 - INFO - __main__ - Step 31183: {'lr': 0.0004535501065031577, 'samples': 5987136, 'steps': 31182, 'loss/train': 1.4410059452056885}}}
+11/07/2021 01:39:08 - INFO - __main__ - Step 31192: {'lr': 0.00045352237369578643, 'samples': 5988864, 'steps': 31191, 'loss/train': 1.604499340057373}}}
+11/07/2021 01:39:11 - INFO - __main__ - Step 31196: {'lr': 0.0004535100456192562, 'samples': 5989632, 'steps': 31195, 'loss/train': 1.4107824563980103}}}
+11/07/2021 01:39:12 - INFO - __main__ - Step 31200: {'lr': 0.00045349771607555017, 'samples': 5990400, 'steps': 31199, 'loss/train': 1.4114199876785278}}
+11/07/2021 01:39:14 - INFO - __main__ - Step 31204: {'lr': 0.0004534853850647572, 'samples': 5991168, 'steps': 31203, 'loss/train': 0.8451942205429077}}}
+11/07/2021 01:39:17 - INFO - __main__ - Step 31209: {'lr': 0.0004534699692383106, 'samples': 5992128, 'steps': 31208, 'loss/train': 2.1556811332702637}}}
+11/07/2021 01:39:19 - INFO - __main__ - Step 31213: {'lr': 0.0004534576349268973, 'samples': 5992896, 'steps': 31212, 'loss/train': 1.6039478778839111}}}
+11/07/2021 01:39:21 - INFO - __main__ - Step 31217: {'lr': 0.00045344529914868593, 'samples': 5993664, 'steps': 31216, 'loss/train': 1.2807214260101318}}
+11/07/2021 01:39:22 - INFO - __main__ - Step 31221: {'lr': 0.00045343296190376566, 'samples': 5994432, 'steps': 31220, 'loss/train': 1.400227665901184}}}
+11/07/2021 01:39:24 - INFO - __main__ - Step 31225: {'lr': 0.0004534206231922253, 'samples': 5995200, 'steps': 31224, 'loss/train': 1.1981773376464844}}}
+11/07/2021 01:39:27 - INFO - __main__ - Step 31230: {'lr': 0.00045340519774050093, 'samples': 5996160, 'steps': 31229, 'loss/train': 1.1463749408721924}}
+11/07/2021 01:39:27 - INFO - __main__ - Step 31230: {'lr': 0.00045340519774050093, 'samples': 5996160, 'steps': 31229, 'loss/train': 1.1463749408721924}}
+11/07/2021 01:39:30 - INFO - __main__ - Step 31236: {'lr': 0.00045338668417395595, 'samples': 5997312, 'steps': 31235, 'loss/train': 0.497263103723526}}}
+11/07/2021 01:39:33 - INFO - __main__ - Step 31241: {'lr': 0.0004533712536816426, 'samples': 5998272, 'steps': 31240, 'loss/train': 1.227736234664917}}}}
+11/07/2021 01:39:35 - INFO - __main__ - Step 31245: {'lr': 0.00045335890763833646, 'samples': 5999040, 'steps': 31244, 'loss/train': 2.0331690311431885}}
+11/07/2021 01:39:37 - INFO - __main__ - Step 31249: {'lr': 0.00045334656012894424, 'samples': 5999808, 'steps': 31248, 'loss/train': 1.0691889524459839}}
+11/07/2021 01:39:39 - INFO - __main__ - Step 31253: {'lr': 0.00045333421115355477, 'samples': 6000576, 'steps': 31252, 'loss/train': 1.006943702697754}}}
+11/07/2021 01:39:40 - INFO - __main__ - Step 31257: {'lr': 0.00045332186071225724, 'samples': 6001344, 'steps': 31256, 'loss/train': 1.2591632604599}4}}}
+11/07/2021 01:39:42 - INFO - __main__ - Step 31261: {'lr': 0.00045330950880514065, 'samples': 6002112, 'steps': 31260, 'loss/train': 1.3240946531295776}}
+11/07/2021 01:39:45 - INFO - __main__ - Step 31266: {'lr': 0.0004532940668600724, 'samples': 6003072, 'steps': 31265, 'loss/train': 0.8703139424324036}}}
+11/07/2021 01:39:47 - INFO - __main__ - Step 31270: {'lr': 0.0004532817116551884, 'samples': 6003840, 'steps': 31269, 'loss/train': 1.169777512550354}}}}
+11/07/2021 01:39:49 - INFO - __main__ - Step 31274: {'lr': 0.00045326935498477477, 'samples': 6004608, 'steps': 31273, 'loss/train': 1.14182448387146}}}}
+11/07/2021 01:39:50 - INFO - __main__ - Step 31278: {'lr': 0.00045325699684892065, 'samples': 6005376, 'steps': 31277, 'loss/train': 1.491533875465393}}}
+11/07/2021 01:39:52 - INFO - __main__ - Step 31282: {'lr': 0.000453244637247715, 'samples': 6006144, 'steps': 31281, 'loss/train': 0.903304934501648}3}}}
+11/07/2021 01:39:55 - INFO - __main__ - Step 31287: {'lr': 0.00045322918568569315, 'samples': 6007104, 'steps': 31286, 'loss/train': 1.453641414642334}}}
+11/07/2021 01:39:57 - INFO - __main__ - Step 31291: {'lr': 0.00045321682278777253, 'samples': 6007872, 'steps': 31290, 'loss/train': 1.9191278219223022}}
+11/07/2021 01:39:59 - INFO - __main__ - Step 31295: {'lr': 0.0004532044584247901, 'samples': 6008640, 'steps': 31294, 'loss/train': 1.4246947765350342}}}
+11/07/2021 01:40:00 - INFO - __main__ - Step 31299: {'lr': 0.00045319209259683503, 'samples': 6009408, 'steps': 31298, 'loss/train': 1.696137547492981}}}
+11/07/2021 01:40:03 - INFO - __main__ - Step 31303: {'lr': 0.00045317972530399634, 'samples': 6010176, 'steps': 31302, 'loss/train': 1.545304536819458}}}
+11/07/2021 01:40:03 - INFO - __main__ - Step 31303: {'lr': 0.00045317972530399634, 'samples': 6010176, 'steps': 31302, 'loss/train': 1.545304536819458}}}
+11/07/2021 01:40:07 - INFO - __main__ - Step 31311: {'lr': 0.00045315498632402494, 'samples': 6011712, 'steps': 31310, 'loss/train': 1.181226372718811}}}
+11/07/2021 01:40:09 - INFO - __main__ - Step 31315: {'lr': 0.00045314261463707064, 'samples': 6012480, 'steps': 31314, 'loss/train': 0.8304257392883301}}
+11/07/2021 01:40:11 - INFO - __main__ - Step 31319: {'lr': 0.0004531302414855895, 'samples': 6013248, 'steps': 31318, 'loss/train': 1.498241662979126}1}}
+11/07/2021 01:40:11 - INFO - __main__ - Step 31319: {'lr': 0.0004531302414855895, 'samples': 6013248, 'steps': 31318, 'loss/train': 1.498241662979126}1}}
+11/07/2021 01:40:11 - INFO - __main__ - Step 31319: {'lr': 0.0004531302414855895, 'samples': 6013248, 'steps': 31318, 'loss/train': 1.498241662979126}1}}
+11/07/2021 01:40:16 - INFO - __main__ - Step 31330: {'lr': 0.00045309620776827817, 'samples': 6015360, 'steps': 31329, 'loss/train': 1.5829106569290161}}
+11/07/2021 01:40:18 - INFO - __main__ - Step 31334: {'lr': 0.0004530838291256159, 'samples': 6016128, 'steps': 31333, 'loss/train': 1.8291977643966675}}}
+11/07/2021 01:40:21 - INFO - __main__ - Step 31339: {'lr': 0.00045306835376340366, 'samples': 6017088, 'steps': 31338, 'loss/train': 1.6746957302093506}}
+11/07/2021 01:40:23 - INFO - __main__ - Step 31343: {'lr': 0.0004530559718266351, 'samples': 6017856, 'steps': 31342, 'loss/train': 1.5785162448883057}}}
+11/07/2021 01:40:25 - INFO - __main__ - Step 31347: {'lr': 0.0004530435884259644, 'samples': 6018624, 'steps': 31346, 'loss/train': 1.60947847366333}7}}}
+11/07/2021 01:40:26 - INFO - __main__ - Step 31351: {'lr': 0.00045303120356148067, 'samples': 6019392, 'steps': 31350, 'loss/train': 1.539341688156128}}}
+11/07/2021 01:40:28 - INFO - __main__ - Step 31355: {'lr': 0.0004530188172332733, 'samples': 6020160, 'steps': 31354, 'loss/train': 1.6850532293319702}}}
+11/07/2021 01:40:31 - INFO - __main__ - Step 31360: {'lr': 0.00045300333226478887, 'samples': 6021120, 'steps': 31359, 'loss/train': 1.4599359035491943}}
+11/07/2021 01:40:33 - INFO - __main__ - Step 31364: {'lr': 0.00045299094264352987, 'samples': 6021888, 'steps': 31363, 'loss/train': 1.5297051668167114}}
+11/07/2021 01:40:33 - INFO - __main__ - Step 31364: {'lr': 0.00045299094264352987, 'samples': 6021888, 'steps': 31363, 'loss/train': 1.5297051668167114}}
+11/07/2021 01:40:36 - INFO - __main__ - Step 31371: {'lr': 0.0004529692572849938, 'samples': 6023232, 'steps': 31370, 'loss/train': 1.7392520904541016}}}
+11/07/2021 01:40:38 - INFO - __main__ - Step 31376: {'lr': 0.0004529537649995099, 'samples': 6024192, 'steps': 31375, 'loss/train': 1.51448392868042}6}}}
+11/07/2021 01:40:41 - INFO - __main__ - Step 31380: {'lr': 0.00045294136952505346, 'samples': 6024960, 'steps': 31379, 'loss/train': 1.8567157983779907}}
+11/07/2021 01:40:43 - INFO - __main__ - Step 31384: {'lr': 0.00045292897258752095, 'samples': 6025728, 'steps': 31383, 'loss/train': 5.561633110046387}}}
+11/07/2021 01:40:44 - INFO - __main__ - Step 31388: {'lr': 0.0004529165741870018, 'samples': 6026496, 'steps': 31387, 'loss/train': 1.2687602043151855}}}
+11/07/2021 01:40:46 - INFO - __main__ - Step 31392: {'lr': 0.00045290417432358553, 'samples': 6027264, 'steps': 31391, 'loss/train': 1.7551089525222778}}
+11/07/2021 01:40:49 - INFO - __main__ - Step 31397: {'lr': 0.00045288867243725207, 'samples': 6028224, 'steps': 31396, 'loss/train': 0.6855195760726929}}
+11/07/2021 01:40:51 - INFO - __main__ - Step 31401: {'lr': 0.0004528762692826439, 'samples': 6028992, 'steps': 31400, 'loss/train': 1.1373130083084106}}}
+11/07/2021 01:40:53 - INFO - __main__ - Step 31405: {'lr': 0.00045286386466542896, 'samples': 6029760, 'steps': 31404, 'loss/train': 0.9506607055664062}}
+11/07/2021 01:40:54 - INFO - __main__ - Step 31409: {'lr': 0.0004528514585856968, 'samples': 6030528, 'steps': 31408, 'loss/train': 1.5592893362045288}}}
+11/07/2021 01:40:56 - INFO - __main__ - Step 31413: {'lr': 0.0004528390510435368, 'samples': 6031296, 'steps': 31412, 'loss/train': 1.2986992597579956}}}
+11/07/2021 01:40:59 - INFO - __main__ - Step 31418: {'lr': 0.00045282353955943417, 'samples': 6032256, 'steps': 31417, 'loss/train': 1.755852222442627}}}
+11/07/2021 01:41:01 - INFO - __main__ - Step 31422: {'lr': 0.0004528111287271388, 'samples': 6033024, 'steps': 31421, 'loss/train': 1.262176752090454}}}}
+11/07/2021 01:41:03 - INFO - __main__ - Step 31426: {'lr': 0.0004527987164327063, 'samples': 6033792, 'steps': 31425, 'loss/train': 1.0587403774261475}}}
+11/07/2021 01:41:03 - INFO - __main__ - Step 31426: {'lr': 0.0004527987164327063, 'samples': 6033792, 'steps': 31425, 'loss/train': 1.0587403774261475}}}
+11/07/2021 01:41:06 - INFO - __main__ - Step 31433: {'lr': 0.0004527769913994515, 'samples': 6035136, 'steps': 31432, 'loss/train': 1.1822314262390137}}}
+11/07/2021 01:41:09 - INFO - __main__ - Step 31439: {'lr': 0.0004527583663789986, 'samples': 6036288, 'steps': 31438, 'loss/train': 0.918387770652771}}}}
+11/07/2021 01:41:11 - INFO - __main__ - Step 31444: {'lr': 0.00045274284301621414, 'samples': 6037248, 'steps': 31443, 'loss/train': 1.4954262971878052}}
+11/07/2021 01:41:13 - INFO - __main__ - Step 31448: {'lr': 0.0004527304226816278, 'samples': 6038016, 'steps': 31447, 'loss/train': 1.6347882747650146}}}
+11/07/2021 01:41:13 - INFO - __main__ - Step 31448: {'lr': 0.0004527304226816278, 'samples': 6038016, 'steps': 31447, 'loss/train': 1.6347882747650146}}}
+11/07/2021 01:41:17 - INFO - __main__ - Step 31455: {'lr': 0.0004527086835792884, 'samples': 6039360, 'steps': 31454, 'loss/train': 1.391819715499878}}}}
+11/07/2021 01:41:17 - INFO - __main__ - Step 31455: {'lr': 0.0004527086835792884, 'samples': 6039360, 'steps': 31454, 'loss/train': 1.391819715499878}}}}
+11/07/2021 01:41:21 - INFO - __main__ - Step 31463: {'lr': 0.0004526838334106842, 'samples': 6040896, 'steps': 31462, 'loss/train': 1.9305704832077026}}}
+11/07/2021 01:41:21 - INFO - __main__ - Step 31463: {'lr': 0.0004526838334106842, 'samples': 6040896, 'steps': 31462, 'loss/train': 1.9305704832077026}}}
+11/07/2021 01:41:24 - INFO - __main__ - Step 31471: {'lr': 0.00045265897739720277, 'samples': 6042432, 'steps': 31470, 'loss/train': 1.2458423376083374}}
+11/07/2021 01:41:26 - INFO - __main__ - Step 31475: {'lr': 0.000452646547198857, 'samples': 6043200, 'steps': 31474, 'loss/train': 1.3974919319152832}4}}
+11/07/2021 01:41:29 - INFO - __main__ - Step 31480: {'lr': 0.00045263100739647373, 'samples': 6044160, 'steps': 31479, 'loss/train': 1.4764176607131958}}
+11/07/2021 01:41:31 - INFO - __main__ - Step 31485: {'lr': 0.0004526154653115303, 'samples': 6045120, 'steps': 31484, 'loss/train': 1.9318288564682007}}}
+11/07/2021 01:41:33 - INFO - __main__ - Step 31489: {'lr': 0.00045260303000024994, 'samples': 6045888, 'steps': 31488, 'loss/train': 1.7852832078933716}}
+11/07/2021 01:41:33 - INFO - __main__ - Step 31489: {'lr': 0.00045260303000024994, 'samples': 6045888, 'steps': 31488, 'loss/train': 1.7852832078933716}}
+11/07/2021 01:41:36 - INFO - __main__ - Step 31496: {'lr': 0.0004525812646909059, 'samples': 6047232, 'steps': 31495, 'loss/train': 1.5362430810928345}}}
+11/07/2021 01:41:39 - INFO - __main__ - Step 31501: {'lr': 0.00045256571530294664, 'samples': 6048192, 'steps': 31500, 'loss/train': 1.1621021032333374}}
+11/07/2021 01:41:41 - INFO - __main__ - Step 31506: {'lr': 0.0004525501636331628, 'samples': 6049152, 'steps': 31505, 'loss/train': 1.6992638111114502}}}
+11/07/2021 01:41:41 - INFO - __main__ - Step 31506: {'lr': 0.0004525501636331628, 'samples': 6049152, 'steps': 31505, 'loss/train': 1.6992638111114502}}}
+11/07/2021 01:41:45 - INFO - __main__ - Step 31513: {'lr': 0.0004525283874623336, 'samples': 6050496, 'steps': 31512, 'loss/train': 1.5510832071304321}}}
+11/07/2021 01:41:46 - INFO - __main__ - Step 31517: {'lr': 0.000452515941928479, 'samples': 6051264, 'steps': 31516, 'loss/train': 1.4280192852020264}}}}
+11/07/2021 01:41:48 - INFO - __main__ - Step 31521: {'lr': 0.0004525034949346155, 'samples': 6052032, 'steps': 31520, 'loss/train': 1.63162100315094}}}}}
+11/07/2021 01:41:51 - INFO - __main__ - Step 31527: {'lr': 0.0004524848217064997, 'samples': 6053184, 'steps': 31526, 'loss/train': 1.5448814630508423}}}
+11/07/2021 01:41:53 - INFO - __main__ - Step 31531: {'lr': 0.0004524723710630064, 'samples': 6053952, 'steps': 31530, 'loss/train': 1.370402455329895}}}}
+11/07/2021 01:41:55 - INFO - __main__ - Step 31535: {'lr': 0.0004524599189598183, 'samples': 6054720, 'steps': 31534, 'loss/train': 2.3842573165893555}}}
+11/07/2021 01:41:55 - INFO - __main__ - Step 31535: {'lr': 0.0004524599189598183, 'samples': 6054720, 'steps': 31534, 'loss/train': 2.3842573165893555}}}
+11/07/2021 01:41:59 - INFO - __main__ - Step 31542: {'lr': 0.00045243812426711856, 'samples': 6056064, 'steps': 31541, 'loss/train': 1.4651298522949219}}
+11/07/2021 01:42:01 - INFO - __main__ - Step 31547: {'lr': 0.0004524225538929829, 'samples': 6057024, 'steps': 31546, 'loss/train': 1.714564323425293}9}}
+11/07/2021 01:42:01 - INFO - __main__ - Step 31547: {'lr': 0.0004524225538929829, 'samples': 6057024, 'steps': 31546, 'loss/train': 1.714564323425293}9}}
+11/07/2021 01:42:05 - INFO - __main__ - Step 31554: {'lr': 0.00045240075153847625, 'samples': 6058368, 'steps': 31553, 'loss/train': 1.6579509973526}}9}}
+11/07/2021 01:42:07 - INFO - __main__ - Step 31558: {'lr': 0.00045238829104378545, 'samples': 6059136, 'steps': 31557, 'loss/train': 1.4942617416381836}}
+11/07/2021 01:42:09 - INFO - __main__ - Step 31563: {'lr': 0.00045237271337358897, 'samples': 6060096, 'steps': 31562, 'loss/train': 1.5823599100112915}}
+11/07/2021 01:42:11 - INFO - __main__ - Step 31567: {'lr': 0.00045236024959607505, 'samples': 6060864, 'steps': 31566, 'loss/train': 1.4078350067138672}}
+11/07/2021 01:42:13 - INFO - __main__ - Step 31571: {'lr': 0.0004523477843596746, 'samples': 6061632, 'steps': 31570, 'loss/train': 1.3582419157028198}}}
+11/07/2021 01:42:15 - INFO - __main__ - Step 31575: {'lr': 0.00045233531766447757, 'samples': 6062400, 'steps': 31574, 'loss/train': 1.8818330764770508}}
+11/07/2021 01:42:17 - INFO - __main__ - Step 31579: {'lr': 0.00045232284951057366, 'samples': 6063168, 'steps': 31578, 'loss/train': 1.141363263130188}}}
+11/07/2021 01:42:19 - INFO - __main__ - Step 31584: {'lr': 0.00045230726226702444, 'samples': 6064128, 'steps': 31583, 'loss/train': 1.5771918296813965}}
+11/07/2021 01:42:21 - INFO - __main__ - Step 31588: {'lr': 0.00045229479083135917, 'samples': 6064896, 'steps': 31587, 'loss/train': 2.3265585899353027}}
+11/07/2021 01:42:21 - INFO - __main__ - Step 31588: {'lr': 0.00045229479083135917, 'samples': 6064896, 'steps': 31587, 'loss/train': 2.3265585899353027}}
+11/07/2021 01:42:25 - INFO - __main__ - Step 31594: {'lr': 0.0004522760809433619, 'samples': 6066048, 'steps': 31593, 'loss/train': 5.449794292449951}7}}
+11/07/2021 01:42:27 - INFO - __main__ - Step 31600: {'lr': 0.0004522573677742353, 'samples': 6067200, 'steps': 31599, 'loss/train': 1.8566700220108032}}}
+11/07/2021 01:42:30 - INFO - __main__ - Step 31604: {'lr': 0.00045224489050545125, 'samples': 6067968, 'steps': 31603, 'loss/train': 1.3735251426696777}}
+11/07/2021 01:42:30 - INFO - __main__ - Step 31604: {'lr': 0.00045224489050545125, 'samples': 6067968, 'steps': 31603, 'loss/train': 1.3735251426696777}}
+11/07/2021 01:42:33 - INFO - __main__ - Step 31611: {'lr': 0.00045222305177668875, 'samples': 6069312, 'steps': 31610, 'loss/train': 0.9692068696022034}}
+11/07/2021 01:42:35 - INFO - __main__ - Step 31616: {'lr': 0.0004522074499511299, 'samples': 6070272, 'steps': 31615, 'loss/train': 1.5862935781478882}}}
+11/07/2021 01:42:35 - INFO - __main__ - Step 31616: {'lr': 0.0004522074499511299, 'samples': 6070272, 'steps': 31615, 'loss/train': 1.5862935781478882}}}
+11/07/2021 01:42:39 - INFO - __main__ - Step 31624: {'lr': 0.0004521824822925078, 'samples': 6071808, 'steps': 31623, 'loss/train': 1.0066297054290771}}}
+11/07/2021 01:42:41 - INFO - __main__ - Step 31628: {'lr': 0.00045216999627674436, 'samples': 6072576, 'steps': 31627, 'loss/train': 1.5675814151763916}}
+11/07/2021 01:42:43 - INFO - __main__ - Step 31632: {'lr': 0.00045215750880346617, 'samples': 6073344, 'steps': 31631, 'loss/train': 1.265383243560791}}}
+11/07/2021 01:42:45 - INFO - __main__ - Step 31637: {'lr': 0.0004521418974123751, 'samples': 6074304, 'steps': 31636, 'loss/train': 1.620078682899475}}}}
+11/07/2021 01:42:45 - INFO - __main__ - Step 31637: {'lr': 0.0004521418974123751, 'samples': 6074304, 'steps': 31636, 'loss/train': 1.620078682899475}}}}
+11/07/2021 01:42:49 - INFO - __main__ - Step 31643: {'lr': 0.0004521231607373747, 'samples': 6075456, 'steps': 31642, 'loss/train': 1.7724577188491821}}}
+11/07/2021 01:42:49 - INFO - __main__ - Step 31643: {'lr': 0.0004521231607373747, 'samples': 6075456, 'steps': 31642, 'loss/train': 1.7724577188491821}}}
+11/07/2021 01:42:52 - INFO - __main__ - Step 31651: {'lr': 0.0004520981734039731, 'samples': 6076992, 'steps': 31650, 'loss/train': 1.3422218561172485}}}
+11/07/2021 01:42:54 - INFO - __main__ - Step 31655: {'lr': 0.0004520856775517316, 'samples': 6077760, 'steps': 31654, 'loss/train': 1.7040534019470215}}}
+11/07/2021 01:42:57 - INFO - __main__ - Step 31660: {'lr': 0.0004520700556876648, 'samples': 6078720, 'steps': 31659, 'loss/train': 1.4073563814163208}}}
+11/07/2021 01:42:57 - INFO - __main__ - Step 31660: {'lr': 0.0004520700556876648, 'samples': 6078720, 'steps': 31659, 'loss/train': 1.4073563814163208}}}
+11/07/2021 01:42:57 - INFO - __main__ - Step 31660: {'lr': 0.0004520700556876648, 'samples': 6078720, 'steps': 31659, 'loss/train': 1.4073563814163208}}}
+11/07/2021 01:43:03 - INFO - __main__ - Step 31671: {'lr': 0.00045203567957459657, 'samples': 6080832, 'steps': 31670, 'loss/train': 1.2069718837738037}}
+11/07/2021 01:43:05 - INFO - __main__ - Step 31676: {'lr': 0.00045202005042717743, 'samples': 6081792, 'steps': 31675, 'loss/train': 1.475319266319275}}}
+11/07/2021 01:43:07 - INFO - __main__ - Step 31681: {'lr': 0.0004520044190040804, 'samples': 6082752, 'steps': 31680, 'loss/train': 1.6463545560836792}}}
+11/07/2021 01:43:07 - INFO - __main__ - Step 31681: {'lr': 0.0004520044190040804, 'samples': 6082752, 'steps': 31680, 'loss/train': 1.6463545560836792}}}
+11/07/2021 01:43:11 - INFO - __main__ - Step 31688: {'lr': 0.00045198253118894084, 'samples': 6084096, 'steps': 31687, 'loss/train': 1.5900429487228394}}
+11/07/2021 01:43:13 - INFO - __main__ - Step 31692: {'lr': 0.0004519700218637482, 'samples': 6084864, 'steps': 31691, 'loss/train': 1.5056148767471313}}}
+11/07/2021 01:43:15 - INFO - __main__ - Step 31697: {'lr': 0.0004519543831596652, 'samples': 6085824, 'steps': 31696, 'loss/train': 1.0026839971542358}}}
+11/07/2021 01:43:17 - INFO - __main__ - Step 31701: {'lr': 0.0004519418705584348, 'samples': 6086592, 'steps': 31700, 'loss/train': 1.449439525604248}}}}
+11/07/2021 01:43:17 - INFO - __main__ - Step 31701: {'lr': 0.0004519418705584348, 'samples': 6086592, 'steps': 31700, 'loss/train': 1.449439525604248}}}}
+11/07/2021 01:43:21 - INFO - __main__ - Step 31707: {'lr': 0.0004519230989268606, 'samples': 6087744, 'steps': 31706, 'loss/train': 1.0818159580230713}}}
+11/07/2021 01:43:21 - INFO - __main__ - Step 31707: {'lr': 0.0004519230989268606, 'samples': 6087744, 'steps': 31706, 'loss/train': 1.0818159580230713}}}
+11/07/2021 01:43:21 - INFO - __main__ - Step 31707: {'lr': 0.0004519230989268606, 'samples': 6087744, 'steps': 31706, 'loss/train': 1.0818159580230713}}}
+11/07/2021 01:43:27 - INFO - __main__ - Step 31718: {'lr': 0.0004518886757622435, 'samples': 6089856, 'steps': 31717, 'loss/train': 1.869469165802002}}}}
+11/07/2021 01:43:29 - INFO - __main__ - Step 31724: {'lr': 0.00045186989485115014, 'samples': 6091008, 'steps': 31723, 'loss/train': 1.8566874265670776}}
+11/07/2021 01:43:32 - INFO - __main__ - Step 31728: {'lr': 0.0004518573724245467, 'samples': 6091776, 'steps': 31727, 'loss/train': 1.43443763256073}76}}
+11/07/2021 01:43:33 - INFO - __main__ - Step 31732: {'lr': 0.00045184484854268216, 'samples': 6092544, 'steps': 31731, 'loss/train': 2.2386746406555176}}
+11/07/2021 01:43:35 - INFO - __main__ - Step 31736: {'lr': 0.0004518323232056468, 'samples': 6093312, 'steps': 31735, 'loss/train': 1.3299400806427002}}}
+11/07/2021 01:43:37 - INFO - __main__ - Step 31741: {'lr': 0.0004518166644881563, 'samples': 6094272, 'steps': 31740, 'loss/train': 1.8045982122421265}}}
+11/07/2021 01:43:40 - INFO - __main__ - Step 31745: {'lr': 0.0004518041358773168, 'samples': 6095040, 'steps': 31744, 'loss/train': 1.9787827730178833}}}
+11/07/2021 01:43:40 - INFO - __main__ - Step 31745: {'lr': 0.0004518041358773168, 'samples': 6095040, 'steps': 31744, 'loss/train': 1.9787827730178833}}}
+11/07/2021 01:43:43 - INFO - __main__ - Step 31752: {'lr': 0.00045178220730760367, 'samples': 6096384, 'steps': 31751, 'loss/train': 1.2757604122161865}}
+11/07/2021 01:43:45 - INFO - __main__ - Step 31757: {'lr': 0.00045176654131589617, 'samples': 6097344, 'steps': 31756, 'loss/train': 1.2734031677246094}}
+11/07/2021 01:43:47 - INFO - __main__ - Step 31761: {'lr': 0.0004517540068860897, 'samples': 6098112, 'steps': 31760, 'loss/train': 1.867502212524414}4}}
+11/07/2021 01:43:49 - INFO - __main__ - Step 31765: {'lr': 0.00045174147100176734, 'samples': 6098880, 'steps': 31764, 'loss/train': 1.377150535583496}}}
+11/07/2021 01:43:51 - INFO - __main__ - Step 31769: {'lr': 0.0004517289336630195, 'samples': 6099648, 'steps': 31768, 'loss/train': 1.407793641090393}}}}
+11/07/2021 01:43:53 - INFO - __main__ - Step 31773: {'lr': 0.0004517163948699365, 'samples': 6100416, 'steps': 31772, 'loss/train': 1.575675129890442}}}}
+11/07/2021 01:43:55 - INFO - __main__ - Step 31778: {'lr': 0.0004517007193335617, 'samples': 6101376, 'steps': 31777, 'loss/train': 1.0152171850204468}}}
+11/07/2021 01:43:55 - INFO - __main__ - Step 31778: {'lr': 0.0004517007193335617, 'samples': 6101376, 'steps': 31777, 'loss/train': 1.0152171850204468}}}
+11/07/2021 01:44:00 - INFO - __main__ - Step 31786: {'lr': 0.0004516756337495075, 'samples': 6102912, 'steps': 31785, 'loss/train': 1.448751449584961}}}}
+11/07/2021 01:44:01 - INFO - __main__ - Step 31790: {'lr': 0.0004516630887765089, 'samples': 6103680, 'steps': 31789, 'loss/train': 1.7036118507385254}}}
+11/07/2021 01:44:03 - INFO - __main__ - Step 31794: {'lr': 0.00045165054234964984, 'samples': 6104448, 'steps': 31793, 'loss/train': 1.4671131372451782}}
+11/07/2021 01:44:05 - INFO - __main__ - Step 31799: {'lr': 0.0004516348572717227, 'samples': 6105408, 'steps': 31798, 'loss/train': 1.4903631210327148}}}
+11/07/2021 01:44:05 - INFO - __main__ - Step 31799: {'lr': 0.0004516348572717227, 'samples': 6105408, 'steps': 31798, 'loss/train': 1.4903631210327148}}}
+11/07/2021 01:44:10 - INFO - __main__ - Step 31807: {'lr': 0.00045160975642272795, 'samples': 6106944, 'steps': 31806, 'loss/train': 1.7411733865737915}}
+11/07/2021 01:44:12 - INFO - __main__ - Step 31811: {'lr': 0.0004515972038179714, 'samples': 6107712, 'steps': 31810, 'loss/train': 1.3670642375946045}}}
+11/07/2021 01:44:13 - INFO - __main__ - Step 31815: {'lr': 0.0004515846497598294, 'samples': 6108480, 'steps': 31814, 'loss/train': 1.7123581171035767}}}
+11/07/2021 01:44:15 - INFO - __main__ - Step 31819: {'lr': 0.00045157209424839253, 'samples': 6109248, 'steps': 31818, 'loss/train': 1.529592752456665}}}
+11/07/2021 01:44:18 - INFO - __main__ - Step 31824: {'lr': 0.00045155639781553825, 'samples': 6110208, 'steps': 31823, 'loss/train': 1.6955679655075073}}
+11/07/2021 01:44:20 - INFO - __main__ - Step 31828: {'lr': 0.0004515438390345188, 'samples': 6110976, 'steps': 31827, 'loss/train': 1.3006891012191772}}}
+11/07/2021 01:44:22 - INFO - __main__ - Step 31832: {'lr': 0.0004515312788004986, 'samples': 6111744, 'steps': 31831, 'loss/train': 1.4673216342926025}}}
+11/07/2021 01:44:23 - INFO - __main__ - Step 31836: {'lr': 0.00045151871711356827, 'samples': 6112512, 'steps': 31835, 'loss/train': 0.9932732582092285}}
+11/07/2021 01:44:26 - INFO - __main__ - Step 31840: {'lr': 0.00045150615397381835, 'samples': 6113280, 'steps': 31839, 'loss/train': 1.0138678550720215}}
+11/07/2021 01:44:28 - INFO - __main__ - Step 31845: {'lr': 0.00045149044800624135, 'samples': 6114240, 'steps': 31844, 'loss/train': 1.5553712844848633}}
+11/07/2021 01:44:30 - INFO - __main__ - Step 31849: {'lr': 0.0004514778815979785, 'samples': 6115008, 'steps': 31848, 'loss/train': 1.764130711555481}3}}
+11/07/2021 01:44:30 - INFO - __main__ - Step 31849: {'lr': 0.0004514778815979785, 'samples': 6115008, 'steps': 31848, 'loss/train': 1.764130711555481}3}}
+11/07/2021 01:44:33 - INFO - __main__ - Step 31856: {'lr': 0.0004514558868884343, 'samples': 6116352, 'steps': 31855, 'loss/train': 1.3141847848892212}}}
+11/07/2021 01:44:36 - INFO - __main__ - Step 31861: {'lr': 0.0004514401736584013, 'samples': 6117312, 'steps': 31860, 'loss/train': 1.288212537765503}}}}
+11/07/2021 01:44:38 - INFO - __main__ - Step 31866: {'lr': 0.00045142445815922244, 'samples': 6118272, 'steps': 31865, 'loss/train': 1.5117849111557007}}
+11/07/2021 01:44:40 - INFO - __main__ - Step 31870: {'lr': 0.0004514118841262133, 'samples': 6119040, 'steps': 31869, 'loss/train': 1.6058647632598877}}}
+11/07/2021 01:44:40 - INFO - __main__ - Step 31870: {'lr': 0.0004514118841262133, 'samples': 6119040, 'steps': 31869, 'loss/train': 1.6058647632598877}}}
+11/07/2021 01:44:44 - INFO - __main__ - Step 31877: {'lr': 0.00045138987607450803, 'samples': 6120384, 'steps': 31876, 'loss/train': 2.0093131065368652}}
+11/07/2021 01:44:44 - INFO - __main__ - Step 31877: {'lr': 0.00045138987607450803, 'samples': 6120384, 'steps': 31876, 'loss/train': 2.0093131065368652}}
+11/07/2021 01:44:48 - INFO - __main__ - Step 31885: {'lr': 0.00045136471857085435, 'samples': 6121920, 'steps': 31884, 'loss/train': 1.7443677186965942}}
+11/07/2021 01:44:50 - INFO - __main__ - Step 31889: {'lr': 0.00045135213764141814, 'samples': 6122688, 'steps': 31888, 'loss/train': 1.505753993988037}}}
+11/07/2021 01:44:52 - INFO - __main__ - Step 31893: {'lr': 0.0004513395552603633, 'samples': 6123456, 'steps': 31892, 'loss/train': 1.3275775909423828}}}
+11/07/2021 01:44:54 - INFO - __main__ - Step 31898: {'lr': 0.0004513238252428442, 'samples': 6124416, 'steps': 31897, 'loss/train': 1.728275179862976}}}}
+11/07/2021 01:44:56 - INFO - __main__ - Step 31902: {'lr': 0.00045131123959597905, 'samples': 6125184, 'steps': 31901, 'loss/train': 1.482000708580017}}}
+11/07/2021 01:44:58 - INFO - __main__ - Step 31906: {'lr': 0.00045129865249779, 'samples': 6125952, 'steps': 31905, 'loss/train': 1.4602670669555664}7}}}
+11/07/2021 01:45:00 - INFO - __main__ - Step 31910: {'lr': 0.00045128606394836805, 'samples': 6126720, 'steps': 31909, 'loss/train': 1.6861112117767334}}
+11/07/2021 01:45:02 - INFO - __main__ - Step 31914: {'lr': 0.00045127347394780367, 'samples': 6127488, 'steps': 31913, 'loss/train': 1.6989363431930542}}
+11/07/2021 01:45:04 - INFO - __main__ - Step 31919: {'lr': 0.00045125773440656756, 'samples': 6128448, 'steps': 31918, 'loss/train': 1.2627248764038086}}
+11/07/2021 01:45:06 - INFO - __main__ - Step 31923: {'lr': 0.00045124514114126493, 'samples': 6129216, 'steps': 31922, 'loss/train': 1.5508592128753662}}
+11/07/2021 01:45:06 - INFO - __main__ - Step 31923: {'lr': 0.00045124514114126493, 'samples': 6129216, 'steps': 31922, 'loss/train': 1.5508592128753662}}
+11/07/2021 01:45:09 - INFO - __main__ - Step 31929: {'lr': 0.0004512262485230007, 'samples': 6130368, 'steps': 31928, 'loss/train': 1.0703651905059814}}}
+11/07/2021 01:45:12 - INFO - __main__ - Step 31934: {'lr': 0.0004512105021810244, 'samples': 6131328, 'steps': 31933, 'loss/train': 1.6673365831375122}}}
+11/07/2021 01:45:15 - INFO - __main__ - Step 31940: {'lr': 0.00045119160357881105, 'samples': 6132480, 'steps': 31939, 'loss/train': 1.8165699243545532}}
+11/07/2021 01:45:15 - INFO - __main__ - Step 31940: {'lr': 0.00045119160357881105, 'samples': 6132480, 'steps': 31939, 'loss/train': 1.8165699243545532}}
+11/07/2021 01:45:17 - INFO - __main__ - Step 31946: {'lr': 0.0004511727017130598, 'samples': 6133632, 'steps': 31945, 'loss/train': 1.8258341550827026}}}
+11/07/2021 01:45:19 - INFO - __main__ - Step 31950: {'lr': 0.00045116009865630034, 'samples': 6134400, 'steps': 31949, 'loss/train': 1.8072712421417236}}
+11/07/2021 01:45:22 - INFO - __main__ - Step 31955: {'lr': 0.00045114434279596994, 'samples': 6135360, 'steps': 31954, 'loss/train': 1.5438740253448486}}
+11/07/2021 01:45:22 - INFO - __main__ - Step 31955: {'lr': 0.00045114434279596994, 'samples': 6135360, 'steps': 31954, 'loss/train': 1.5438740253448486}}
+11/07/2021 01:45:26 - INFO - __main__ - Step 31963: {'lr': 0.0004511191287066232, 'samples': 6136896, 'steps': 31962, 'loss/train': 1.9909965991973877}}}
+11/07/2021 01:45:28 - INFO - __main__ - Step 31967: {'lr': 0.0004511065194869961, 'samples': 6137664, 'steps': 31966, 'loss/train': 1.316340446472168}}}}
+11/07/2021 01:45:30 - INFO - __main__ - Step 31971: {'lr': 0.0004510939088175211, 'samples': 6138432, 'steps': 31970, 'loss/train': 1.5126852989196777}}}
+11/07/2021 01:45:30 - INFO - __main__ - Step 31971: {'lr': 0.0004510939088175211, 'samples': 6138432, 'steps': 31970, 'loss/train': 1.5126852989196777}}}
+11/07/2021 01:45:34 - INFO - __main__ - Step 31979: {'lr': 0.00045106868312939116, 'samples': 6139968, 'steps': 31978, 'loss/train': 0.6979764103889465}}
+11/07/2021 01:45:35 - INFO - __main__ - Step 31983: {'lr': 0.0004510560681109179, 'samples': 6140736, 'steps': 31982, 'loss/train': 1.8358553647994995}}}
+11/07/2021 01:45:38 - INFO - __main__ - Step 31987: {'lr': 0.0004510434516429606, 'samples': 6141504, 'steps': 31986, 'loss/train': 3.6436564922332764}}}
+11/07/2021 01:45:40 - INFO - __main__ - Step 31992: {'lr': 0.0004510276790198153, 'samples': 6142464, 'steps': 31991, 'loss/train': 1.7565659284591675}}}
+11/07/2021 01:45:42 - INFO - __main__ - Step 31996: {'lr': 0.0004510150592908511, 'samples': 6143232, 'steps': 31995, 'loss/train': 0.27138158679008484}}
+11/07/2021 01:45:44 - INFO - __main__ - Step 32000: {'lr': 0.00045100243811269834, 'samples': 6144000, 'steps': 31999, 'loss/train': 1.2587133646011353}}
+11/07/2021 01:45:46 - INFO - __main__ - Step 32004: {'lr': 0.0004509898154854481, 'samples': 6144768, 'steps': 32003, 'loss/train': 1.133880615234375}3}}
+11/07/2021 01:45:48 - INFO - __main__ - Step 32008: {'lr': 0.00045097719140919126, 'samples': 6145536, 'steps': 32007, 'loss/train': 1.929354190826416}}}
+11/07/2021 01:45:50 - INFO - __main__ - Step 32013: {'lr': 0.0004509614092763434, 'samples': 6146496, 'steps': 32012, 'loss/train': 1.2444761991500854}}}
+11/07/2021 01:45:50 - INFO - __main__ - Step 32013: {'lr': 0.0004509614092763434, 'samples': 6146496, 'steps': 32012, 'loss/train': 1.2444761991500854}}}
+11/07/2021 01:45:54 - INFO - __main__ - Step 32020: {'lr': 0.00045093931048729156, 'samples': 6147840, 'steps': 32019, 'loss/train': 1.719070315361023}}}
+11/07/2021 01:45:56 - INFO - __main__ - Step 32024: {'lr': 0.00045092668061591875, 'samples': 6148608, 'steps': 32023, 'loss/train': 1.3829171657562256}}
+11/07/2021 01:45:58 - INFO - __main__ - Step 32029: {'lr': 0.00045091089123968796, 'samples': 6149568, 'steps': 32028, 'loss/train': 1.7335764169692993}}
+11/07/2021 01:46:00 - INFO - __main__ - Step 32033: {'lr': 0.0004508982581092026, 'samples': 6150336, 'steps': 32032, 'loss/train': 0.9741845726966858}}}
+11/07/2021 01:46:02 - INFO - __main__ - Step 32037: {'lr': 0.00045088562353037077, 'samples': 6151104, 'steps': 32036, 'loss/train': 1.8636360168457031}}
+11/07/2021 01:46:02 - INFO - __main__ - Step 32037: {'lr': 0.00045088562353037077, 'samples': 6151104, 'steps': 32036, 'loss/train': 1.8636360168457031}}
+11/07/2021 01:46:05 - INFO - __main__ - Step 32044: {'lr': 0.00045086350953260526, 'samples': 6152448, 'steps': 32043, 'loss/train': 1.8391896486282349}}
+11/07/2021 01:46:08 - INFO - __main__ - Step 32049: {'lr': 0.00045084771110470717, 'samples': 6153408, 'steps': 32048, 'loss/train': 1.6490238904953003}}
+11/07/2021 01:46:08 - INFO - __main__ - Step 32049: {'lr': 0.00045084771110470717, 'samples': 6153408, 'steps': 32048, 'loss/train': 1.6490238904953003}}
+11/07/2021 01:46:12 - INFO - __main__ - Step 32057: {'lr': 0.0004508224289142026, 'samples': 6154944, 'steps': 32056, 'loss/train': 1.6833237409591675}}}
+11/07/2021 01:46:14 - INFO - __main__ - Step 32061: {'lr': 0.00045080978564720505, 'samples': 6155712, 'steps': 32060, 'loss/train': 1.436179757118225}}}
+11/07/2021 01:46:16 - INFO - __main__ - Step 32065: {'lr': 0.00045079714093249887, 'samples': 6156480, 'steps': 32064, 'loss/train': 1.9286205768585205}}
+11/07/2021 01:46:18 - INFO - __main__ - Step 32070: {'lr': 0.0004507813330034147, 'samples': 6157440, 'steps': 32069, 'loss/train': 1.153349757194519}5}}
+11/07/2021 01:46:20 - INFO - __main__ - Step 32074: {'lr': 0.0004507686850316973, 'samples': 6158208, 'steps': 32073, 'loss/train': 1.6692560911178589}}}
+11/07/2021 01:46:22 - INFO - __main__ - Step 32078: {'lr': 0.0004507560356125676, 'samples': 6158976, 'steps': 32077, 'loss/train': 1.8561049699783325}}}
+11/07/2021 01:46:24 - INFO - __main__ - Step 32082: {'lr': 0.00045074338474611683, 'samples': 6159744, 'steps': 32081, 'loss/train': 5.802849769592285}}}
+11/07/2021 01:46:26 - INFO - __main__ - Step 32086: {'lr': 0.00045073073243243603, 'samples': 6160512, 'steps': 32085, 'loss/train': 1.0529669523239136}}
+11/07/2021 01:46:28 - INFO - __main__ - Step 32091: {'lr': 0.00045071491500530694, 'samples': 6161472, 'steps': 32090, 'loss/train': 0.4279614984989166}}
+11/07/2021 01:46:28 - INFO - __main__ - Step 32091: {'lr': 0.00045071491500530694, 'samples': 6161472, 'steps': 32090, 'loss/train': 0.4279614984989166}}
+11/07/2021 01:46:33 - INFO - __main__ - Step 32098: {'lr': 0.00045069276680892624, 'samples': 6162816, 'steps': 32097, 'loss/train': 1.6708344221115112}}
+11/07/2021 01:46:34 - INFO - __main__ - Step 32102: {'lr': 0.00045068010870723783, 'samples': 6163584, 'steps': 32101, 'loss/train': 1.115096092224121}}}
+11/07/2021 01:46:36 - INFO - __main__ - Step 32107: {'lr': 0.0004506642840456126, 'samples': 6164544, 'steps': 32106, 'loss/train': 1.7105660438537598}}}
+11/07/2021 01:46:38 - INFO - __main__ - Step 32111: {'lr': 0.00045065162268881164, 'samples': 6165312, 'steps': 32110, 'loss/train': 1.431797981262207}}}
+11/07/2021 01:46:40 - INFO - __main__ - Step 32115: {'lr': 0.00045063895988544235, 'samples': 6166080, 'steps': 32114, 'loss/train': 1.5505790710449219}}
+11/07/2021 01:46:40 - INFO - __main__ - Step 32115: {'lr': 0.00045063895988544235, 'samples': 6166080, 'steps': 32114, 'loss/train': 1.5505790710449219}}
+11/07/2021 01:46:44 - INFO - __main__ - Step 32122: {'lr': 0.00045061679649901543, 'samples': 6167424, 'steps': 32121, 'loss/train': 1.6725994348526}19}}
+11/07/2021 01:46:46 - INFO - __main__ - Step 32127: {'lr': 0.00045060096279683694, 'samples': 6168384, 'steps': 32126, 'loss/train': 1.4542152881622314}}
+11/07/2021 01:46:48 - INFO - __main__ - Step 32132: {'lr': 0.00045058512683496607, 'samples': 6169344, 'steps': 32131, 'loss/train': 1.505821943283081}}}
+11/07/2021 01:46:51 - INFO - __main__ - Step 32136: {'lr': 0.0004505724564386106, 'samples': 6170112, 'steps': 32135, 'loss/train': 1.8550945520401}81}}}
+11/07/2021 01:46:53 - INFO - __main__ - Step 32140: {'lr': 0.0004505597845962575, 'samples': 6170880, 'steps': 32139, 'loss/train': 1.7972909212112427}}}
+11/07/2021 01:46:55 - INFO - __main__ - Step 32144: {'lr': 0.00045054711130799806, 'samples': 6171648, 'steps': 32143, 'loss/train': 1.3463897705078125}}
+11/07/2021 01:46:56 - INFO - __main__ - Step 32148: {'lr': 0.0004505344365739238, 'samples': 6172416, 'steps': 32147, 'loss/train': 1.6588155031204224}}}
+11/07/2021 01:46:58 - INFO - __main__ - Step 32152: {'lr': 0.00045052176039412587, 'samples': 6173184, 'steps': 32151, 'loss/train': 1.3574669361114502}}
+11/07/2021 01:47:01 - INFO - __main__ - Step 32157: {'lr': 0.0004505059131364689, 'samples': 6174144, 'steps': 32156, 'loss/train': 1.6518559455871582}}}
+11/07/2021 01:47:03 - INFO - __main__ - Step 32161: {'lr': 0.00045049323370412723, 'samples': 6174912, 'steps': 32160, 'loss/train': 1.4618717432022095}}
+11/07/2021 01:47:05 - INFO - __main__ - Step 32165: {'lr': 0.0004504805528263589, 'samples': 6175680, 'steps': 32164, 'loss/train': 1.6876972913742065}}}
+11/07/2021 01:47:06 - INFO - __main__ - Step 32169: {'lr': 0.00045046787050325555, 'samples': 6176448, 'steps': 32168, 'loss/train': 0.7906864285469055}}
+11/07/2021 01:47:08 - INFO - __main__ - Step 32173: {'lr': 0.0004504551867349085, 'samples': 6177216, 'steps': 32172, 'loss/train': 1.5836315155029297}}}
+11/07/2021 01:47:10 - INFO - __main__ - Step 32177: {'lr': 0.0004504425015214092, 'samples': 6177984, 'steps': 32176, 'loss/train': 1.4530431032180786}}}
+11/07/2021 01:47:13 - INFO - __main__ - Step 32181: {'lr': 0.0004504298148628492, 'samples': 6178752, 'steps': 32180, 'loss/train': 0.48151570558547974}}
+11/07/2021 01:47:14 - INFO - __main__ - Step 32185: {'lr': 0.00045041712675931983, 'samples': 6179520, 'steps': 32184, 'loss/train': 1.6092675924301147}}
+11/07/2021 01:47:16 - INFO - __main__ - Step 32189: {'lr': 0.00045040443721091266, 'samples': 6180288, 'steps': 32188, 'loss/train': 1.3511254787445068}}
+11/07/2021 01:47:18 - INFO - __main__ - Step 32194: {'lr': 0.00045038857324368367, 'samples': 6181248, 'steps': 32193, 'loss/train': 1.5134190320968628}}
+11/07/2021 01:47:18 - INFO - __main__ - Step 32194: {'lr': 0.00045038857324368367, 'samples': 6181248, 'steps': 32193, 'loss/train': 1.5134190320968628}}
+11/07/2021 01:47:22 - INFO - __main__ - Step 32201: {'lr': 0.00045036635989733904, 'samples': 6182592, 'steps': 32200, 'loss/train': 0.16695256531238556}
+11/07/2021 01:47:24 - INFO - __main__ - Step 32206: {'lr': 0.00045035049051289037, 'samples': 6183552, 'steps': 32205, 'loss/train': 1.389227032661438}6}
+11/07/2021 01:47:24 - INFO - __main__ - Step 32206: {'lr': 0.00045035049051289037, 'samples': 6183552, 'steps': 32205, 'loss/train': 1.389227032661438}6}
+11/07/2021 01:47:28 - INFO - __main__ - Step 32213: {'lr': 0.0004503282695831589, 'samples': 6184896, 'steps': 32212, 'loss/train': 2.376875400543213}}6}
+11/07/2021 01:47:30 - INFO - __main__ - Step 32217: {'lr': 0.000450315569923169, 'samples': 6185664, 'steps': 32216, 'loss/train': 1.9647176265716553}}6}
+11/07/2021 01:47:32 - INFO - __main__ - Step 32222: {'lr': 0.00045029969331736254, 'samples': 6186624, 'steps': 32221, 'loss/train': 1.9964864253997803}}
+11/07/2021 01:47:34 - INFO - __main__ - Step 32226: {'lr': 0.0004502869904081736, 'samples': 6187392, 'steps': 32225, 'loss/train': 1.5956135988235474}}}
+11/07/2021 01:47:36 - INFO - __main__ - Step 32230: {'lr': 0.00045027428605504507, 'samples': 6188160, 'steps': 32229, 'loss/train': 1.6560455560684204}}
+11/07/2021 01:47:38 - INFO - __main__ - Step 32234: {'lr': 0.0004502615802580685, 'samples': 6188928, 'steps': 32233, 'loss/train': 1.5005950927734375}}}
+11/07/2021 01:47:40 - INFO - __main__ - Step 32238: {'lr': 0.00045024887301733555, 'samples': 6189696, 'steps': 32237, 'loss/train': 1.6385005712509155}}
+11/07/2021 01:47:42 - INFO - __main__ - Step 32242: {'lr': 0.00045023616433293763, 'samples': 6190464, 'steps': 32241, 'loss/train': 1.55082106590271}5}}
+11/07/2021 01:47:44 - INFO - __main__ - Step 32247: {'lr': 0.00045022027644742624, 'samples': 6191424, 'steps': 32246, 'loss/train': 1.9687552452087402}}
+11/07/2021 01:47:47 - INFO - __main__ - Step 32251: {'lr': 0.0004502075645151175, 'samples': 6192192, 'steps': 32250, 'loss/train': 1.9542632102966309}}}
+11/07/2021 01:47:48 - INFO - __main__ - Step 32255: {'lr': 0.0004501948511394417, 'samples': 6192960, 'steps': 32254, 'loss/train': 1.3751741647720337}}}
+11/07/2021 01:47:50 - INFO - __main__ - Step 32259: {'lr': 0.0004501821363204906, 'samples': 6193728, 'steps': 32258, 'loss/train': 1.2249864339828491}}}
+11/07/2021 01:47:53 - INFO - __main__ - Step 32264: {'lr': 0.0004501662407673354, 'samples': 6194688, 'steps': 32263, 'loss/train': 1.338904857635498}}}}
+11/07/2021 01:47:55 - INFO - __main__ - Step 32268: {'lr': 0.0004501535227013498, 'samples': 6195456, 'steps': 32267, 'loss/train': 1.4296706914901733}}}
+11/07/2021 01:47:57 - INFO - __main__ - Step 32272: {'lr': 0.00045014080319238686, 'samples': 6196224, 'steps': 32271, 'loss/train': 1.12027907371521}}}}
+11/07/2021 01:47:59 - INFO - __main__ - Step 32276: {'lr': 0.0004501280822405382, 'samples': 6196992, 'steps': 32275, 'loss/train': 1.6742898225784302}}}
+11/07/2021 01:48:00 - INFO - __main__ - Step 32280: {'lr': 0.00045011535984589544, 'samples': 6197760, 'steps': 32279, 'loss/train': 1.3071985244750977}}
+11/07/2021 01:48:02 - INFO - __main__ - Step 32284: {'lr': 0.0004501026360085505, 'samples': 6198528, 'steps': 32283, 'loss/train': 1.030112624168396}7}}
+11/07/2021 01:48:02 - INFO - __main__ - Step 32284: {'lr': 0.0004501026360085505, 'samples': 6198528, 'steps': 32283, 'loss/train': 1.030112624168396}7}}
+11/07/2021 01:48:07 - INFO - __main__ - Step 32292: {'lr': 0.0004500771840061206, 'samples': 6200064, 'steps': 32291, 'loss/train': 1.9112358093261719}}}
+11/07/2021 01:48:08 - INFO - __main__ - Step 32296: {'lr': 0.00045006445584121923, 'samples': 6200832, 'steps': 32295, 'loss/train': 1.9976251125335693}}
+11/07/2021 01:48:10 - INFO - __main__ - Step 32300: {'lr': 0.0004500517262339825, 'samples': 6201600, 'steps': 32299, 'loss/train': 1.860845685005188}3}}
+11/07/2021 01:48:13 - INFO - __main__ - Step 32305: {'lr': 0.00045003581219679235, 'samples': 6202560, 'steps': 32304, 'loss/train': 1.3765199184417725}}
+11/07/2021 01:48:13 - INFO - __main__ - Step 32305: {'lr': 0.00045003581219679235, 'samples': 6202560, 'steps': 32304, 'loss/train': 1.3765199184417725}}
+11/07/2021 01:48:17 - INFO - __main__ - Step 32313: {'lr': 0.00045001034505044415, 'samples': 6204096, 'steps': 32312, 'loss/train': 1.686047077178955}}}
+11/07/2021 01:48:19 - INFO - __main__ - Step 32317: {'lr': 0.0004499976093143063, 'samples': 6204864, 'steps': 32316, 'loss/train': 1.5840280055999756}}}
+11/07/2021 01:48:20 - INFO - __main__ - Step 32321: {'lr': 0.0004499848721363151, 'samples': 6205632, 'steps': 32320, 'loss/train': 2.0209126472473145}}}
+11/07/2021 01:48:23 - INFO - __main__ - Step 32326: {'lr': 0.00044996894863635965, 'samples': 6206592, 'steps': 32325, 'loss/train': 1.345014214515686}}}
+11/07/2021 01:48:25 - INFO - __main__ - Step 32330: {'lr': 0.00044995620821453416, 'samples': 6207360, 'steps': 32329, 'loss/train': 1.9484862089157104}}
+11/07/2021 01:48:25 - INFO - __main__ - Step 32330: {'lr': 0.00044995620821453416, 'samples': 6207360, 'steps': 32329, 'loss/train': 1.9484862089157104}}
+11/07/2021 01:48:28 - INFO - __main__ - Step 32337: {'lr': 0.0004499339090076532, 'samples': 6208704, 'steps': 32336, 'loss/train': 2.068150520324707}4}}
+11/07/2021 01:48:31 - INFO - __main__ - Step 32342: {'lr': 0.00044991797830009543, 'samples': 6209664, 'steps': 32341, 'loss/train': 2.685377597808838}}}
+11/07/2021 01:48:33 - INFO - __main__ - Step 32347: {'lr': 0.0004499020453405388, 'samples': 6210624, 'steps': 32346, 'loss/train': 1.9387210607528687}}}
+11/07/2021 01:48:35 - INFO - __main__ - Step 32351: {'lr': 0.000449889297351575, 'samples': 6211392, 'steps': 32350, 'loss/train': 1.0773181915283203}}}}
+11/07/2021 01:48:37 - INFO - __main__ - Step 32355: {'lr': 0.00044987654792153853, 'samples': 6212160, 'steps': 32354, 'loss/train': 1.4395281076431274}}
+11/07/2021 01:48:39 - INFO - __main__ - Step 32359: {'lr': 0.0004498637970505215, 'samples': 6212928, 'steps': 32358, 'loss/train': 1.9765815734863281}}}
+11/07/2021 01:48:41 - INFO - __main__ - Step 32363: {'lr': 0.00044985104473861583, 'samples': 6213696, 'steps': 32362, 'loss/train': 1.6762796640396118}}
+11/07/2021 01:48:43 - INFO - __main__ - Step 32368: {'lr': 0.00044983510232262405, 'samples': 6214656, 'steps': 32367, 'loss/train': 1.2581473588943481}}
+11/07/2021 01:48:45 - INFO - __main__ - Step 32372: {'lr': 0.0004498223467690549, 'samples': 6215424, 'steps': 32371, 'loss/train': 1.257175087928772}1}}
+11/07/2021 01:48:47 - INFO - __main__ - Step 32376: {'lr': 0.00044980958977489593, 'samples': 6216192, 'steps': 32375, 'loss/train': 1.2944344282150269}}
+11/07/2021 01:48:47 - INFO - __main__ - Step 32376: {'lr': 0.00044980958977489593, 'samples': 6216192, 'steps': 32375, 'loss/train': 1.2944344282150269}}
+11/07/2021 01:48:51 - INFO - __main__ - Step 32383: {'lr': 0.0004497872615689751, 'samples': 6217536, 'steps': 32382, 'loss/train': 0.8333058953285217}}}
+11/07/2021 01:48:53 - INFO - __main__ - Step 32388: {'lr': 0.00044977131014979974, 'samples': 6218496, 'steps': 32387, 'loss/train': 1.2199071645736694}}
+11/07/2021 01:48:53 - INFO - __main__ - Step 32388: {'lr': 0.00044977131014979974, 'samples': 6218496, 'steps': 32387, 'loss/train': 1.2199071645736694}}
+11/07/2021 01:48:57 - INFO - __main__ - Step 32396: {'lr': 0.0004497457831984727, 'samples': 6220032, 'steps': 32395, 'loss/train': 1.5898518562316895}}}
+11/07/2021 01:48:59 - INFO - __main__ - Step 32400: {'lr': 0.00044973301756270635, 'samples': 6220800, 'steps': 32399, 'loss/train': 1.4757723808288574}}
+11/07/2021 01:49:01 - INFO - __main__ - Step 32404: {'lr': 0.0004497202504869941, 'samples': 6221568, 'steps': 32403, 'loss/train': 1.795836091041565}4}}
+11/07/2021 01:49:03 - INFO - __main__ - Step 32409: {'lr': 0.00044970428961757026, 'samples': 6222528, 'steps': 32408, 'loss/train': 1.5618425607681274}}
+11/07/2021 01:49:06 - INFO - __main__ - Step 32414: {'lr': 0.00044968832649855455, 'samples': 6223488, 'steps': 32413, 'loss/train': 1.6851338148117065}}
+11/07/2021 01:49:06 - INFO - __main__ - Step 32414: {'lr': 0.00044968832649855455, 'samples': 6223488, 'steps': 32413, 'loss/train': 1.6851338148117065}}
+11/07/2021 01:49:09 - INFO - __main__ - Step 32421: {'lr': 0.0004496659743529608, 'samples': 6224832, 'steps': 32420, 'loss/train': 1.5266687870025635}}}
+11/07/2021 01:49:11 - INFO - __main__ - Step 32425: {'lr': 0.0004496531997190432, 'samples': 6225600, 'steps': 32424, 'loss/train': 1.8037725687026978}}}
+11/07/2021 01:49:11 - INFO - __main__ - Step 32425: {'lr': 0.0004496531997190432, 'samples': 6225600, 'steps': 32424, 'loss/train': 1.8037725687026978}}}
+11/07/2021 01:49:15 - INFO - __main__ - Step 32432: {'lr': 0.00044963084064625775, 'samples': 6226944, 'steps': 32431, 'loss/train': 1.677183747291565}}}
+11/07/2021 01:49:16 - INFO - __main__ - Step 32436: {'lr': 0.0004496180620542931, 'samples': 6227712, 'steps': 32435, 'loss/train': 1.2223323583602905}}}
+11/07/2021 01:49:18 - INFO - __main__ - Step 32440: {'lr': 0.00044960528202321143, 'samples': 6228480, 'steps': 32439, 'loss/train': 1.3973376750946045}}
+11/07/2021 01:49:18 - INFO - __main__ - Step 32440: {'lr': 0.00044960528202321143, 'samples': 6228480, 'steps': 32439, 'loss/train': 1.3973376750946045}}
+11/07/2021 01:49:23 - INFO - __main__ - Step 32449: {'lr': 0.000449576521691983, 'samples': 6230208, 'steps': 32448, 'loss/train': 1.449952244758606}45}}
+11/07/2021 01:49:25 - INFO - __main__ - Step 32453: {'lr': 0.0004495637369844071, 'samples': 6230976, 'steps': 32452, 'loss/train': 1.0895562171936035}}}
+11/07/2021 01:49:26 - INFO - __main__ - Step 32457: {'lr': 0.0004495509508381058, 'samples': 6231744, 'steps': 32456, 'loss/train': 1.1795073747634888}}}
+11/07/2021 01:49:28 - INFO - __main__ - Step 32461: {'lr': 0.00044953816325317116, 'samples': 6232512, 'steps': 32460, 'loss/train': 1.4539257287979126}}
+11/07/2021 01:49:31 - INFO - __main__ - Step 32466: {'lr': 0.0004495221767490653, 'samples': 6233472, 'steps': 32465, 'loss/train': 1.3486028909683228}}}
+11/07/2021 01:49:31 - INFO - __main__ - Step 32466: {'lr': 0.0004495221767490653, 'samples': 6233472, 'steps': 32465, 'loss/train': 1.3486028909683228}}}
+11/07/2021 01:49:35 - INFO - __main__ - Step 32474: {'lr': 0.00044949659366768697, 'samples': 6235008, 'steps': 32473, 'loss/train': 1.6390635967254639}}
+11/07/2021 01:49:37 - INFO - __main__ - Step 32478: {'lr': 0.00044948379996958963, 'samples': 6235776, 'steps': 32477, 'loss/train': 1.706484317779541}}}
+11/07/2021 01:49:39 - INFO - __main__ - Step 32482: {'lr': 0.00044947100483334315, 'samples': 6236544, 'steps': 32481, 'loss/train': 1.956660509109497}}}
+11/07/2021 01:49:41 - INFO - __main__ - Step 32487: {'lr': 0.0004494550088907783, 'samples': 6237504, 'steps': 32486, 'loss/train': 1.5964031219482422}}}
+11/07/2021 01:49:41 - INFO - __main__ - Step 32487: {'lr': 0.0004494550088907783, 'samples': 6237504, 'steps': 32486, 'loss/train': 1.5964031219482422}}}
+11/07/2021 01:49:44 - INFO - __main__ - Step 32494: {'lr': 0.0004494326107966311, 'samples': 6238848, 'steps': 32493, 'loss/train': 1.3394577503204346}}}
+11/07/2021 01:49:47 - INFO - __main__ - Step 32498: {'lr': 0.0004494198099087106, 'samples': 6239616, 'steps': 32497, 'loss/train': 1.2754056453704834}}}
+11/07/2021 01:49:49 - INFO - __main__ - Step 32503: {'lr': 0.00044940380677707214, 'samples': 6240576, 'steps': 32502, 'loss/train': 0.6593044400215149}}
+11/07/2021 01:49:51 - INFO - __main__ - Step 32508: {'lr': 0.0004493878013992268, 'samples': 6241536, 'steps': 32507, 'loss/train': 1.458335518836975}9}}
+11/07/2021 01:49:53 - INFO - __main__ - Step 32512: {'lr': 0.00044937499547980265, 'samples': 6242304, 'steps': 32511, 'loss/train': 1.2921862602233887}}
+11/07/2021 01:49:55 - INFO - __main__ - Step 32516: {'lr': 0.0004493621881230138, 'samples': 6243072, 'steps': 32515, 'loss/train': 1.0435876846313477}}}
+11/07/2021 01:49:55 - INFO - __main__ - Step 32516: {'lr': 0.0004493621881230138, 'samples': 6243072, 'steps': 32515, 'loss/train': 1.0435876846313477}}}
+11/07/2021 01:49:59 - INFO - __main__ - Step 32523: {'lr': 0.0004493397717902521, 'samples': 6244416, 'steps': 32522, 'loss/train': 1.3674840927124023}}}
+11/07/2021 01:50:01 - INFO - __main__ - Step 32528: {'lr': 0.000449323757429382, 'samples': 6245376, 'steps': 32527, 'loss/train': 1.4659003019332886}}}}
+11/07/2021 01:50:01 - INFO - __main__ - Step 32528: {'lr': 0.000449323757429382, 'samples': 6245376, 'steps': 32527, 'loss/train': 1.4659003019332886}}}}
+11/07/2021 01:50:01 - INFO - __main__ - Step 32528: {'lr': 0.000449323757429382, 'samples': 6245376, 'steps': 32527, 'loss/train': 1.4659003019332886}}}}
+11/07/2021 01:50:07 - INFO - __main__ - Step 32539: {'lr': 0.00044928851793224765, 'samples': 6247488, 'steps': 32538, 'loss/train': 1.605699896812439}}}
+11/07/2021 01:50:07 - INFO - __main__ - Step 32539: {'lr': 0.00044928851793224765, 'samples': 6247488, 'steps': 32538, 'loss/train': 1.605699896812439}}}
+11/07/2021 01:50:11 - INFO - __main__ - Step 32546: {'lr': 0.00044926608714041763, 'samples': 6248832, 'steps': 32545, 'loss/train': 1.8412197828292847}}
+11/07/2021 01:50:13 - INFO - __main__ - Step 32551: {'lr': 0.00044925006245263757, 'samples': 6249792, 'steps': 32550, 'loss/train': 1.6064367294311523}}
+11/07/2021 01:50:13 - INFO - __main__ - Step 32551: {'lr': 0.00044925006245263757, 'samples': 6249792, 'steps': 32550, 'loss/train': 1.6064367294311523}}
+11/07/2021 01:50:17 - INFO - __main__ - Step 32559: {'lr': 0.0004492244182837565, 'samples': 6251328, 'steps': 32558, 'loss/train': 1.5362626314163208}}}
+11/07/2021 01:50:19 - INFO - __main__ - Step 32563: {'lr': 0.000449211594044851, 'samples': 6252096, 'steps': 32562, 'loss/train': 1.7514045238494873}}}}
+11/07/2021 01:50:21 - INFO - __main__ - Step 32567: {'lr': 0.00044919876836975876, 'samples': 6252864, 'steps': 32566, 'loss/train': 1.298283338546753}}}
+11/07/2021 01:50:23 - INFO - __main__ - Step 32572: {'lr': 0.0004491827342563968, 'samples': 6253824, 'steps': 32571, 'loss/train': 1.350450038909912}}}}
+11/07/2021 01:50:25 - INFO - __main__ - Step 32576: {'lr': 0.00044916990535022244, 'samples': 6254592, 'steps': 32575, 'loss/train': 1.6362158060073853}}
+11/07/2021 01:50:28 - INFO - __main__ - Step 32580: {'lr': 0.00044915707500816206, 'samples': 6255360, 'steps': 32579, 'loss/train': 1.317042589187622}}}
+11/07/2021 01:50:29 - INFO - __main__ - Step 32584: {'lr': 0.0004491442432303079, 'samples': 6256128, 'steps': 32583, 'loss/train': 1.6612629890441895}}}
+11/07/2021 01:50:31 - INFO - __main__ - Step 32588: {'lr': 0.0004491314100167526, 'samples': 6256896, 'steps': 32587, 'loss/train': 1.5734999179840088}}}
+11/07/2021 01:50:34 - INFO - __main__ - Step 32593: {'lr': 0.0004491153664809947, 'samples': 6257856, 'steps': 32592, 'loss/train': 2.1112542152404785}}}
+11/07/2021 01:50:34 - INFO - __main__ - Step 32593: {'lr': 0.0004491153664809947, 'samples': 6257856, 'steps': 32592, 'loss/train': 2.1112542152404785}}}
+11/07/2021 01:50:38 - INFO - __main__ - Step 32600: {'lr': 0.00044909290176280495, 'samples': 6259200, 'steps': 32599, 'loss/train': 0.8739935159683228}}
+11/07/2021 01:50:39 - INFO - __main__ - Step 32604: {'lr': 0.0004490800628073703, 'samples': 6259968, 'steps': 32603, 'loss/train': 0.8565096855163574}}}
+11/07/2021 01:50:41 - INFO - __main__ - Step 32608: {'lr': 0.0004490672224166972, 'samples': 6260736, 'steps': 32607, 'loss/train': 1.7255065441131592}}}
+11/07/2021 01:50:44 - INFO - __main__ - Step 32613: {'lr': 0.00044905116991019264, 'samples': 6261696, 'steps': 32612, 'loss/train': 1.5295449495315552}}
+11/07/2021 01:50:46 - INFO - __main__ - Step 32617: {'lr': 0.0004490383262905714, 'samples': 6262464, 'steps': 32616, 'loss/train': 1.5342575311660767}}}
+11/07/2021 01:50:46 - INFO - __main__ - Step 32617: {'lr': 0.0004490383262905714, 'samples': 6262464, 'steps': 32616, 'loss/train': 1.5342575311660767}}}
+11/07/2021 01:50:49 - INFO - __main__ - Step 32624: {'lr': 0.00044901584650347147, 'samples': 6263808, 'steps': 32623, 'loss/train': 1.515797734260559}}}
+11/07/2021 01:50:51 - INFO - __main__ - Step 32629: {'lr': 0.0004489997868224528, 'samples': 6264768, 'steps': 32628, 'loss/train': 1.539214015007019}}}}
+11/07/2021 01:50:51 - INFO - __main__ - Step 32629: {'lr': 0.0004489997868224528, 'samples': 6264768, 'steps': 32628, 'loss/train': 1.539214015007019}}}}
+11/07/2021 01:50:56 - INFO - __main__ - Step 32637: {'lr': 0.00044897408667025397, 'samples': 6266304, 'steps': 32636, 'loss/train': 1.4235544204711914}}
+11/07/2021 01:50:56 - INFO - __main__ - Step 32637: {'lr': 0.00044897408667025397, 'samples': 6266304, 'steps': 32636, 'loss/train': 1.4235544204711914}}
+11/07/2021 01:50:59 - INFO - __main__ - Step 32644: {'lr': 0.0004489515943301854, 'samples': 6267648, 'steps': 32643, 'loss/train': 1.586187720298767}4}}
+11/07/2021 01:51:02 - INFO - __main__ - Step 32649: {'lr': 0.00044893552568362903, 'samples': 6268608, 'steps': 32648, 'loss/train': 1.0430372953414917}}
+11/07/2021 01:51:02 - INFO - __main__ - Step 32649: {'lr': 0.00044893552568362903, 'samples': 6268608, 'steps': 32648, 'loss/train': 1.0430372953414917}}
+11/07/2021 01:51:06 - INFO - __main__ - Step 32657: {'lr': 0.00044890981118807585, 'samples': 6270144, 'steps': 32656, 'loss/train': 2.038282871246338}}}
+11/07/2021 01:51:07 - INFO - __main__ - Step 32661: {'lr': 0.0004488969517892363, 'samples': 6270912, 'steps': 32660, 'loss/train': 0.7900300025939941}}}
+11/07/2021 01:51:09 - INFO - __main__ - Step 32665: {'lr': 0.00044888409095647833, 'samples': 6271680, 'steps': 32664, 'loss/train': 1.3088997602462769}}
+11/07/2021 01:51:12 - INFO - __main__ - Step 32670: {'lr': 0.0004488680128992244, 'samples': 6272640, 'steps': 32669, 'loss/train': 1.103938341140747}9}}
+11/07/2021 01:51:12 - INFO - __main__ - Step 32670: {'lr': 0.0004488680128992244, 'samples': 6272640, 'steps': 32669, 'loss/train': 1.103938341140747}9}}
+11/07/2021 01:51:16 - INFO - __main__ - Step 32677: {'lr': 0.00044884549985562165, 'samples': 6273984, 'steps': 32676, 'loss/train': 1.7669689655303955}}
+11/07/2021 01:51:17 - INFO - __main__ - Step 32681: {'lr': 0.0004488326332881175, 'samples': 6274752, 'steps': 32680, 'loss/train': 1.354612946510315}5}}
+11/07/2021 01:51:20 - INFO - __main__ - Step 32686: {'lr': 0.0004488165480629527, 'samples': 6275712, 'steps': 32685, 'loss/train': 1.4111723899841309}}}
+11/07/2021 01:51:22 - INFO - __main__ - Step 32691: {'lr': 0.00044880046059819615, 'samples': 6276672, 'steps': 32690, 'loss/train': 1.3003720045089722}}
+11/07/2021 01:51:24 - INFO - __main__ - Step 32695: {'lr': 0.00044878758901400665, 'samples': 6277440, 'steps': 32694, 'loss/train': 1.5347445011138916}}
+11/07/2021 01:51:24 - INFO - __main__ - Step 32695: {'lr': 0.00044878758901400665, 'samples': 6277440, 'steps': 32694, 'loss/train': 1.5347445011138916}}
+11/07/2021 01:51:27 - INFO - __main__ - Step 32702: {'lr': 0.0004487650602932619, 'samples': 6278784, 'steps': 32701, 'loss/train': 1.208509087562561}6}}
+11/07/2021 01:51:29 - INFO - __main__ - Step 32706: {'lr': 0.00044875218476818845, 'samples': 6279552, 'steps': 32705, 'loss/train': 0.7631714940071106}}
+11/07/2021 01:51:32 - INFO - __main__ - Step 32711: {'lr': 0.00044873608834687754, 'samples': 6280512, 'steps': 32710, 'loss/train': 0.9771917462348938}}
+11/07/2021 01:51:32 - INFO - __main__ - Step 32711: {'lr': 0.00044873608834687754, 'samples': 6280512, 'steps': 32710, 'loss/train': 0.9771917462348938}}
+11/07/2021 01:51:35 - INFO - __main__ - Step 32718: {'lr': 0.00044871354959609135, 'samples': 6281856, 'steps': 32717, 'loss/train': 0.7198702096939087}}
+11/07/2021 01:51:38 - INFO - __main__ - Step 32723: {'lr': 0.0004486974478022402, 'samples': 6282816, 'steps': 32722, 'loss/train': 1.418270230293274}7}}
+11/07/2021 01:51:40 - INFO - __main__ - Step 32728: {'lr': 0.0004486813437701389, 'samples': 6283776, 'steps': 32727, 'loss/train': 1.4692602157592773}}}
+11/07/2021 01:51:40 - INFO - __main__ - Step 32728: {'lr': 0.0004486813437701389, 'samples': 6283776, 'steps': 32727, 'loss/train': 1.4692602157592773}}}
+11/07/2021 01:51:43 - INFO - __main__ - Step 32735: {'lr': 0.0004486587943652823, 'samples': 6285120, 'steps': 32734, 'loss/train': 0.731379508972168}}}}
+11/07/2021 01:51:45 - INFO - __main__ - Step 32739: {'lr': 0.00044864590702176977, 'samples': 6285888, 'steps': 32738, 'loss/train': 2.4802517890930176}}
+11/07/2021 01:51:48 - INFO - __main__ - Step 32744: {'lr': 0.0004486297958284874, 'samples': 6286848, 'steps': 32743, 'loss/train': 1.754269003868103}6}}
+11/07/2021 01:51:50 - INFO - __main__ - Step 32749: {'lr': 0.00044861368239771694, 'samples': 6287808, 'steps': 32748, 'loss/train': 1.5400633811950684}}
+11/07/2021 01:51:50 - INFO - __main__ - Step 32749: {'lr': 0.00044861368239771694, 'samples': 6287808, 'steps': 32748, 'loss/train': 1.5400633811950684}}
+11/07/2021 01:51:53 - INFO - __main__ - Step 32756: {'lr': 0.0004485911198360041, 'samples': 6289152, 'steps': 32755, 'loss/train': 1.0894807577133179}}}
+11/07/2021 01:51:56 - INFO - __main__ - Step 32760: {'lr': 0.0004485782249749587, 'samples': 6289920, 'steps': 32759, 'loss/train': 1.6369692087173462}}}
+11/07/2021 01:51:58 - INFO - __main__ - Step 32764: {'lr': 0.0004485653286822927, 'samples': 6290688, 'steps': 32763, 'loss/train': 1.508261799812317}}}}
+11/07/2021 01:51:58 - INFO - __main__ - Step 32764: {'lr': 0.0004485653286822927, 'samples': 6290688, 'steps': 32763, 'loss/train': 1.508261799812317}}}}
+11/07/2021 01:52:02 - INFO - __main__ - Step 32771: {'lr': 0.0004485427567255701, 'samples': 6292032, 'steps': 32770, 'loss/train': 1.6293174028396606}}}
+11/07/2021 01:52:02 - INFO - __main__ - Step 32771: {'lr': 0.0004485427567255701, 'samples': 6292032, 'steps': 32770, 'loss/train': 1.6293174028396606}}}
+11/07/2021 01:52:02 - INFO - __main__ - Step 32771: {'lr': 0.0004485427567255701, 'samples': 6292032, 'steps': 32770, 'loss/train': 1.6293174028396606}}}
+11/07/2021 01:52:08 - INFO - __main__ - Step 32781: {'lr': 0.00044851050346910706, 'samples': 6293952, 'steps': 32780, 'loss/train': 1.8087482452392578}}
+11/07/2021 01:52:10 - INFO - __main__ - Step 32785: {'lr': 0.0004484975996619589, 'samples': 6294720, 'steps': 32784, 'loss/train': 1.4865195751190186}}}
+11/07/2021 01:52:12 - INFO - __main__ - Step 32789: {'lr': 0.0004484846944237714, 'samples': 6295488, 'steps': 32788, 'loss/train': 1.3773404359817505}}}
+11/07/2021 01:52:13 - INFO - __main__ - Step 32793: {'lr': 0.0004484717877546377, 'samples': 6296256, 'steps': 32792, 'loss/train': 1.530842900276184}}}}
+11/07/2021 01:52:15 - INFO - __main__ - Step 32797: {'lr': 0.00044845887965465076, 'samples': 6297024, 'steps': 32796, 'loss/train': 0.6192265748977661}}
+11/07/2021 01:52:18 - INFO - __main__ - Step 32803: {'lr': 0.0004484395148220243, 'samples': 6298176, 'steps': 32802, 'loss/train': 1.4404723644256592}}}
+11/07/2021 01:52:20 - INFO - __main__ - Step 32807: {'lr': 0.00044842660314531145, 'samples': 6298944, 'steps': 32806, 'loss/train': 1.6565542221069336}}
+11/07/2021 01:52:22 - INFO - __main__ - Step 32811: {'lr': 0.0004484136900380713, 'samples': 6299712, 'steps': 32810, 'loss/train': 1.570265531539917}6}}
+11/07/2021 01:52:22 - INFO - __main__ - Step 32811: {'lr': 0.0004484136900380713, 'samples': 6299712, 'steps': 32810, 'loss/train': 1.570265531539917}6}}
+11/07/2021 01:52:25 - INFO - __main__ - Step 32818: {'lr': 0.0004483910886584743, 'samples': 6301056, 'steps': 32817, 'loss/train': 1.8153525590896606}}}
+11/07/2021 01:52:28 - INFO - __main__ - Step 32823: {'lr': 0.000448374942134117, 'samples': 6302016, 'steps': 32822, 'loss/train': 1.758912205696106}6}}}
+11/07/2021 01:52:30 - INFO - __main__ - Step 32828: {'lr': 0.00044835879337514254, 'samples': 6302976, 'steps': 32827, 'loss/train': 1.0733113288879395}}
+11/07/2021 01:52:30 - INFO - __main__ - Step 32828: {'lr': 0.00044835879337514254, 'samples': 6302976, 'steps': 32827, 'loss/train': 1.0733113288879395}}
+11/07/2021 01:52:33 - INFO - __main__ - Step 32834: {'lr': 0.00044833941191493463, 'samples': 6304128, 'steps': 32833, 'loss/train': 1.464808464050293}}}
+11/07/2021 01:52:36 - INFO - __main__ - Step 32839: {'lr': 0.00044832325824044274, 'samples': 6305088, 'steps': 32838, 'loss/train': 1.810701847076416}}}
+11/07/2021 01:52:38 - INFO - __main__ - Step 32844: {'lr': 0.00044830710233191573, 'samples': 6306048, 'steps': 32843, 'loss/train': 1.419494867324829}}}
+11/07/2021 01:52:38 - INFO - __main__ - Step 32844: {'lr': 0.00044830710233191573, 'samples': 6306048, 'steps': 32843, 'loss/train': 1.419494867324829}}}
+11/07/2021 01:52:38 - INFO - __main__ - Step 32844: {'lr': 0.00044830710233191573, 'samples': 6306048, 'steps': 32843, 'loss/train': 1.419494867324829}}}
+11/07/2021 01:52:44 - INFO - __main__ - Step 32854: {'lr': 0.00044827478381348495, 'samples': 6307968, 'steps': 32853, 'loss/train': 0.8628458976745605}}
+11/07/2021 01:52:45 - INFO - __main__ - Step 32858: {'lr': 0.0004482618539045234, 'samples': 6308736, 'steps': 32857, 'loss/train': 1.3535361289978027}}}
+11/07/2021 01:52:47 - INFO - __main__ - Step 32862: {'lr': 0.0004482489225662222, 'samples': 6309504, 'steps': 32861, 'loss/train': 1.0501551628112793}}}
+11/07/2021 01:52:50 - INFO - __main__ - Step 32867: {'lr': 0.0004482327563834787, 'samples': 6310464, 'steps': 32866, 'loss/train': 2.1392643451690674}}}
+11/07/2021 01:52:52 - INFO - __main__ - Step 32872: {'lr': 0.0004482165879677197, 'samples': 6311424, 'steps': 32871, 'loss/train': 1.16120183467865}4}}}
+11/07/2021 01:52:54 - INFO - __main__ - Step 32876: {'lr': 0.00044820365162746373, 'samples': 6312192, 'steps': 32875, 'loss/train': 1.523007869720459}}}
+11/07/2021 01:52:54 - INFO - __main__ - Step 32876: {'lr': 0.00044820365162746373, 'samples': 6312192, 'steps': 32875, 'loss/train': 1.523007869720459}}}
+11/07/2021 01:52:58 - INFO - __main__ - Step 32883: {'lr': 0.0004481810095937329, 'samples': 6313536, 'steps': 32882, 'loss/train': 1.4392449855804443}}}
+11/07/2021 01:53:00 - INFO - __main__ - Step 32888: {'lr': 0.0004481648340335482, 'samples': 6314496, 'steps': 32887, 'loss/train': 1.4408528804779053}}}
+11/07/2021 01:53:00 - INFO - __main__ - Step 32888: {'lr': 0.0004481648340335482, 'samples': 6314496, 'steps': 32887, 'loss/train': 1.4408528804779053}}}
+11/07/2021 01:53:04 - INFO - __main__ - Step 32896: {'lr': 0.00044813894849424777, 'samples': 6316032, 'steps': 32895, 'loss/train': 1.8859457969665527}}
+11/07/2021 01:53:06 - INFO - __main__ - Step 32900: {'lr': 0.0004481260035818704, 'samples': 6316800, 'steps': 32899, 'loss/train': 0.8094185590744019}}}
+11/07/2021 01:53:08 - INFO - __main__ - Step 32904: {'lr': 0.0004481130572411327, 'samples': 6317568, 'steps': 32903, 'loss/train': 1.5772401094436646}}}
+11/07/2021 01:53:10 - INFO - __main__ - Step 32909: {'lr': 0.00044809687230672115, 'samples': 6318528, 'steps': 32908, 'loss/train': 1.201430320739746}}}
+11/07/2021 01:53:10 - INFO - __main__ - Step 32909: {'lr': 0.00044809687230672115, 'samples': 6318528, 'steps': 32908, 'loss/train': 1.201430320739746}}}
+11/07/2021 01:53:14 - INFO - __main__ - Step 32916: {'lr': 0.00044807420964969113, 'samples': 6319872, 'steps': 32915, 'loss/train': 1.5196776390075684}}
+11/07/2021 01:53:16 - INFO - __main__ - Step 32920: {'lr': 0.00044806125759644567, 'samples': 6320640, 'steps': 32919, 'loss/train': 1.3492869138717651}}
+11/07/2021 01:53:18 - INFO - __main__ - Step 32924: {'lr': 0.0004480483041153066, 'samples': 6321408, 'steps': 32923, 'loss/train': 1.350351095199585}1}}
+11/07/2021 01:53:20 - INFO - __main__ - Step 32929: {'lr': 0.00044803211025604985, 'samples': 6322368, 'steps': 32928, 'loss/train': 1.494863748550415}}}
+11/07/2021 01:53:22 - INFO - __main__ - Step 32933: {'lr': 0.0004480191535624918, 'samples': 6323136, 'steps': 32932, 'loss/train': 1.4989677667617798}}}
+11/07/2021 01:53:24 - INFO - __main__ - Step 32937: {'lr': 0.00044800619544134375, 'samples': 6323904, 'steps': 32936, 'loss/train': 1.7458767890930176}}
+11/07/2021 01:53:24 - INFO - __main__ - Step 32937: {'lr': 0.00044800619544134375, 'samples': 6323904, 'steps': 32936, 'loss/train': 1.7458767890930176}}
+11/07/2021 01:53:28 - INFO - __main__ - Step 32945: {'lr': 0.00044798027491665135, 'samples': 6325440, 'steps': 32944, 'loss/train': 1.762140154838562}}}
+11/07/2021 01:53:30 - INFO - __main__ - Step 32950: {'lr': 0.0004479640716894483, 'samples': 6326400, 'steps': 32949, 'loss/train': 1.559309720993042}}}}
+11/07/2021 01:53:33 - INFO - __main__ - Step 32955: {'lr': 0.00044794786623225636, 'samples': 6327360, 'steps': 32954, 'loss/train': 1.3424718379974365}}
+11/07/2021 01:53:33 - INFO - __main__ - Step 32955: {'lr': 0.00044794786623225636, 'samples': 6327360, 'steps': 32954, 'loss/train': 1.3424718379974365}}
+11/07/2021 01:53:36 - INFO - __main__ - Step 32962: {'lr': 0.00044792517484615384, 'samples': 6328704, 'steps': 32961, 'loss/train': 1.1192171573638916}}
+11/07/2021 01:53:38 - INFO - __main__ - Step 32966: {'lr': 0.0004479122063777728, 'samples': 6329472, 'steps': 32965, 'loss/train': 1.8037034273147583}}}
+11/07/2021 01:53:41 - INFO - __main__ - Step 32971: {'lr': 0.00044789599378584324, 'samples': 6330432, 'steps': 32970, 'loss/train': 1.7470932006835938}}
+11/07/2021 01:53:41 - INFO - __main__ - Step 32971: {'lr': 0.00044789599378584324, 'samples': 6330432, 'steps': 32970, 'loss/train': 1.7470932006835938}}
+11/07/2021 01:53:43 - INFO - __main__ - Step 32977: {'lr': 0.0004478765357329708, 'samples': 6331584, 'steps': 32976, 'loss/train': 1.7699060440063477}}}
+11/07/2021 01:53:46 - INFO - __main__ - Step 32982: {'lr': 0.00044786031823699384, 'samples': 6332544, 'steps': 32981, 'loss/train': 1.4322315454483032}}
+11/07/2021 01:53:46 - INFO - __main__ - Step 32982: {'lr': 0.00044786031823699384, 'samples': 6332544, 'steps': 32981, 'loss/train': 1.4322315454483032}}
+11/07/2021 01:53:50 - INFO - __main__ - Step 32990: {'lr': 0.00044783436560756086, 'samples': 6334080, 'steps': 32989, 'loss/train': 1.7610799074172974}}
+11/07/2021 01:53:52 - INFO - __main__ - Step 32994: {'lr': 0.00044782138715341094, 'samples': 6334848, 'steps': 32993, 'loss/train': 1.7642078399658203}}
+11/07/2021 01:53:54 - INFO - __main__ - Step 32998: {'lr': 0.00044780840727309676, 'samples': 6335616, 'steps': 32997, 'loss/train': 1.4560761451721191}}
+11/07/2021 01:53:56 - INFO - __main__ - Step 33003: {'lr': 0.00044779218041730314, 'samples': 6336576, 'steps': 33002, 'loss/train': 1.16958487033844}1}}
+11/07/2021 01:53:56 - INFO - __main__ - Step 33003: {'lr': 0.00044779218041730314, 'samples': 6336576, 'steps': 33002, 'loss/train': 1.16958487033844}1}}
+11/07/2021 01:53:56 - INFO - __main__ - Step 33003: {'lr': 0.00044779218041730314, 'samples': 6336576, 'steps': 33002, 'loss/train': 1.16958487033844}1}}
+11/07/2021 01:54:01 - INFO - __main__ - Step 33014: {'lr': 0.0004477564734920694, 'samples': 6338688, 'steps': 33013, 'loss/train': 1.2043906450271606}}}
+11/07/2021 01:54:03 - INFO - __main__ - Step 33018: {'lr': 0.0004477434864823379, 'samples': 6339456, 'steps': 33017, 'loss/train': 1.5662287473678589}}}
+11/07/2021 01:54:06 - INFO - __main__ - Step 33023: {'lr': 0.0004477272507154308, 'samples': 6340416, 'steps': 33022, 'loss/train': 1.5063848495483398}}}
+11/07/2021 01:54:08 - INFO - __main__ - Step 33028: {'lr': 0.0004477110127212025, 'samples': 6341376, 'steps': 33027, 'loss/train': 1.0178325176239014}}}
+11/07/2021 01:54:10 - INFO - __main__ - Step 33032: {'lr': 0.0004476980207222716, 'samples': 6342144, 'steps': 33031, 'loss/train': 1.3227752447128296}}}
+11/07/2021 01:54:10 - INFO - __main__ - Step 33032: {'lr': 0.0004476980207222716, 'samples': 6342144, 'steps': 33031, 'loss/train': 1.3227752447128296}}}
+11/07/2021 01:54:14 - INFO - __main__ - Step 33039: {'lr': 0.0004476752812946312, 'samples': 6343488, 'steps': 33038, 'loss/train': 1.3962721824645996}}}
+11/07/2021 01:54:16 - INFO - __main__ - Step 33044: {'lr': 0.00044765903617420436, 'samples': 6344448, 'steps': 33043, 'loss/train': 1.1298271417617798}}
+11/07/2021 01:54:18 - INFO - __main__ - Step 33049: {'lr': 0.0004476427888272248, 'samples': 6345408, 'steps': 33048, 'loss/train': 1.2218657732009888}}}
+11/07/2021 01:54:18 - INFO - __main__ - Step 33049: {'lr': 0.0004476427888272248, 'samples': 6345408, 'steps': 33048, 'loss/train': 1.2218657732009888}}}
+11/07/2021 01:54:22 - INFO - __main__ - Step 33056: {'lr': 0.0004476200388011932, 'samples': 6346752, 'steps': 33055, 'loss/train': 1.2742310762405396}}}
+11/07/2021 01:54:24 - INFO - __main__ - Step 33060: {'lr': 0.00044760703682730584, 'samples': 6347520, 'steps': 33059, 'loss/train': 3.064441680908203}}}
+11/07/2021 01:54:26 - INFO - __main__ - Step 33064: {'lr': 0.0004475940334287996, 'samples': 6348288, 'steps': 33063, 'loss/train': 1.500831961631775}}}}
+11/07/2021 01:54:28 - INFO - __main__ - Step 33069: {'lr': 0.0004475777771774393, 'samples': 6349248, 'steps': 33068, 'loss/train': 1.1545443534851074}}}
+11/07/2021 01:54:30 - INFO - __main__ - Step 33073: {'lr': 0.00044756477057388336, 'samples': 6350016, 'steps': 33072, 'loss/train': 1.4639098644256592}}
+11/07/2021 01:54:30 - INFO - __main__ - Step 33073: {'lr': 0.00044756477057388336, 'samples': 6350016, 'steps': 33072, 'loss/train': 1.4639098644256592}}
+11/07/2021 01:54:34 - INFO - __main__ - Step 33080: {'lr': 0.00044754200559046076, 'samples': 6351360, 'steps': 33079, 'loss/train': 1.2222187519073486}}
+11/07/2021 01:54:36 - INFO - __main__ - Step 33085: {'lr': 0.00044752574221770537, 'samples': 6352320, 'steps': 33084, 'loss/train': 1.0361472368240356}}
+11/07/2021 01:54:36 - INFO - __main__ - Step 33085: {'lr': 0.00044752574221770537, 'samples': 6352320, 'steps': 33084, 'loss/train': 1.0361472368240356}}
+11/07/2021 01:54:40 - INFO - __main__ - Step 33093: {'lr': 0.00044749971619326633, 'samples': 6353856, 'steps': 33092, 'loss/train': 1.8795900344848633}}
+11/07/2021 01:54:42 - INFO - __main__ - Step 33097: {'lr': 0.0004474867010452321, 'samples': 6354624, 'steps': 33096, 'loss/train': 1.044918179512024}3}}
+11/07/2021 01:54:44 - INFO - __main__ - Step 33102: {'lr': 0.00044747043010805, 'samples': 6355584, 'steps': 33101, 'loss/train': 1.7007176876068115}}3}}
+11/07/2021 01:54:47 - INFO - __main__ - Step 33106: {'lr': 0.0004474574117567072, 'samples': 6356352, 'steps': 33105, 'loss/train': 1.1456880569458008}}}
+11/07/2021 01:54:49 - INFO - __main__ - Step 33110: {'lr': 0.0004474443919818241, 'samples': 6357120, 'steps': 33109, 'loss/train': 1.4442769289016724}}}
+11/07/2021 01:54:51 - INFO - __main__ - Step 33114: {'lr': 0.0004474313707834947, 'samples': 6357888, 'steps': 33113, 'loss/train': 4.484914779663086}}}}
+11/07/2021 01:54:52 - INFO - __main__ - Step 33118: {'lr': 0.0004474183481618129, 'samples': 6358656, 'steps': 33117, 'loss/train': 1.3420227766036987}}}
+11/07/2021 01:54:52 - INFO - __main__ - Step 33118: {'lr': 0.0004474183481618129, 'samples': 6358656, 'steps': 33117, 'loss/train': 1.3420227766036987}}}
+11/07/2021 01:54:56 - INFO - __main__ - Step 33126: {'lr': 0.0004473922986487674, 'samples': 6360192, 'steps': 33125, 'loss/train': 1.3780709505081177}}}
+11/07/2021 01:54:58 - INFO - __main__ - Step 33130: {'lr': 0.0004473792717575915, 'samples': 6360960, 'steps': 33129, 'loss/train': 1.9495084285736084}}}
+11/07/2021 01:55:00 - INFO - __main__ - Step 33134: {'lr': 0.0004473662434434388, 'samples': 6361728, 'steps': 33133, 'loss/train': 1.762020230293274}}}}
+11/07/2021 01:55:02 - INFO - __main__ - Step 33139: {'lr': 0.00044734995604982973, 'samples': 6362688, 'steps': 33138, 'loss/train': 1.522831916809082}}}
+11/07/2021 01:55:02 - INFO - __main__ - Step 33139: {'lr': 0.00044734995604982973, 'samples': 6362688, 'steps': 33138, 'loss/train': 1.522831916809082}}}
+11/07/2021 01:55:02 - INFO - __main__ - Step 33139: {'lr': 0.00044734995604982973, 'samples': 6362688, 'steps': 33138, 'loss/train': 1.522831916809082}}}
+11/07/2021 01:55:08 - INFO - __main__ - Step 33149: {'lr': 0.0004473173745935818, 'samples': 6364608, 'steps': 33148, 'loss/train': 1.4953867197036743}}}
+11/07/2021 01:55:10 - INFO - __main__ - Step 33154: {'lr': 0.00044730108053130986, 'samples': 6365568, 'steps': 33153, 'loss/train': 1.3361729383468628}}
+11/07/2021 01:55:13 - INFO - __main__ - Step 33159: {'lr': 0.00044728478424651744, 'samples': 6366528, 'steps': 33158, 'loss/train': 0.8608505129814148}}
+11/07/2021 01:55:13 - INFO - __main__ - Step 33159: {'lr': 0.00044728478424651744, 'samples': 6366528, 'steps': 33158, 'loss/train': 0.8608505129814148}}
+11/07/2021 01:55:16 - INFO - __main__ - Step 33166: {'lr': 0.0004472619657143229, 'samples': 6367872, 'steps': 33165, 'loss/train': 1.4132847785949707}}}
+11/07/2021 01:55:18 - INFO - __main__ - Step 33170: {'lr': 0.0004472489245976063, 'samples': 6368640, 'steps': 33169, 'loss/train': 1.5054649114608765}}}
+11/07/2021 01:55:20 - INFO - __main__ - Step 33175: {'lr': 0.00044723262120198177, 'samples': 6369600, 'steps': 33174, 'loss/train': 1.5991913080215454}}
+11/07/2021 01:55:20 - INFO - __main__ - Step 33175: {'lr': 0.00044723262120198177, 'samples': 6369600, 'steps': 33174, 'loss/train': 1.5991913080215454}}
+11/07/2021 01:55:24 - INFO - __main__ - Step 33182: {'lr': 0.00044720979271560963, 'samples': 6370944, 'steps': 33181, 'loss/train': 1.4953434467315674}}
+11/07/2021 01:55:26 - INFO - __main__ - Step 33186: {'lr': 0.0004471967459113086, 'samples': 6371712, 'steps': 33185, 'loss/train': 0.953913688659668}4}}
+11/07/2021 01:55:28 - INFO - __main__ - Step 33191: {'lr': 0.00044718043540673257, 'samples': 6372672, 'steps': 33190, 'loss/train': 1.7337013483047485}}
+11/07/2021 01:55:28 - INFO - __main__ - Step 33191: {'lr': 0.00044718043540673257, 'samples': 6372672, 'steps': 33190, 'loss/train': 1.7337013483047485}}
+11/07/2021 01:55:32 - INFO - __main__ - Step 33199: {'lr': 0.0004471543339794715, 'samples': 6374208, 'steps': 33198, 'loss/train': 1.2976843118667603}}}
+11/07/2021 01:55:34 - INFO - __main__ - Step 33203: {'lr': 0.0004471412811337611, 'samples': 6374976, 'steps': 33202, 'loss/train': 1.6096456050872803}}}
+11/07/2021 01:55:36 - INFO - __main__ - Step 33207: {'lr': 0.00044712822686678955, 'samples': 6375744, 'steps': 33206, 'loss/train': 1.668056607246399}}}
+11/07/2021 01:55:38 - INFO - __main__ - Step 33212: {'lr': 0.00044711190703457005, 'samples': 6376704, 'steps': 33211, 'loss/train': 1.2352567911148071}}
+11/07/2021 01:55:40 - INFO - __main__ - Step 33216: {'lr': 0.0004470988495701052, 'samples': 6377472, 'steps': 33215, 'loss/train': 1.591020107269287}1}}
+11/07/2021 01:55:42 - INFO - __main__ - Step 33220: {'lr': 0.00044708579068468505, 'samples': 6378240, 'steps': 33219, 'loss/train': 1.5764384269714355}}
+11/07/2021 01:55:44 - INFO - __main__ - Step 33224: {'lr': 0.0004470727303784039, 'samples': 6379008, 'steps': 33223, 'loss/train': 1.5153917074203491}}}
+11/07/2021 01:55:46 - INFO - __main__ - Step 33228: {'lr': 0.00044705966865135583, 'samples': 6379776, 'steps': 33227, 'loss/train': 2.1757476329803467}}
+11/07/2021 01:55:48 - INFO - __main__ - Step 33232: {'lr': 0.00044704660550363507, 'samples': 6380544, 'steps': 33231, 'loss/train': 1.9485957622528076}}
+11/07/2021 01:55:50 - INFO - __main__ - Step 33237: {'lr': 0.0004470302745713065, 'samples': 6381504, 'steps': 33236, 'loss/train': 1.4370431900024414}}}
+11/07/2021 01:55:50 - INFO - __main__ - Step 33237: {'lr': 0.0004470302745713065, 'samples': 6381504, 'steps': 33236, 'loss/train': 1.4370431900024414}}}
+11/07/2021 01:55:55 - INFO - __main__ - Step 33245: {'lr': 0.0004470041404631597, 'samples': 6383040, 'steps': 33244, 'loss/train': 0.9164215922355652}}}
+11/07/2021 01:55:56 - INFO - __main__ - Step 33249: {'lr': 0.00044699107127863056, 'samples': 6383808, 'steps': 33248, 'loss/train': 1.3086721897125244}}
+11/07/2021 01:55:59 - INFO - __main__ - Step 33253: {'lr': 0.00044697800067392327, 'samples': 6384576, 'steps': 33252, 'loss/train': 1.573535680770874}}}
+11/07/2021 01:55:59 - INFO - __main__ - Step 33253: {'lr': 0.00044697800067392327, 'samples': 6384576, 'steps': 33252, 'loss/train': 1.573535680770874}}}
+11/07/2021 01:56:02 - INFO - __main__ - Step 33260: {'lr': 0.0004469551236986651, 'samples': 6385920, 'steps': 33259, 'loss/train': 1.6525382995605469}}}
+11/07/2021 01:56:04 - INFO - __main__ - Step 33264: {'lr': 0.00044694204918895367, 'samples': 6386688, 'steps': 33263, 'loss/train': 1.9074795246124268}}
+11/07/2021 01:56:06 - INFO - __main__ - Step 33269: {'lr': 0.00044692570405519683, 'samples': 6387648, 'steps': 33268, 'loss/train': 1.416410207748413}}}
+11/07/2021 01:56:06 - INFO - __main__ - Step 33269: {'lr': 0.00044692570405519683, 'samples': 6387648, 'steps': 33268, 'loss/train': 1.416410207748413}}}
+11/07/2021 01:56:11 - INFO - __main__ - Step 33277: {'lr': 0.00044689954722721494, 'samples': 6389184, 'steps': 33276, 'loss/train': 1.537747859954834}}}
+11/07/2021 01:56:12 - INFO - __main__ - Step 33281: {'lr': 0.00044688646668389933, 'samples': 6389952, 'steps': 33280, 'loss/train': 1.5683271884918213}}
+11/07/2021 01:56:14 - INFO - __main__ - Step 33285: {'lr': 0.00044687338472115964, 'samples': 6390720, 'steps': 33284, 'loss/train': 1.4872294664382935}}
+11/07/2021 01:56:17 - INFO - __main__ - Step 33290: {'lr': 0.00044685703027181364, 'samples': 6391680, 'steps': 33289, 'loss/train': 1.8223915100097656}}
+11/07/2021 01:56:19 - INFO - __main__ - Step 33295: {'lr': 0.00044684067360494905, 'samples': 6392640, 'steps': 33294, 'loss/train': 1.848178744316101}}}
+11/07/2021 01:56:19 - INFO - __main__ - Step 33295: {'lr': 0.00044684067360494905, 'samples': 6392640, 'steps': 33294, 'loss/train': 1.848178744316101}}}
+11/07/2021 01:56:23 - INFO - __main__ - Step 33302: {'lr': 0.0004468177705462585, 'samples': 6393984, 'steps': 33301, 'loss/train': 1.3737915754318237}}}
+11/07/2021 01:56:24 - INFO - __main__ - Step 33306: {'lr': 0.00044680468113309006, 'samples': 6394752, 'steps': 33305, 'loss/train': 1.0961544513702393}}
+11/07/2021 01:56:27 - INFO - __main__ - Step 33311: {'lr': 0.0004467883173714047, 'samples': 6395712, 'steps': 33310, 'loss/train': 1.6529051065444946}}}
+11/07/2021 01:56:29 - INFO - __main__ - Step 33316: {'lr': 0.00044677195139297476, 'samples': 6396672, 'steps': 33315, 'loss/train': 1.5994012355804443}}
+11/07/2021 01:56:31 - INFO - __main__ - Step 33320: {'lr': 0.00044675885701429873, 'samples': 6397440, 'steps': 33319, 'loss/train': 1.3172155618667603}}
+11/07/2021 01:56:31 - INFO - __main__ - Step 33320: {'lr': 0.00044675885701429873, 'samples': 6397440, 'steps': 33319, 'loss/train': 1.3172155618667603}}
+11/07/2021 01:56:34 - INFO - __main__ - Step 33327: {'lr': 0.000446735938438397, 'samples': 6398784, 'steps': 33326, 'loss/train': 0.787378191947937}03}}
+11/07/2021 01:56:37 - INFO - __main__ - Step 33331: {'lr': 0.0004467228401590619, 'samples': 6399552, 'steps': 33330, 'loss/train': 1.2289947271347046}}}
+11/07/2021 01:56:37 - INFO - __main__ - Step 33331: {'lr': 0.0004467228401590619, 'samples': 6399552, 'steps': 33330, 'loss/train': 1.2289947271347046}}}
+11/07/2021 01:56:41 - INFO - __main__ - Step 33338: {'lr': 0.00044669991475763173, 'samples': 6400896, 'steps': 33337, 'loss/train': 1.0887442827224731}}
+11/07/2021 01:56:42 - INFO - __main__ - Step 33342: {'lr': 0.00044668681257835173, 'samples': 6401664, 'steps': 33341, 'loss/train': 1.473926305770874}}}
+11/07/2021 01:56:44 - INFO - __main__ - Step 33346: {'lr': 0.0004466737089810871, 'samples': 6402432, 'steps': 33345, 'loss/train': 1.721977710723877}}}}
+11/07/2021 01:56:47 - INFO - __main__ - Step 33351: {'lr': 0.0004466573274906092, 'samples': 6403392, 'steps': 33350, 'loss/train': 1.2804734706878662}}}
+11/07/2021 01:56:48 - INFO - __main__ - Step 33355: {'lr': 0.0004466442207032244, 'samples': 6404160, 'steps': 33354, 'loss/train': 1.2369035482406616}}}
+11/07/2021 01:56:51 - INFO - __main__ - Step 33360: {'lr': 0.0004466278352253954, 'samples': 6405120, 'steps': 33359, 'loss/train': 1.5842740535736084}}}
+11/07/2021 01:56:51 - INFO - __main__ - Step 33360: {'lr': 0.0004466278352253954, 'samples': 6405120, 'steps': 33359, 'loss/train': 1.5842740535736084}}}
+11/07/2021 01:56:54 - INFO - __main__ - Step 33367: {'lr': 0.00044660489183538237, 'samples': 6406464, 'steps': 33366, 'loss/train': 1.8919562101364136}}
+11/07/2021 01:56:57 - INFO - __main__ - Step 33372: {'lr': 0.0004465885010420154, 'samples': 6407424, 'steps': 33371, 'loss/train': 1.249595046043396}6}}
+11/07/2021 01:56:57 - INFO - __main__ - Step 33372: {'lr': 0.0004465885010420154, 'samples': 6407424, 'steps': 33371, 'loss/train': 1.249595046043396}6}}
+11/07/2021 01:57:01 - INFO - __main__ - Step 33380: {'lr': 0.00044656227116655824, 'samples': 6408960, 'steps': 33379, 'loss/train': 1.671711802482605}}}
+11/07/2021 01:57:01 - INFO - __main__ - Step 33380: {'lr': 0.00044656227116655824, 'samples': 6408960, 'steps': 33379, 'loss/train': 1.671711802482605}}}
+11/07/2021 01:57:05 - INFO - __main__ - Step 33387: {'lr': 0.00044653931537569125, 'samples': 6410304, 'steps': 33386, 'loss/train': 7.1502532958984375}}
+11/07/2021 01:57:06 - INFO - __main__ - Step 33391: {'lr': 0.0004465261958326108, 'samples': 6411072, 'steps': 33390, 'loss/train': 2.0901994705200195}}}
+11/07/2021 01:57:08 - INFO - __main__ - Step 33395: {'lr': 0.0004465130748727036, 'samples': 6411840, 'steps': 33394, 'loss/train': 1.4100768566131592}}}
+11/07/2021 01:57:11 - INFO - __main__ - Step 33400: {'lr': 0.0004464966716805511, 'samples': 6412800, 'steps': 33399, 'loss/train': 1.7051008939743042}}}
+11/07/2021 01:57:13 - INFO - __main__ - Step 33404: {'lr': 0.0004464835475331296, 'samples': 6413568, 'steps': 33403, 'loss/train': 1.8330544233322144}}}
+11/07/2021 01:57:13 - INFO - __main__ - Step 33404: {'lr': 0.0004464835475331296, 'samples': 6413568, 'steps': 33403, 'loss/train': 1.8330544233322144}}}
+11/07/2021 01:57:16 - INFO - __main__ - Step 33411: {'lr': 0.0004464605768666995, 'samples': 6414912, 'steps': 33410, 'loss/train': 1.5178637504577637}}}
+11/07/2021 01:57:19 - INFO - __main__ - Step 33416: {'lr': 0.00044644416659212806, 'samples': 6415872, 'steps': 33415, 'loss/train': 1.6313021183013916}}
+11/07/2021 01:57:19 - INFO - __main__ - Step 33416: {'lr': 0.00044644416659212806, 'samples': 6415872, 'steps': 33415, 'loss/train': 1.6313021183013916}}
+11/07/2021 01:57:23 - INFO - __main__ - Step 33424: {'lr': 0.0004464179055501258, 'samples': 6417408, 'steps': 33423, 'loss/train': 1.4190086126327515}}}
+11/07/2021 01:57:25 - INFO - __main__ - Step 33428: {'lr': 0.00044640477290500824, 'samples': 6418176, 'steps': 33427, 'loss/train': 1.526247501373291}}}
+11/07/2021 01:57:26 - INFO - __main__ - Step 33432: {'lr': 0.0004463916388439394, 'samples': 6418944, 'steps': 33431, 'loss/train': 1.5159145593643188}}}
+11/07/2021 01:57:29 - INFO - __main__ - Step 33437: {'lr': 0.000446375219276566, 'samples': 6419904, 'steps': 33436, 'loss/train': 1.4341305494308472}}}}
+11/07/2021 01:57:31 - INFO - __main__ - Step 33441: {'lr': 0.00044636208202995277, 'samples': 6420672, 'steps': 33440, 'loss/train': 1.4302234649658203}}
+11/07/2021 01:57:33 - INFO - __main__ - Step 33445: {'lr': 0.0004463489433676959, 'samples': 6421440, 'steps': 33444, 'loss/train': 2.250821352005005}3}}
+11/07/2021 01:57:35 - INFO - __main__ - Step 33449: {'lr': 0.0004463358032898903, 'samples': 6422208, 'steps': 33448, 'loss/train': 2.1877307891845703}}}
+11/07/2021 01:57:36 - INFO - __main__ - Step 33453: {'lr': 0.0004463226617966305, 'samples': 6422976, 'steps': 33452, 'loss/train': 1.6182461977005005}}}
+11/07/2021 01:57:38 - INFO - __main__ - Step 33457: {'lr': 0.0004463095188880113, 'samples': 6423744, 'steps': 33456, 'loss/train': 1.511284589767456}}}}
+11/07/2021 01:57:41 - INFO - __main__ - Step 33462: {'lr': 0.0004462930882620325, 'samples': 6424704, 'steps': 33461, 'loss/train': 1.2532994747161865}}}
+11/07/2021 01:57:43 - INFO - __main__ - Step 33466: {'lr': 0.0004462799421692012, 'samples': 6425472, 'steps': 33465, 'loss/train': 1.49006986618042}5}}}
+11/07/2021 01:57:45 - INFO - __main__ - Step 33470: {'lr': 0.0004462667946613184, 'samples': 6426240, 'steps': 33469, 'loss/train': 1.6399989128112793}}}
+11/07/2021 01:57:47 - INFO - __main__ - Step 33474: {'lr': 0.00044625364573847904, 'samples': 6427008, 'steps': 33473, 'loss/train': 0.8817580342292786}}
+11/07/2021 01:57:49 - INFO - __main__ - Step 33478: {'lr': 0.00044624049540077784, 'samples': 6427776, 'steps': 33477, 'loss/train': 1.6491341590881348}}
+11/07/2021 01:57:51 - INFO - __main__ - Step 33482: {'lr': 0.0004462273436483095, 'samples': 6428544, 'steps': 33481, 'loss/train': 2.0158817768096924}}}
+11/07/2021 01:57:53 - INFO - __main__ - Step 33486: {'lr': 0.0004462141904811691, 'samples': 6429312, 'steps': 33485, 'loss/train': 1.271095633506775}}}}
+11/07/2021 01:57:55 - INFO - __main__ - Step 33490: {'lr': 0.0004462010358994513, 'samples': 6430080, 'steps': 33489, 'loss/train': 1.6507304906845093}}}
+11/07/2021 01:57:57 - INFO - __main__ - Step 33494: {'lr': 0.00044618787990325086, 'samples': 6430848, 'steps': 33493, 'loss/train': 1.9450844526290894}}
+11/07/2021 01:57:59 - INFO - __main__ - Step 33498: {'lr': 0.0004461747224926628, 'samples': 6431616, 'steps': 33497, 'loss/train': 1.6501895189285278}}}
+11/07/2021 01:58:01 - INFO - __main__ - Step 33503: {'lr': 0.0004461582737405895, 'samples': 6432576, 'steps': 33502, 'loss/train': 1.302112340927124}}}}
+11/07/2021 01:58:03 - INFO - __main__ - Step 33507: {'lr': 0.0004461451131479759, 'samples': 6433344, 'steps': 33506, 'loss/train': 1.5932680368423462}}}
+11/07/2021 01:58:05 - INFO - __main__ - Step 33511: {'lr': 0.0004461319511412829, 'samples': 6434112, 'steps': 33510, 'loss/train': 1.8179429769515991}}}
+11/07/2021 01:58:07 - INFO - __main__ - Step 33515: {'lr': 0.0004461187877206055, 'samples': 6434880, 'steps': 33514, 'loss/train': 1.1957716941833496}}}
+11/07/2021 01:58:09 - INFO - __main__ - Step 33519: {'lr': 0.00044610562288603846, 'samples': 6435648, 'steps': 33518, 'loss/train': 1.0899434089660645}}
+11/07/2021 01:58:11 - INFO - __main__ - Step 33524: {'lr': 0.00044608916485469195, 'samples': 6436608, 'steps': 33523, 'loss/train': 1.9318363666534424}}
+11/07/2021 01:58:13 - INFO - __main__ - Step 33528: {'lr': 0.0004460759968392204, 'samples': 6437376, 'steps': 33527, 'loss/train': 1.5011610984802246}}}
+11/07/2021 01:58:15 - INFO - __main__ - Step 33532: {'lr': 0.0004460628274101677, 'samples': 6438144, 'steps': 33531, 'loss/train': 1.682828664779663}}}}
+11/07/2021 01:58:17 - INFO - __main__ - Step 33536: {'lr': 0.00044604965656762884, 'samples': 6438912, 'steps': 33535, 'loss/train': 1.7080373764038086}}
+11/07/2021 01:58:19 - INFO - __main__ - Step 33540: {'lr': 0.00044603648431169884, 'samples': 6439680, 'steps': 33539, 'loss/train': 1.581534504890442}}}
+11/07/2021 01:58:21 - INFO - __main__ - Step 33545: {'lr': 0.00044602001700434963, 'samples': 6440640, 'steps': 33544, 'loss/train': 0.7786942720413208}}
+11/07/2021 01:58:23 - INFO - __main__ - Step 33549: {'lr': 0.0004460068415686366, 'samples': 6441408, 'steps': 33548, 'loss/train': 1.798831582069397}8}}
+11/07/2021 01:58:25 - INFO - __main__ - Step 33553: {'lr': 0.000445993664719841, 'samples': 6442176, 'steps': 33552, 'loss/train': 1.5944808721542358}8}}
+11/07/2021 01:58:27 - INFO - __main__ - Step 33557: {'lr': 0.000445980486458058, 'samples': 6442944, 'steps': 33556, 'loss/train': 1.659221887588501}}8}}
+11/07/2021 01:58:29 - INFO - __main__ - Step 33561: {'lr': 0.00044596730678338236, 'samples': 6443712, 'steps': 33560, 'loss/train': 1.454308032989502}}}
+11/07/2021 01:58:31 - INFO - __main__ - Step 33565: {'lr': 0.00044595412569590934, 'samples': 6444480, 'steps': 33564, 'loss/train': 1.0743993520736694}}
+11/07/2021 01:58:33 - INFO - __main__ - Step 33570: {'lr': 0.00044593764734996615, 'samples': 6445440, 'steps': 33569, 'loss/train': 1.4638475179672241}}
+11/07/2021 01:58:35 - INFO - __main__ - Step 33574: {'lr': 0.0004459244630840461, 'samples': 6446208, 'steps': 33573, 'loss/train': 0.9683477878570557}}}
+11/07/2021 01:58:38 - INFO - __main__ - Step 33578: {'lr': 0.0004459112774056374, 'samples': 6446976, 'steps': 33577, 'loss/train': 1.8841018676757812}}}
+11/07/2021 01:58:40 - INFO - __main__ - Step 33582: {'lr': 0.00044589809031483517, 'samples': 6447744, 'steps': 33581, 'loss/train': 1.8601634502410889}}
+11/07/2021 01:58:41 - INFO - __main__ - Step 33586: {'lr': 0.00044588490181173435, 'samples': 6448512, 'steps': 33585, 'loss/train': 1.6263537406921387}}
+11/07/2021 01:58:43 - INFO - __main__ - Step 33591: {'lr': 0.0004458684141969585, 'samples': 6449472, 'steps': 33590, 'loss/train': 1.5999499559402466}}}
+11/07/2021 01:58:43 - INFO - __main__ - Step 33591: {'lr': 0.0004458684141969585, 'samples': 6449472, 'steps': 33590, 'loss/train': 1.5999499559402466}}}
+11/07/2021 01:58:48 - INFO - __main__ - Step 33599: {'lr': 0.00044584202942411956, 'samples': 6451008, 'steps': 33598, 'loss/train': 1.7060731649398804}}
+11/07/2021 01:58:50 - INFO - __main__ - Step 33603: {'lr': 0.00044582883491981097, 'samples': 6451776, 'steps': 33602, 'loss/train': 1.7198821306228638}}
+11/07/2021 01:58:51 - INFO - __main__ - Step 33607: {'lr': 0.00044581563900370326, 'samples': 6452544, 'steps': 33606, 'loss/train': 1.5778969526290894}}
+11/07/2021 01:58:53 - INFO - __main__ - Step 33611: {'lr': 0.00044580244167589136, 'samples': 6453312, 'steps': 33610, 'loss/train': 1.672492265701294}}}
+11/07/2021 01:58:56 - INFO - __main__ - Step 33616: {'lr': 0.00044578594303106266, 'samples': 6454272, 'steps': 33615, 'loss/train': 1.8838460445404053}}
+11/07/2021 01:58:56 - INFO - __main__ - Step 33616: {'lr': 0.00044578594303106266, 'samples': 6454272, 'steps': 33615, 'loss/train': 1.8838460445404053}}
+11/07/2021 01:58:59 - INFO - __main__ - Step 33623: {'lr': 0.0004457628412231828, 'samples': 6455616, 'steps': 33622, 'loss/train': 1.6696631908416748}}}
+11/07/2021 01:59:01 - INFO - __main__ - Step 33627: {'lr': 0.0004457496382495062, 'samples': 6456384, 'steps': 33626, 'loss/train': 1.0140951871871948}}}
+11/07/2021 01:59:03 - INFO - __main__ - Step 33632: {'lr': 0.00044573313254788176, 'samples': 6457344, 'steps': 33631, 'loss/train': 1.1901419162750244}}
+11/07/2021 01:59:06 - INFO - __main__ - Step 33637: {'lr': 0.0004457166246413992, 'samples': 6458304, 'steps': 33636, 'loss/train': 1.040553092956543}4}}
+11/07/2021 01:59:08 - INFO - __main__ - Step 33641: {'lr': 0.00044570341672884006, 'samples': 6459072, 'steps': 33640, 'loss/train': 1.2570524215698242}}
+11/07/2021 01:59:08 - INFO - __main__ - Step 33641: {'lr': 0.00044570341672884006, 'samples': 6459072, 'steps': 33640, 'loss/train': 1.2570524215698242}}
+11/07/2021 01:59:11 - INFO - __main__ - Step 33648: {'lr': 0.00044568029948695287, 'samples': 6460416, 'steps': 33647, 'loss/train': 1.5932193994522095}}
+11/07/2021 01:59:14 - INFO - __main__ - Step 33653: {'lr': 0.00044566378452617363, 'samples': 6461376, 'steps': 33652, 'loss/train': 1.5953766107559204}}
+11/07/2021 01:59:16 - INFO - __main__ - Step 33658: {'lr': 0.0004456472673613174, 'samples': 6462336, 'steps': 33657, 'loss/train': 1.685717225074768}4}}
+11/07/2021 01:59:18 - INFO - __main__ - Step 33662: {'lr': 0.000445634052042622, 'samples': 6463104, 'steps': 33661, 'loss/train': 1.6241892576217651}4}}
+11/07/2021 01:59:18 - INFO - __main__ - Step 33662: {'lr': 0.000445634052042622, 'samples': 6463104, 'steps': 33661, 'loss/train': 1.6241892576217651}4}}
+11/07/2021 01:59:21 - INFO - __main__ - Step 33669: {'lr': 0.00044561092184119933, 'samples': 6464448, 'steps': 33668, 'loss/train': 1.6479049921035767}}
+11/07/2021 01:59:23 - INFO - __main__ - Step 33673: {'lr': 0.000445597702644147, 'samples': 6465216, 'steps': 33672, 'loss/train': 1.821217656135559}67}}
+11/07/2021 01:59:26 - INFO - __main__ - Step 33678: {'lr': 0.0004455811766648434, 'samples': 6466176, 'steps': 33677, 'loss/train': 1.6165025234222412}}}
+11/07/2021 01:59:28 - INFO - __main__ - Step 33683: {'lr': 0.0004455646484823933, 'samples': 6467136, 'steps': 33682, 'loss/train': 2.1249895095825195}}}
+11/07/2021 01:59:28 - INFO - __main__ - Step 33683: {'lr': 0.0004455646484823933, 'samples': 6467136, 'steps': 33682, 'loss/train': 2.1249895095825195}}}
+11/07/2021 01:59:31 - INFO - __main__ - Step 33690: {'lr': 0.00044554150532603154, 'samples': 6468480, 'steps': 33689, 'loss/train': 1.949639081954956}}}
+11/07/2021 01:59:34 - INFO - __main__ - Step 33694: {'lr': 0.00044552827872684493, 'samples': 6469248, 'steps': 33693, 'loss/train': 1.9272459745407104}}
+11/07/2021 01:59:36 - INFO - __main__ - Step 33699: {'lr': 0.00044551174349557733, 'samples': 6470208, 'steps': 33698, 'loss/train': 1.4626320600509644}}
+11/07/2021 01:59:36 - INFO - __main__ - Step 33699: {'lr': 0.00044551174349557733, 'samples': 6470208, 'steps': 33698, 'loss/train': 1.4626320600509644}}
+11/07/2021 01:59:40 - INFO - __main__ - Step 33707: {'lr': 0.0004454852825447087, 'samples': 6471744, 'steps': 33706, 'loss/train': 1.672659158706665}4}}
+11/07/2021 01:59:42 - INFO - __main__ - Step 33711: {'lr': 0.00044547204995524305, 'samples': 6472512, 'steps': 33710, 'loss/train': 1.8348017930984497}}
+11/07/2021 01:59:44 - INFO - __main__ - Step 33715: {'lr': 0.00044545881595655035, 'samples': 6473280, 'steps': 33714, 'loss/train': 1.4596387147903442}}
+11/07/2021 01:59:46 - INFO - __main__ - Step 33719: {'lr': 0.0004454455805487261, 'samples': 6474048, 'steps': 33718, 'loss/train': 1.7880730628967285}}}
+11/07/2021 01:59:48 - INFO - __main__ - Step 33723: {'lr': 0.00044543234373186556, 'samples': 6474816, 'steps': 33722, 'loss/train': 1.5587968826293945}}
+11/07/2021 01:59:48 - INFO - __main__ - Step 33723: {'lr': 0.00044543234373186556, 'samples': 6474816, 'steps': 33722, 'loss/train': 1.5587968826293945}}
+11/07/2021 01:59:51 - INFO - __main__ - Step 33730: {'lr': 0.00044540917591215335, 'samples': 6476160, 'steps': 33729, 'loss/train': 1.6598936319351196}}
+11/07/2021 01:59:54 - INFO - __main__ - Step 33736: {'lr': 0.0004453893143470661, 'samples': 6477312, 'steps': 33735, 'loss/train': 1.5552427768707275}}}
+11/07/2021 01:59:54 - INFO - __main__ - Step 33736: {'lr': 0.0004453893143470661, 'samples': 6477312, 'steps': 33735, 'loss/train': 1.5552427768707275}}}
+11/07/2021 01:59:58 - INFO - __main__ - Step 33743: {'lr': 0.0004453661385153604, 'samples': 6478656, 'steps': 33742, 'loss/train': 1.8474880456924438}}}
+11/07/2021 01:59:59 - INFO - __main__ - Step 33747: {'lr': 0.00044535289324628704, 'samples': 6479424, 'steps': 33746, 'loss/train': 1.3100298643112183}}
+11/07/2021 02:00:01 - INFO - __main__ - Step 33751: {'lr': 0.0004453396465688457, 'samples': 6480192, 'steps': 33750, 'loss/train': 1.4245951175689697}}}
+11/07/2021 02:00:04 - INFO - __main__ - Step 33756: {'lr': 0.0004453230862416721, 'samples': 6481152, 'steps': 33755, 'loss/train': 1.6372071504592896}}}
+11/07/2021 02:00:06 - INFO - __main__ - Step 33760: {'lr': 0.00044530983639575193, 'samples': 6481920, 'steps': 33759, 'loss/train': 1.6232199668884277}}
+11/07/2021 02:00:08 - INFO - __main__ - Step 33764: {'lr': 0.0004452965851417743, 'samples': 6482688, 'steps': 33763, 'loss/train': 1.709043025970459}7}}
+11/07/2021 02:00:10 - INFO - __main__ - Step 33768: {'lr': 0.00044528333247983456, 'samples': 6483456, 'steps': 33767, 'loss/train': 2.097458600997925}}}
+11/07/2021 02:00:12 - INFO - __main__ - Step 33773: {'lr': 0.0004452667646726088, 'samples': 6484416, 'steps': 33772, 'loss/train': 1.6249957084655762}}}
+11/07/2021 02:00:14 - INFO - __main__ - Step 33777: {'lr': 0.0004452535088431038, 'samples': 6485184, 'steps': 33776, 'loss/train': 1.4473791122436523}}}
+11/07/2021 02:00:14 - INFO - __main__ - Step 33777: {'lr': 0.0004452535088431038, 'samples': 6485184, 'steps': 33776, 'loss/train': 1.4473791122436523}}}
+11/07/2021 02:00:17 - INFO - __main__ - Step 33784: {'lr': 0.00044523030775436617, 'samples': 6486528, 'steps': 33783, 'loss/train': 1.2860418558120728}}
+11/07/2021 02:00:20 - INFO - __main__ - Step 33789: {'lr': 0.0004452137329090622, 'samples': 6487488, 'steps': 33788, 'loss/train': 1.3245213031768799}}}
+11/07/2021 02:00:22 - INFO - __main__ - Step 33794: {'lr': 0.00044519715586475083, 'samples': 6488448, 'steps': 33793, 'loss/train': 1.6966907978057861}}
+11/07/2021 02:00:22 - INFO - __main__ - Step 33794: {'lr': 0.00044519715586475083, 'samples': 6488448, 'steps': 33793, 'loss/train': 1.6966907978057861}}
+11/07/2021 02:00:26 - INFO - __main__ - Step 33801: {'lr': 0.0004451739443087381, 'samples': 6489792, 'steps': 33800, 'loss/train': 1.3621511459350586}}}
+11/07/2021 02:00:28 - INFO - __main__ - Step 33805: {'lr': 0.00044516067862768015, 'samples': 6490560, 'steps': 33804, 'loss/train': 1.5042489767074585}}
+11/07/2021 02:00:30 - INFO - __main__ - Step 33809: {'lr': 0.00044514741153964, 'samples': 6491328, 'steps': 33808, 'loss/train': 1.6844371557235718}85}}
+11/07/2021 02:00:32 - INFO - __main__ - Step 33815: {'lr': 0.00044512750826969724, 'samples': 6492480, 'steps': 33814, 'loss/train': 1.7158915996551514}}
+11/07/2021 02:00:34 - INFO - __main__ - Step 33819: {'lr': 0.0004451142376646199, 'samples': 6493248, 'steps': 33818, 'loss/train': 1.484433889389038}4}}
+11/07/2021 02:00:34 - INFO - __main__ - Step 33819: {'lr': 0.0004451142376646199, 'samples': 6493248, 'steps': 33818, 'loss/train': 1.484433889389038}4}}
+11/07/2021 02:00:38 - INFO - __main__ - Step 33826: {'lr': 0.0004450910107210467, 'samples': 6494592, 'steps': 33825, 'loss/train': 1.1198339462280273}}}
+11/07/2021 02:00:40 - INFO - __main__ - Step 33830: {'lr': 0.0004450777362479192, 'samples': 6495360, 'steps': 33829, 'loss/train': 1.4964271783828735}}}
+11/07/2021 02:00:42 - INFO - __main__ - Step 33836: {'lr': 0.0004450578219012873, 'samples': 6496512, 'steps': 33835, 'loss/train': 1.7628679275512695}}}
+11/07/2021 02:00:45 - INFO - __main__ - Step 33840: {'lr': 0.0004450445439123785, 'samples': 6497280, 'steps': 33839, 'loss/train': 1.5153329372406006}}}
+11/07/2021 02:00:47 - INFO - __main__ - Step 33844: {'lr': 0.00044503126451732474, 'samples': 6498048, 'steps': 33843, 'loss/train': 1.7846750020980835}}
+11/07/2021 02:00:47 - INFO - __main__ - Step 33844: {'lr': 0.00044503126451732474, 'samples': 6498048, 'steps': 33843, 'loss/train': 1.7846750020980835}}
+11/07/2021 02:00:50 - INFO - __main__ - Step 33851: {'lr': 0.00044500802219273224, 'samples': 6499392, 'steps': 33850, 'loss/train': 1.3523143529891968}}
+11/07/2021 02:00:53 - INFO - __main__ - Step 33856: {'lr': 0.00044499141789625086, 'samples': 6500352, 'steps': 33855, 'loss/train': 1.5748056173324585}}
+11/07/2021 02:00:53 - INFO - __main__ - Step 33856: {'lr': 0.00044499141789625086, 'samples': 6500352, 'steps': 33855, 'loss/train': 1.5748056173324585}}
+11/07/2021 02:00:56 - INFO - __main__ - Step 33862: {'lr': 0.00044497148984110567, 'samples': 6501504, 'steps': 33861, 'loss/train': 1.399930715560913}}}
+11/07/2021 02:00:59 - INFO - __main__ - Step 33868: {'lr': 0.0004449515586233193, 'samples': 6502656, 'steps': 33867, 'loss/train': 0.7612836956977844}}}
+11/07/2021 02:01:01 - INFO - __main__ - Step 33872: {'lr': 0.0004449382693879318, 'samples': 6503424, 'steps': 33871, 'loss/train': 1.233699083328247}}}}
+11/07/2021 02:01:03 - INFO - __main__ - Step 33876: {'lr': 0.0004449249787471655, 'samples': 6504192, 'steps': 33875, 'loss/train': 1.0890296697616577}}}
+11/07/2021 02:01:05 - INFO - __main__ - Step 33880: {'lr': 0.00044491168670111615, 'samples': 6504960, 'steps': 33879, 'loss/train': 1.1301995515823364}}
+11/07/2021 02:01:06 - INFO - __main__ - Step 33884: {'lr': 0.0004448983932498797, 'samples': 6505728, 'steps': 33883, 'loss/train': 1.7393323183059692}}}
+11/07/2021 02:01:09 - INFO - __main__ - Step 33889: {'lr': 0.00044488177445993563, 'samples': 6506688, 'steps': 33888, 'loss/train': 1.2288641929626465}}
+11/07/2021 02:01:09 - INFO - __main__ - Step 33889: {'lr': 0.00044488177445993563, 'samples': 6506688, 'steps': 33888, 'loss/train': 1.2288641929626465}}
+11/07/2021 02:01:13 - INFO - __main__ - Step 33896: {'lr': 0.0004448585044660055, 'samples': 6508032, 'steps': 33895, 'loss/train': 0.20409615337848663}}
+11/07/2021 02:01:14 - INFO - __main__ - Step 33900: {'lr': 0.0004448452053949789, 'samples': 6508800, 'steps': 33899, 'loss/train': 1.3028892278671265}}}
+11/07/2021 02:01:14 - INFO - __main__ - Step 33900: {'lr': 0.0004448452053949789, 'samples': 6508800, 'steps': 33899, 'loss/train': 1.3028892278671265}}}
+11/07/2021 02:01:18 - INFO - __main__ - Step 33908: {'lr': 0.00044481860303889766, 'samples': 6510336, 'steps': 33907, 'loss/train': 1.1449620723724365}}
+11/07/2021 02:01:18 - INFO - __main__ - Step 33908: {'lr': 0.00044481860303889766, 'samples': 6510336, 'steps': 33907, 'loss/train': 1.1449620723724365}}
+11/07/2021 02:01:22 - INFO - __main__ - Step 33915: {'lr': 0.0004447953213687319, 'samples': 6511680, 'steps': 33914, 'loss/train': 1.4334322214126587}}}
+11/07/2021 02:01:24 - INFO - __main__ - Step 33920: {'lr': 0.0004447786889711449, 'samples': 6512640, 'steps': 33919, 'loss/train': 1.3927388191223145}}}
+11/07/2021 02:01:24 - INFO - __main__ - Step 33920: {'lr': 0.0004447786889711449, 'samples': 6512640, 'steps': 33919, 'loss/train': 1.3927388191223145}}}
+11/07/2021 02:01:28 - INFO - __main__ - Step 33928: {'lr': 0.00044475207257134143, 'samples': 6514176, 'steps': 33927, 'loss/train': 1.7115229368209839}}
+11/07/2021 02:01:30 - INFO - __main__ - Step 33932: {'lr': 0.00044473876226533703, 'samples': 6514944, 'steps': 33931, 'loss/train': 1.2794572114944458}}
+11/07/2021 02:01:32 - INFO - __main__ - Step 33937: {'lr': 0.00044472212240855155, 'samples': 6515904, 'steps': 33936, 'loss/train': 1.6173049211502075}}
+11/07/2021 02:01:34 - INFO - __main__ - Step 33941: {'lr': 0.000444708808943816, 'samples': 6516672, 'steps': 33940, 'loss/train': 1.5928783416748047}5}}
+11/07/2021 02:01:36 - INFO - __main__ - Step 33945: {'lr': 0.00044469549407535593, 'samples': 6517440, 'steps': 33944, 'loss/train': 1.3439016342163086}}
+11/07/2021 02:01:38 - INFO - __main__ - Step 33949: {'lr': 0.00044468217780326724, 'samples': 6518208, 'steps': 33948, 'loss/train': 1.5032635927200317}}
+11/07/2021 02:01:40 - INFO - __main__ - Step 33953: {'lr': 0.00044466886012764603, 'samples': 6518976, 'steps': 33952, 'loss/train': 1.2247635126113892}}
+11/07/2021 02:01:42 - INFO - __main__ - Step 33957: {'lr': 0.00044465554104858817, 'samples': 6519744, 'steps': 33956, 'loss/train': 1.220327377319336}}}
+11/07/2021 02:01:44 - INFO - __main__ - Step 33962: {'lr': 0.00044463889022632963, 'samples': 6520704, 'steps': 33961, 'loss/train': 1.528019666671753}}}
+11/07/2021 02:01:46 - INFO - __main__ - Step 33966: {'lr': 0.0004446255679898907, 'samples': 6521472, 'steps': 33965, 'loss/train': 1.6411830186843872}}}
+11/07/2021 02:01:46 - INFO - __main__ - Step 33966: {'lr': 0.0004446255679898907, 'samples': 6521472, 'steps': 33965, 'loss/train': 1.6411830186843872}}}
+11/07/2021 02:01:50 - INFO - __main__ - Step 33973: {'lr': 0.0004446022506999122, 'samples': 6522816, 'steps': 33972, 'loss/train': 1.216179370880127}}}}
+11/07/2021 02:01:52 - INFO - __main__ - Step 33977: {'lr': 0.00044458892460511225, 'samples': 6523584, 'steps': 33976, 'loss/train': 1.4237685203552246}}
+11/07/2021 02:01:54 - INFO - __main__ - Step 33982: {'lr': 0.0004445722650138512, 'samples': 6524544, 'steps': 33981, 'loss/train': 1.6285544633865356}}}
+11/07/2021 02:01:54 - INFO - __main__ - Step 33982: {'lr': 0.0004445722650138512, 'samples': 6524544, 'steps': 33981, 'loss/train': 1.6285544633865356}}}
+11/07/2021 02:01:58 - INFO - __main__ - Step 33990: {'lr': 0.0004445456051090062, 'samples': 6526080, 'steps': 33989, 'loss/train': 1.3475840091705322}}}
+11/07/2021 02:02:00 - INFO - __main__ - Step 33994: {'lr': 0.0004445322730527137, 'samples': 6526848, 'steps': 33993, 'loss/train': 1.6258047819137573}}}
+11/07/2021 02:02:02 - INFO - __main__ - Step 33998: {'lr': 0.0004445189395939694, 'samples': 6527616, 'steps': 33997, 'loss/train': 1.4667303562164307}}}
+11/07/2021 02:02:05 - INFO - __main__ - Step 34003: {'lr': 0.0004445022707984874, 'samples': 6528576, 'steps': 34002, 'loss/train': 0.221288800239563}}}}
+11/07/2021 02:02:05 - INFO - __main__ - Step 34003: {'lr': 0.0004445022707984874, 'samples': 6528576, 'steps': 34002, 'loss/train': 0.221288800239563}}}}
+11/07/2021 02:02:08 - INFO - __main__ - Step 34010: {'lr': 0.0004444789308039865, 'samples': 6529920, 'steps': 34009, 'loss/train': 2.2077717781066895}}}
+11/07/2021 02:02:10 - INFO - __main__ - Step 34014: {'lr': 0.0004444655917363961, 'samples': 6530688, 'steps': 34013, 'loss/train': 1.3438079357147217}}}
+11/07/2021 02:02:13 - INFO - __main__ - Step 34019: {'lr': 0.0004444489159303976, 'samples': 6531648, 'steps': 34018, 'loss/train': 1.5133620500564575}}}
+11/07/2021 02:02:15 - INFO - __main__ - Step 34023: {'lr': 0.00044443557370850743, 'samples': 6532416, 'steps': 34022, 'loss/train': 1.3057926893234253}}
+11/07/2021 02:02:17 - INFO - __main__ - Step 34027: {'lr': 0.0004444222300848626, 'samples': 6533184, 'steps': 34026, 'loss/train': 1.056647777557373}3}}
+11/07/2021 02:02:19 - INFO - __main__ - Step 34031: {'lr': 0.00044440888505955926, 'samples': 6533952, 'steps': 34030, 'loss/train': 2.1320152282714844}}
+11/07/2021 02:02:20 - INFO - __main__ - Step 34035: {'lr': 0.00044439553863269356, 'samples': 6534720, 'steps': 34034, 'loss/train': 1.7785248756408691}}
+11/07/2021 02:02:22 - INFO - __main__ - Step 34039: {'lr': 0.00044438219080436184, 'samples': 6535488, 'steps': 34038, 'loss/train': 1.7232627868652344}}
+11/07/2021 02:02:25 - INFO - __main__ - Step 34044: {'lr': 0.00044436550404828207, 'samples': 6536448, 'steps': 34043, 'loss/train': 1.2998487949371338}}
+11/07/2021 02:02:27 - INFO - __main__ - Step 34048: {'lr': 0.0004443521530670035, 'samples': 6537216, 'steps': 34047, 'loss/train': 1.7646113634109497}}}
+11/07/2021 02:02:29 - INFO - __main__ - Step 34052: {'lr': 0.00044433880068457166, 'samples': 6537984, 'steps': 34051, 'loss/train': 1.6336530447006226}}
+11/07/2021 02:02:30 - INFO - __main__ - Step 34056: {'lr': 0.0004443254469010828, 'samples': 6538752, 'steps': 34055, 'loss/train': 1.014756441116333}6}}
+11/07/2021 02:02:32 - INFO - __main__ - Step 34060: {'lr': 0.00044431209171663313, 'samples': 6539520, 'steps': 34059, 'loss/train': 0.7567717432975769}}
+11/07/2021 02:02:35 - INFO - __main__ - Step 34065: {'lr': 0.00044429539576611664, 'samples': 6540480, 'steps': 34064, 'loss/train': 1.0325992107391357}}
+11/07/2021 02:02:35 - INFO - __main__ - Step 34065: {'lr': 0.00044429539576611664, 'samples': 6540480, 'steps': 34064, 'loss/train': 1.0325992107391357}}
+11/07/2021 02:02:38 - INFO - __main__ - Step 34072: {'lr': 0.00044427201775848246, 'samples': 6541824, 'steps': 34071, 'loss/train': 1.4158926010131836}}
+11/07/2021 02:02:40 - INFO - __main__ - Step 34077: {'lr': 0.00044425531655549157, 'samples': 6542784, 'steps': 34076, 'loss/train': 0.8294751048088074}}
+11/07/2021 02:02:43 - INFO - __main__ - Step 34081: {'lr': 0.0004442419540175778, 'samples': 6543552, 'steps': 34080, 'loss/train': 1.5299001932144165}}}
+11/07/2021 02:02:43 - INFO - __main__ - Step 34081: {'lr': 0.0004442419540175778, 'samples': 6543552, 'steps': 34080, 'loss/train': 1.5299001932144165}}}
+11/07/2021 02:02:46 - INFO - __main__ - Step 34088: {'lr': 0.0004442185662066731, 'samples': 6544896, 'steps': 34087, 'loss/train': 1.6649442911148071}}}
+11/07/2021 02:02:48 - INFO - __main__ - Step 34092: {'lr': 0.00044420519981800446, 'samples': 6545664, 'steps': 34091, 'loss/train': 1.9090162515640259}}
+11/07/2021 02:02:48 - INFO - __main__ - Step 34092: {'lr': 0.00044420519981800446, 'samples': 6545664, 'steps': 34091, 'loss/train': 1.9090162515640259}}
+11/07/2021 02:02:52 - INFO - __main__ - Step 34100: {'lr': 0.0004441784628404817, 'samples': 6547200, 'steps': 34099, 'loss/train': 1.303661823272705}9}}
+11/07/2021 02:02:55 - INFO - __main__ - Step 34104: {'lr': 0.00044416509225182044, 'samples': 6547968, 'steps': 34103, 'loss/train': 1.9034819602966309}}
+11/07/2021 02:02:56 - INFO - __main__ - Step 34108: {'lr': 0.0004441517202633546, 'samples': 6548736, 'steps': 34107, 'loss/train': 1.857909083366394}9}}
+11/07/2021 02:02:56 - INFO - __main__ - Step 34108: {'lr': 0.0004441517202633546, 'samples': 6548736, 'steps': 34107, 'loss/train': 1.857909083366394}9}}
+11/07/2021 02:02:56 - INFO - __main__ - Step 34108: {'lr': 0.0004441517202633546, 'samples': 6548736, 'steps': 34107, 'loss/train': 1.857909083366394}9}}
+11/07/2021 02:03:02 - INFO - __main__ - Step 34118: {'lr': 0.00044411828416867684, 'samples': 6550656, 'steps': 34117, 'loss/train': 1.4765671491622925}}
+11/07/2021 02:03:05 - INFO - __main__ - Step 34124: {'lr': 0.0004440982183133721, 'samples': 6551808, 'steps': 34123, 'loss/train': 1.508685827255249}5}}
+11/07/2021 02:03:07 - INFO - __main__ - Step 34128: {'lr': 0.00044408483932732886, 'samples': 6552576, 'steps': 34127, 'loss/train': 1.5073697566986084}}
+11/07/2021 02:03:07 - INFO - __main__ - Step 34128: {'lr': 0.00044408483932732886, 'samples': 6552576, 'steps': 34127, 'loss/train': 1.5073697566986084}}
+11/07/2021 02:03:10 - INFO - __main__ - Step 34135: {'lr': 0.00044406142273492334, 'samples': 6553920, 'steps': 34134, 'loss/train': 1.5329359769821167}}
+11/07/2021 02:03:13 - INFO - __main__ - Step 34140: {'lr': 0.00044404469397422823, 'samples': 6554880, 'steps': 34139, 'loss/train': 0.6725926399230957}}
+11/07/2021 02:03:15 - INFO - __main__ - Step 34144: {'lr': 0.0004440313093918593, 'samples': 6555648, 'steps': 34143, 'loss/train': 1.4875729084014893}}}
+11/07/2021 02:03:15 - INFO - __main__ - Step 34144: {'lr': 0.0004440313093918593, 'samples': 6555648, 'steps': 34143, 'loss/train': 1.4875729084014893}}}
+11/07/2021 02:03:18 - INFO - __main__ - Step 34151: {'lr': 0.0004440078830068125, 'samples': 6556992, 'steps': 34150, 'loss/train': 1.9597066640853882}}}
+11/07/2021 02:03:21 - INFO - __main__ - Step 34156: {'lr': 0.0004439911472520972, 'samples': 6557952, 'steps': 34155, 'loss/train': 1.247413992881775}}}}
+11/07/2021 02:03:21 - INFO - __main__ - Step 34156: {'lr': 0.0004439911472520972, 'samples': 6557952, 'steps': 34155, 'loss/train': 1.247413992881775}}}}
+11/07/2021 02:03:25 - INFO - __main__ - Step 34164: {'lr': 0.00044396436549934155, 'samples': 6559488, 'steps': 34163, 'loss/train': 1.2462340593338013}}
+11/07/2021 02:03:26 - INFO - __main__ - Step 34168: {'lr': 0.00044395097252537905, 'samples': 6560256, 'steps': 34167, 'loss/train': 1.355995535850525}}}
+11/07/2021 02:03:28 - INFO - __main__ - Step 34172: {'lr': 0.0004439375781531555, 'samples': 6561024, 'steps': 34171, 'loss/train': 1.5006424188613892}}}
+11/07/2021 02:03:31 - INFO - __main__ - Step 34177: {'lr': 0.0004439208332217186, 'samples': 6561984, 'steps': 34176, 'loss/train': 1.02590012550354}2}}}
+11/07/2021 02:03:33 - INFO - __main__ - Step 34182: {'lr': 0.0004439040861058383, 'samples': 6562944, 'steps': 34181, 'loss/train': 1.599212408065796}}}}
+11/07/2021 02:03:33 - INFO - __main__ - Step 34182: {'lr': 0.0004439040861058383, 'samples': 6562944, 'steps': 34181, 'loss/train': 1.599212408065796}}}}
+11/07/2021 02:03:36 - INFO - __main__ - Step 34189: {'lr': 0.00044388063647410016, 'samples': 6564288, 'steps': 34188, 'loss/train': 1.8877049684524536}}
+11/07/2021 02:03:38 - INFO - __main__ - Step 34193: {'lr': 0.0004438672347625907, 'samples': 6565056, 'steps': 34192, 'loss/train': 1.344968557357788}6}}
+11/07/2021 02:03:41 - INFO - __main__ - Step 34198: {'lr': 0.0004438504806577594, 'samples': 6566016, 'steps': 34197, 'loss/train': 1.6417779922485352}}}
+11/07/2021 02:03:43 - INFO - __main__ - Step 34203: {'lr': 0.00044383372436927727, 'samples': 6566976, 'steps': 34202, 'loss/train': 1.6074336767196655}}
+11/07/2021 02:03:43 - INFO - __main__ - Step 34203: {'lr': 0.00044383372436927727, 'samples': 6566976, 'steps': 34202, 'loss/train': 1.6074336767196655}}
+11/07/2021 02:03:47 - INFO - __main__ - Step 34210: {'lr': 0.00044381026189722824, 'samples': 6568320, 'steps': 34209, 'loss/train': 1.6742136478424072}}
+11/07/2021 02:03:49 - INFO - __main__ - Step 34214: {'lr': 0.00044379685284909575, 'samples': 6569088, 'steps': 34213, 'loss/train': 1.9888619184494019}}
+11/07/2021 02:03:51 - INFO - __main__ - Step 34218: {'lr': 0.0004437834424038133, 'samples': 6569856, 'steps': 34217, 'loss/train': 0.8595290780067444}}}
+11/07/2021 02:03:53 - INFO - __main__ - Step 34222: {'lr': 0.00044377003056147757, 'samples': 6570624, 'steps': 34221, 'loss/train': 1.8908228874206543}}
+11/07/2021 02:03:55 - INFO - __main__ - Step 34226: {'lr': 0.0004437566173221853, 'samples': 6571392, 'steps': 34225, 'loss/train': 1.329896330833435}3}}
+11/07/2021 02:03:56 - INFO - __main__ - Step 34230: {'lr': 0.0004437432026860332, 'samples': 6572160, 'steps': 34229, 'loss/train': 1.3589770793914795}}}
+11/07/2021 02:03:58 - INFO - __main__ - Step 34234: {'lr': 0.0004437297866531179, 'samples': 6572928, 'steps': 34233, 'loss/train': 1.6355782747268677}}}
+11/07/2021 02:04:00 - INFO - __main__ - Step 34239: {'lr': 0.0004437130146479229, 'samples': 6573888, 'steps': 34238, 'loss/train': 1.646666169166565}}}}
+11/07/2021 02:04:00 - INFO - __main__ - Step 34239: {'lr': 0.0004437130146479229, 'samples': 6573888, 'steps': 34238, 'loss/train': 1.646666169166565}}}}
+11/07/2021 02:04:05 - INFO - __main__ - Step 34247: {'lr': 0.00044368617490091655, 'samples': 6575424, 'steps': 34246, 'loss/train': 1.436553955078125}}}
+11/07/2021 02:04:06 - INFO - __main__ - Step 34251: {'lr': 0.00044367275293283705, 'samples': 6576192, 'steps': 34250, 'loss/train': 1.1485662460327148}}
+11/07/2021 02:04:08 - INFO - __main__ - Step 34255: {'lr': 0.0004436593295685022, 'samples': 6576960, 'steps': 34254, 'loss/train': 1.3940390348434448}}}
+11/07/2021 02:04:11 - INFO - __main__ - Step 34260: {'lr': 0.00044364254839974717, 'samples': 6577920, 'steps': 34259, 'loss/train': 1.560340404510498}}}
+11/07/2021 02:04:13 - INFO - __main__ - Step 34265: {'lr': 0.00044362576504968344, 'samples': 6578880, 'steps': 34264, 'loss/train': 0.7693606019020081}}
+11/07/2021 02:04:13 - INFO - __main__ - Step 34265: {'lr': 0.00044362576504968344, 'samples': 6578880, 'steps': 34264, 'loss/train': 0.7693606019020081}}
+11/07/2021 02:04:17 - INFO - __main__ - Step 34272: {'lr': 0.00044360226469535583, 'samples': 6580224, 'steps': 34271, 'loss/train': 1.5781022310256958}}
+11/07/2021 02:04:18 - INFO - __main__ - Step 34276: {'lr': 0.0004435888340022688, 'samples': 6580992, 'steps': 34275, 'loss/train': 1.8282495737075806}}}
+11/07/2021 02:04:21 - INFO - __main__ - Step 34281: {'lr': 0.0004435720436732882, 'samples': 6581952, 'steps': 34280, 'loss/train': 1.3213019371032715}}}
+11/07/2021 02:04:23 - INFO - __main__ - Step 34285: {'lr': 0.0004435586098401243, 'samples': 6582720, 'steps': 34284, 'loss/train': 1.3020122051239014}}}
+11/07/2021 02:04:25 - INFO - __main__ - Step 34289: {'lr': 0.000443545174611528, 'samples': 6583488, 'steps': 34288, 'loss/train': 1.1464428901672363}}}}
+11/07/2021 02:04:27 - INFO - __main__ - Step 34293: {'lr': 0.00044353173798759616, 'samples': 6584256, 'steps': 34292, 'loss/train': 1.7356139421463013}}
+11/07/2021 02:04:29 - INFO - __main__ - Step 34297: {'lr': 0.00044351829996842575, 'samples': 6585024, 'steps': 34296, 'loss/train': 0.8310204148292542}}
+11/07/2021 02:04:31 - INFO - __main__ - Step 34302: {'lr': 0.000443501500482556, 'samples': 6585984, 'steps': 34301, 'loss/train': 0.19430121779441833}}}
+11/07/2021 02:04:33 - INFO - __main__ - Step 34306: {'lr': 0.0004434880593244528, 'samples': 6586752, 'steps': 34305, 'loss/train': 1.5231199264526367}}}
+11/07/2021 02:04:35 - INFO - __main__ - Step 34310: {'lr': 0.000443474616771426, 'samples': 6587520, 'steps': 34309, 'loss/train': 1.5393397808074951}}}}
+11/07/2021 02:04:37 - INFO - __main__ - Step 34314: {'lr': 0.0004434611728235722, 'samples': 6588288, 'steps': 34313, 'loss/train': 1.2123658657073975}}}
+11/07/2021 02:04:39 - INFO - __main__ - Step 34318: {'lr': 0.00044344772748098867, 'samples': 6589056, 'steps': 34317, 'loss/train': 1.4679759740829468}}
+11/07/2021 02:04:39 - INFO - __main__ - Step 34318: {'lr': 0.00044344772748098867, 'samples': 6589056, 'steps': 34317, 'loss/train': 1.4679759740829468}}
+11/07/2021 02:04:39 - INFO - __main__ - Step 34318: {'lr': 0.00044344772748098867, 'samples': 6589056, 'steps': 34317, 'loss/train': 1.4679759740829468}}
+11/07/2021 02:04:45 - INFO - __main__ - Step 34329: {'lr': 0.00044341074559809903, 'samples': 6591168, 'steps': 34328, 'loss/train': 1.5705645084381104}}
+11/07/2021 02:04:47 - INFO - __main__ - Step 34334: {'lr': 0.00044339393216529394, 'samples': 6592128, 'steps': 34333, 'loss/train': 1.4728405475616455}}
+11/07/2021 02:04:49 - INFO - __main__ - Step 34339: {'lr': 0.00044337711655398083, 'samples': 6593088, 'steps': 34338, 'loss/train': 1.6327975988388062}}
+11/07/2021 02:04:51 - INFO - __main__ - Step 34343: {'lr': 0.0004433636624965318, 'samples': 6593856, 'steps': 34342, 'loss/train': 2.237250328063965}2}}
+11/07/2021 02:04:51 - INFO - __main__ - Step 34343: {'lr': 0.0004433636624965318, 'samples': 6593856, 'steps': 34342, 'loss/train': 2.237250328063965}2}}
+11/07/2021 02:04:55 - INFO - __main__ - Step 34350: {'lr': 0.0004433401145416771, 'samples': 6595200, 'steps': 34349, 'loss/train': 1.1282519102096558}}}
+11/07/2021 02:04:57 - INFO - __main__ - Step 34355: {'lr': 0.00044332329196041133, 'samples': 6596160, 'steps': 34354, 'loss/train': 1.3930827379226685}}
+11/07/2021 02:04:57 - INFO - __main__ - Step 34355: {'lr': 0.00044332329196041133, 'samples': 6596160, 'steps': 34354, 'loss/train': 1.3930827379226685}}
+11/07/2021 02:05:01 - INFO - __main__ - Step 34363: {'lr': 0.00044329637130082324, 'samples': 6597696, 'steps': 34362, 'loss/train': 1.4699153900146484}}
+11/07/2021 02:05:03 - INFO - __main__ - Step 34367: {'lr': 0.000443282908880668, 'samples': 6598464, 'steps': 34366, 'loss/train': 1.5377881526947021}4}}
+11/07/2021 02:05:05 - INFO - __main__ - Step 34371: {'lr': 0.000443269445067068, 'samples': 6599232, 'steps': 34370, 'loss/train': 1.4963665008544922}4}}
+11/07/2021 02:05:05 - INFO - __main__ - Step 34371: {'lr': 0.000443269445067068, 'samples': 6599232, 'steps': 34370, 'loss/train': 1.4963665008544922}4}}
+11/07/2021 02:05:09 - INFO - __main__ - Step 34379: {'lr': 0.00044324251325992214, 'samples': 6600768, 'steps': 34378, 'loss/train': 1.768172264099121}}}
+11/07/2021 02:05:11 - INFO - __main__ - Step 34383: {'lr': 0.0004432290452665704, 'samples': 6601536, 'steps': 34382, 'loss/train': 1.7808390855789185}}}
+11/07/2021 02:05:13 - INFO - __main__ - Step 34387: {'lr': 0.00044321557588016214, 'samples': 6602304, 'steps': 34386, 'loss/train': 1.2353405952453613}}
+11/07/2021 02:05:15 - INFO - __main__ - Step 34391: {'lr': 0.0004432021051007946, 'samples': 6603072, 'steps': 34390, 'loss/train': 5.095420837402344}3}}
+11/07/2021 02:05:17 - INFO - __main__ - Step 34396: {'lr': 0.0004431852646678842, 'samples': 6604032, 'steps': 34395, 'loss/train': 1.4153156280517578}}}
+11/07/2021 02:05:17 - INFO - __main__ - Step 34396: {'lr': 0.0004431852646678842, 'samples': 6604032, 'steps': 34395, 'loss/train': 1.4153156280517578}}}
+11/07/2021 02:05:21 - INFO - __main__ - Step 34403: {'lr': 0.00044316168440590757, 'samples': 6605376, 'steps': 34402, 'loss/train': 1.8850730657577515}}
+11/07/2021 02:05:23 - INFO - __main__ - Step 34407: {'lr': 0.000443148208055674, 'samples': 6606144, 'steps': 34406, 'loss/train': 1.199692726135254}15}}
+11/07/2021 02:05:25 - INFO - __main__ - Step 34413: {'lr': 0.0004431279909194661, 'samples': 6607296, 'steps': 34412, 'loss/train': 2.042417526245117}5}}
+11/07/2021 02:05:25 - INFO - __main__ - Step 34413: {'lr': 0.0004431279909194661, 'samples': 6607296, 'steps': 34412, 'loss/train': 2.042417526245117}5}}
+11/07/2021 02:05:25 - INFO - __main__ - Step 34413: {'lr': 0.0004431279909194661, 'samples': 6607296, 'steps': 34412, 'loss/train': 2.042417526245117}5}}
+11/07/2021 02:05:31 - INFO - __main__ - Step 34423: {'lr': 0.0004430942887309755, 'samples': 6609216, 'steps': 34422, 'loss/train': 1.5944414138793945}}}
+11/07/2021 02:05:33 - INFO - __main__ - Step 34428: {'lr': 0.00044307743437393623, 'samples': 6610176, 'steps': 34427, 'loss/train': 0.5758892893791199}}
+11/07/2021 02:05:35 - INFO - __main__ - Step 34432: {'lr': 0.00044306394932233694, 'samples': 6610944, 'steps': 34431, 'loss/train': 1.181859016418457}}}
+11/07/2021 02:05:37 - INFO - __main__ - Step 34436: {'lr': 0.0004430504628788714, 'samples': 6611712, 'steps': 34435, 'loss/train': 1.7379834651947021}}}
+11/07/2021 02:05:39 - INFO - __main__ - Step 34440: {'lr': 0.0004430369750436369, 'samples': 6612480, 'steps': 34439, 'loss/train': 1.3736330270767212}}}
+11/07/2021 02:05:41 - INFO - __main__ - Step 34444: {'lr': 0.0004430234858167308, 'samples': 6613248, 'steps': 34443, 'loss/train': 1.2908469438552856}}}
+11/07/2021 02:05:43 - INFO - __main__ - Step 34449: {'lr': 0.00044300662232620784, 'samples': 6614208, 'steps': 34448, 'loss/train': 1.7782011032104492}}
+11/07/2021 02:05:43 - INFO - __main__ - Step 34449: {'lr': 0.00044300662232620784, 'samples': 6614208, 'steps': 34448, 'loss/train': 1.7782011032104492}}
+11/07/2021 02:05:48 - INFO - __main__ - Step 34457: {'lr': 0.0004429796362192283, 'samples': 6615744, 'steps': 34456, 'loss/train': 1.631561279296875}2}}
+11/07/2021 02:05:49 - INFO - __main__ - Step 34461: {'lr': 0.0004429661410788024, 'samples': 6616512, 'steps': 34460, 'loss/train': 1.6277323961257935}}}
+11/07/2021 02:05:51 - INFO - __main__ - Step 34465: {'lr': 0.00044295264454721544, 'samples': 6617280, 'steps': 34464, 'loss/train': 1.2352428436279297}}
+11/07/2021 02:05:53 - INFO - __main__ - Step 34469: {'lr': 0.00044293914662456475, 'samples': 6618048, 'steps': 34468, 'loss/train': 1.8215768337249756}}
+11/07/2021 02:05:55 - INFO - __main__ - Step 34473: {'lr': 0.0004429256473109476, 'samples': 6618816, 'steps': 34472, 'loss/train': 2.1451096534729004}}}
+11/07/2021 02:05:57 - INFO - __main__ - Step 34477: {'lr': 0.0004429121466064614, 'samples': 6619584, 'steps': 34476, 'loss/train': 1.6861153841018677}}}
+11/07/2021 02:05:59 - INFO - __main__ - Step 34481: {'lr': 0.0004428986445112033, 'samples': 6620352, 'steps': 34480, 'loss/train': 1.5794472694396973}}}
+11/07/2021 02:06:01 - INFO - __main__ - Step 34485: {'lr': 0.0004428851410252709, 'samples': 6621120, 'steps': 34484, 'loss/train': 1.702553629875183}}}}
+11/07/2021 02:06:03 - INFO - __main__ - Step 34490: {'lr': 0.0004428682597123677, 'samples': 6622080, 'steps': 34489, 'loss/train': 1.1206878423690796}}}
+11/07/2021 02:06:05 - INFO - __main__ - Step 34494: {'lr': 0.0004428547530977736, 'samples': 6622848, 'steps': 34493, 'loss/train': 2.4662539958953857}}}
+11/07/2021 02:06:07 - INFO - __main__ - Step 34498: {'lr': 0.0004428412450928216, 'samples': 6623616, 'steps': 34497, 'loss/train': 2.3211231231689453}}}
+11/07/2021 02:06:09 - INFO - __main__ - Step 34502: {'lr': 0.0004428277356976089, 'samples': 6624384, 'steps': 34501, 'loss/train': 1.5118417739868164}}}
+11/07/2021 02:06:11 - INFO - __main__ - Step 34506: {'lr': 0.0004428142249122331, 'samples': 6625152, 'steps': 34505, 'loss/train': 1.3635393381118774}}}
+11/07/2021 02:06:13 - INFO - __main__ - Step 34511: {'lr': 0.00044279733447574456, 'samples': 6626112, 'steps': 34510, 'loss/train': 1.3775317668914795}}
+11/07/2021 02:06:15 - INFO - __main__ - Step 34515: {'lr': 0.0004427838205628575, 'samples': 6626880, 'steps': 34514, 'loss/train': 1.34334397315979}95}}
+11/07/2021 02:06:15 - INFO - __main__ - Step 34515: {'lr': 0.0004427838205628575, 'samples': 6626880, 'steps': 34514, 'loss/train': 1.34334397315979}95}}
+11/07/2021 02:06:19 - INFO - __main__ - Step 34522: {'lr': 0.00044276016787104535, 'samples': 6628224, 'steps': 34521, 'loss/train': 1.5454742908477783}}
+11/07/2021 02:06:21 - INFO - __main__ - Step 34527: {'lr': 0.0004427432704855064, 'samples': 6629184, 'steps': 34526, 'loss/train': 2.385096311569214}3}}
+11/07/2021 02:06:23 - INFO - __main__ - Step 34532: {'lr': 0.0004427263709287889, 'samples': 6630144, 'steps': 34531, 'loss/train': 1.4572937488555908}}}
+11/07/2021 02:06:23 - INFO - __main__ - Step 34532: {'lr': 0.0004427263709287889, 'samples': 6630144, 'steps': 34531, 'loss/train': 1.4572937488555908}}}
+11/07/2021 02:06:27 - INFO - __main__ - Step 34539: {'lr': 0.0004427027079021667, 'samples': 6631488, 'steps': 34538, 'loss/train': 1.4280678033828735}}}
+11/07/2021 02:06:29 - INFO - __main__ - Step 34543: {'lr': 0.0004426891842623998, 'samples': 6632256, 'steps': 34542, 'loss/train': 1.1412307024002075}}}
+11/07/2021 02:06:31 - INFO - __main__ - Step 34548: {'lr': 0.0004426722777591902, 'samples': 6633216, 'steps': 34547, 'loss/train': 1.6598010063171387}}}
+11/07/2021 02:06:34 - INFO - __main__ - Step 34553: {'lr': 0.0004426553690856016, 'samples': 6634176, 'steps': 34552, 'loss/train': 0.9244617223739624}}}
+11/07/2021 02:06:34 - INFO - __main__ - Step 34553: {'lr': 0.0004426553690856016, 'samples': 6634176, 'steps': 34552, 'loss/train': 0.9244617223739624}}}
+11/07/2021 02:06:37 - INFO - __main__ - Step 34560: {'lr': 0.0004426316932967038, 'samples': 6635520, 'steps': 34559, 'loss/train': 1.3592138290405273}}}
+11/07/2021 02:06:39 - INFO - __main__ - Step 34564: {'lr': 0.00044261816236491186, 'samples': 6636288, 'steps': 34563, 'loss/train': 1.6028127670288086}}
+11/07/2021 02:06:42 - INFO - __main__ - Step 34569: {'lr': 0.000442601246747391, 'samples': 6637248, 'steps': 34568, 'loss/train': 0.9717766046524048}6}}
+11/07/2021 02:06:44 - INFO - __main__ - Step 34573: {'lr': 0.0004425877126912685, 'samples': 6638016, 'steps': 34572, 'loss/train': 1.4090310335159302}}}
+11/07/2021 02:06:46 - INFO - __main__ - Step 34577: {'lr': 0.0004425741772467131, 'samples': 6638784, 'steps': 34576, 'loss/train': 1.5985610485076904}}}
+11/07/2021 02:06:46 - INFO - __main__ - Step 34577: {'lr': 0.0004425741772467131, 'samples': 6638784, 'steps': 34576, 'loss/train': 1.5985610485076904}}}
+11/07/2021 02:06:49 - INFO - __main__ - Step 34584: {'lr': 0.0004425504868781183, 'samples': 6640128, 'steps': 34583, 'loss/train': 1.4580005407333374}}}
+11/07/2021 02:06:52 - INFO - __main__ - Step 34589: {'lr': 0.000442533562583426, 'samples': 6641088, 'steps': 34588, 'loss/train': 1.6986876726150513}}}}
+11/07/2021 02:06:54 - INFO - __main__ - Step 34593: {'lr': 0.0004425200215861153, 'samples': 6641856, 'steps': 34592, 'loss/train': 1.6354613304138184}}}
+11/07/2021 02:06:56 - INFO - __main__ - Step 34597: {'lr': 0.0004425064792008597, 'samples': 6642624, 'steps': 34596, 'loss/train': 2.3666765689849854}}}
+11/07/2021 02:06:57 - INFO - __main__ - Step 34601: {'lr': 0.000442492935427757, 'samples': 6643392, 'steps': 34600, 'loss/train': 1.5505502223968506}}}}
+11/07/2021 02:06:59 - INFO - __main__ - Step 34605: {'lr': 0.00044247939026690475, 'samples': 6644160, 'steps': 34604, 'loss/train': 1.9255297183990479}}
+11/07/2021 02:07:02 - INFO - __main__ - Step 34610: {'lr': 0.0004424624568644654, 'samples': 6645120, 'steps': 34609, 'loss/train': 1.5061067342758179}}}
+11/07/2021 02:07:02 - INFO - __main__ - Step 34610: {'lr': 0.0004424624568644654, 'samples': 6645120, 'steps': 34609, 'loss/train': 1.5061067342758179}}}
+11/07/2021 02:07:06 - INFO - __main__ - Step 34617: {'lr': 0.00044243874645882733, 'samples': 6646464, 'steps': 34616, 'loss/train': 1.3017340898513794}}
+11/07/2021 02:07:07 - INFO - __main__ - Step 34621: {'lr': 0.00044242519574795347, 'samples': 6647232, 'steps': 34620, 'loss/train': 1.5387800931930542}}
+11/07/2021 02:07:09 - INFO - __main__ - Step 34625: {'lr': 0.0004424116436498185, 'samples': 6648000, 'steps': 34624, 'loss/train': 1.0495797395706177}}}
+11/07/2021 02:07:11 - INFO - __main__ - Step 34629: {'lr': 0.00044239809016452, 'samples': 6648768, 'steps': 34628, 'loss/train': 1.4800750017166138}7}}}
+11/07/2021 02:07:13 - INFO - __main__ - Step 34633: {'lr': 0.00044238453529215575, 'samples': 6649536, 'steps': 34632, 'loss/train': 1.3253827095031738}}
+11/07/2021 02:07:15 - INFO - __main__ - Step 34637: {'lr': 0.0004423709790328235, 'samples': 6650304, 'steps': 34636, 'loss/train': 1.3128234148025513}}}
+11/07/2021 02:07:17 - INFO - __main__ - Step 34641: {'lr': 0.00044235742138662085, 'samples': 6651072, 'steps': 34640, 'loss/train': 1.697799563407898}}}
+11/07/2021 02:07:19 - INFO - __main__ - Step 34646: {'lr': 0.0004423404723787301, 'samples': 6652032, 'steps': 34645, 'loss/train': 0.7880754470825195}}}
+11/07/2021 02:07:22 - INFO - __main__ - Step 34651: {'lr': 0.0004423235212041982, 'samples': 6652992, 'steps': 34650, 'loss/train': 1.5523748397827148}}}
+11/07/2021 02:07:22 - INFO - __main__ - Step 34651: {'lr': 0.0004423235212041982, 'samples': 6652992, 'steps': 34650, 'loss/train': 1.5523748397827148}}}
+11/07/2021 02:07:25 - INFO - __main__ - Step 34658: {'lr': 0.00044229978592025975, 'samples': 6654336, 'steps': 34657, 'loss/train': 1.4368984699249268}}
+11/07/2021 02:07:27 - INFO - __main__ - Step 34662: {'lr': 0.00044228622099459183, 'samples': 6655104, 'steps': 34661, 'loss/train': 1.4233191013336182}}
+11/07/2021 02:07:30 - INFO - __main__ - Step 34667: {'lr': 0.0004422692628880913, 'samples': 6656064, 'steps': 34666, 'loss/train': 1.0020115375518799}}}
+11/07/2021 02:07:32 - INFO - __main__ - Step 34672: {'lr': 0.00044225230261575165, 'samples': 6657024, 'steps': 34671, 'loss/train': 1.550666332244873}}}
+11/07/2021 02:07:34 - INFO - __main__ - Step 34676: {'lr': 0.0004422387328386042, 'samples': 6657792, 'steps': 34675, 'loss/train': 1.2925069332122803}}}
+11/07/2021 02:07:34 - INFO - __main__ - Step 34676: {'lr': 0.0004422387328386042, 'samples': 6657792, 'steps': 34675, 'loss/train': 1.2925069332122803}}}
+11/07/2021 02:07:37 - INFO - __main__ - Step 34682: {'lr': 0.00044221837557431945, 'samples': 6658944, 'steps': 34681, 'loss/train': 1.5414425134658813}}
+11/07/2021 02:07:40 - INFO - __main__ - Step 34688: {'lr': 0.0004421980151920518, 'samples': 6660096, 'steps': 34687, 'loss/train': 1.3367774486541748}}}
+11/07/2021 02:07:42 - INFO - __main__ - Step 34692: {'lr': 0.00044218443987182384, 'samples': 6660864, 'steps': 34691, 'loss/train': 1.4428645372390747}}
+11/07/2021 02:07:42 - INFO - __main__ - Step 34692: {'lr': 0.00044218443987182384, 'samples': 6660864, 'steps': 34691, 'loss/train': 1.4428645372390747}}
+11/07/2021 02:07:45 - INFO - __main__ - Step 34699: {'lr': 0.000442160679727563, 'samples': 6662208, 'steps': 34698, 'loss/train': 0.9124966859817505}7}}
+11/07/2021 02:07:48 - INFO - __main__ - Step 34704: {'lr': 0.0004421437055983785, 'samples': 6663168, 'steps': 34703, 'loss/train': 1.1789891719818115}}}
+11/07/2021 02:07:50 - INFO - __main__ - Step 34709: {'lr': 0.0004421267293047692, 'samples': 6664128, 'steps': 34708, 'loss/train': 1.248964786529541}}}}
+11/07/2021 02:07:50 - INFO - __main__ - Step 34709: {'lr': 0.0004421267293047692, 'samples': 6664128, 'steps': 34708, 'loss/train': 1.248964786529541}}}}
+11/07/2021 02:07:53 - INFO - __main__ - Step 34716: {'lr': 0.0004421029588578468, 'samples': 6665472, 'steps': 34715, 'loss/train': 1.2604187726974487}}}
+11/07/2021 02:07:56 - INFO - __main__ - Step 34720: {'lr': 0.00044208937384099614, 'samples': 6666240, 'steps': 34719, 'loss/train': 1.3792513608932495}}
+11/07/2021 02:07:58 - INFO - __main__ - Step 34725: {'lr': 0.00044207239062251297, 'samples': 6667200, 'steps': 34724, 'loss/train': 1.4305295944213867}}
+11/07/2021 02:08:00 - INFO - __main__ - Step 34729: {'lr': 0.0004420588024899098, 'samples': 6667968, 'steps': 34728, 'loss/train': 1.555402159690857}7}}
+11/07/2021 02:08:02 - INFO - __main__ - Step 34733: {'lr': 0.000442045212972687, 'samples': 6668736, 'steps': 34732, 'loss/train': 1.4219645261764526}7}}
+11/07/2021 02:08:03 - INFO - __main__ - Step 34737: {'lr': 0.0004420316220709424, 'samples': 6669504, 'steps': 34736, 'loss/train': 1.3695883750915527}}}
+11/07/2021 02:08:06 - INFO - __main__ - Step 34741: {'lr': 0.000442018029784774, 'samples': 6670272, 'steps': 34740, 'loss/train': 1.6417057514190674}}}}
+11/07/2021 02:08:08 - INFO - __main__ - Step 34746: {'lr': 0.000442001037480367, 'samples': 6671232, 'steps': 34745, 'loss/train': 1.3379449844360352}}}}
+11/07/2021 02:08:08 - INFO - __main__ - Step 34746: {'lr': 0.000442001037480367, 'samples': 6671232, 'steps': 34745, 'loss/train': 1.3379449844360352}}}}
+11/07/2021 02:08:12 - INFO - __main__ - Step 34754: {'lr': 0.0004419738452947346, 'samples': 6672768, 'steps': 34753, 'loss/train': 1.601043462753296}}}}
+11/07/2021 02:08:14 - INFO - __main__ - Step 34758: {'lr': 0.00044196024712585854, 'samples': 6673536, 'steps': 34757, 'loss/train': 1.2186495065689087}}
+11/07/2021 02:08:16 - INFO - __main__ - Step 34762: {'lr': 0.0004419466475730732, 'samples': 6674304, 'steps': 34761, 'loss/train': 2.0209977626800537}}}
+11/07/2021 02:08:18 - INFO - __main__ - Step 34766: {'lr': 0.00044193304663647684, 'samples': 6675072, 'steps': 34765, 'loss/train': 0.5651389360427856}}
+11/07/2021 02:08:20 - INFO - __main__ - Step 34771: {'lr': 0.0004419160435198963, 'samples': 6676032, 'steps': 34770, 'loss/train': 1.1811498403549194}}}
+11/07/2021 02:08:20 - INFO - __main__ - Step 34771: {'lr': 0.0004419160435198963, 'samples': 6676032, 'steps': 34770, 'loss/train': 1.1811498403549194}}}
+11/07/2021 02:08:24 - INFO - __main__ - Step 34779: {'lr': 0.00044188883403677783, 'samples': 6677568, 'steps': 34778, 'loss/train': 1.1535234451293945}}
+11/07/2021 02:08:26 - INFO - __main__ - Step 34783: {'lr': 0.000441875227220078, 'samples': 6678336, 'steps': 34782, 'loss/train': 1.3227585554122925}5}}
+11/07/2021 02:08:28 - INFO - __main__ - Step 34787: {'lr': 0.00044186161902008193, 'samples': 6679104, 'steps': 34786, 'loss/train': 0.9370352625846863}}
+11/07/2021 02:08:28 - INFO - __main__ - Step 34787: {'lr': 0.00044186161902008193, 'samples': 6679104, 'steps': 34786, 'loss/train': 0.9370352625846863}}
+11/07/2021 02:08:32 - INFO - __main__ - Step 34795: {'lr': 0.0004418343984705935, 'samples': 6680640, 'steps': 34794, 'loss/train': 1.2904330492019653}}}
+11/07/2021 02:08:34 - INFO - __main__ - Step 34799: {'lr': 0.0004418207861212973, 'samples': 6681408, 'steps': 34798, 'loss/train': 1.2074306011199951}}}
+11/07/2021 02:08:36 - INFO - __main__ - Step 34803: {'lr': 0.0004418071723890973, 'samples': 6682176, 'steps': 34802, 'loss/train': 1.9970906972885132}}}
+11/07/2021 02:08:38 - INFO - __main__ - Step 34808: {'lr': 0.00044179015327928847, 'samples': 6683136, 'steps': 34807, 'loss/train': 1.496474266052246}}}
+11/07/2021 02:08:38 - INFO - __main__ - Step 34808: {'lr': 0.00044179015327928847, 'samples': 6683136, 'steps': 34807, 'loss/train': 1.496474266052246}}}
+11/07/2021 02:08:42 - INFO - __main__ - Step 34815: {'lr': 0.0004417663228960562, 'samples': 6684480, 'steps': 34814, 'loss/train': 1.3058736324310303}}}
+11/07/2021 02:08:43 - INFO - __main__ - Step 34819: {'lr': 0.0004417527036332227, 'samples': 6685248, 'steps': 34818, 'loss/train': 1.158371090888977}}}}
+11/07/2021 02:08:45 - INFO - __main__ - Step 34823: {'lr': 0.00044173908298797627, 'samples': 6686016, 'steps': 34822, 'loss/train': 1.4924274682998657}}
+11/07/2021 02:08:48 - INFO - __main__ - Step 34828: {'lr': 0.0004417220552375496, 'samples': 6686976, 'steps': 34827, 'loss/train': 1.4486048221588135}}}
+11/07/2021 02:08:50 - INFO - __main__ - Step 34832: {'lr': 0.00044170843148223305, 'samples': 6687744, 'steps': 34831, 'loss/train': 1.9806476831436157}}
+11/07/2021 02:08:52 - INFO - __main__ - Step 34836: {'lr': 0.00044169480634482274, 'samples': 6688512, 'steps': 34835, 'loss/train': 1.677834391593933}}}
+11/07/2021 02:08:54 - INFO - __main__ - Step 34840: {'lr': 0.0004416811798254168, 'samples': 6689280, 'steps': 34839, 'loss/train': 1.6745431423187256}}}
+11/07/2021 02:08:56 - INFO - __main__ - Step 34844: {'lr': 0.00044166755192411364, 'samples': 6690048, 'steps': 34843, 'loss/train': 2.0981333255767822}}
+11/07/2021 02:08:58 - INFO - __main__ - Step 34849: {'lr': 0.0004416505151043412, 'samples': 6691008, 'steps': 34848, 'loss/train': 1.796020269393921}2}}
+11/07/2021 02:09:00 - INFO - __main__ - Step 34853: {'lr': 0.00044163688409412833, 'samples': 6691776, 'steps': 34852, 'loss/train': 1.48081636428833}2}}
+11/07/2021 02:09:00 - INFO - __main__ - Step 34853: {'lr': 0.00044163688409412833, 'samples': 6691776, 'steps': 34852, 'loss/train': 1.48081636428833}2}}
+11/07/2021 02:09:04 - INFO - __main__ - Step 34860: {'lr': 0.00044161302650189295, 'samples': 6693120, 'steps': 34859, 'loss/train': 1.5468337535858154}}
+11/07/2021 02:09:06 - INFO - __main__ - Step 34865: {'lr': 0.000441595982774415, 'samples': 6694080, 'steps': 34864, 'loss/train': 1.3882853984832764}4}}
+11/07/2021 02:09:08 - INFO - __main__ - Step 34870: {'lr': 0.00044157893688868223, 'samples': 6695040, 'steps': 34869, 'loss/train': 1.635990023612976}}}
+11/07/2021 02:09:08 - INFO - __main__ - Step 34870: {'lr': 0.00044157893688868223, 'samples': 6695040, 'steps': 34869, 'loss/train': 1.635990023612976}}}
+11/07/2021 02:09:12 - INFO - __main__ - Step 34877: {'lr': 0.0004415550690231539, 'samples': 6696384, 'steps': 34876, 'loss/train': 1.5939267873764038}}}
+11/07/2021 02:09:14 - INFO - __main__ - Step 34881: {'lr': 0.00044154142834395947, 'samples': 6697152, 'steps': 34880, 'loss/train': 1.8461229801177979}}
+11/07/2021 02:09:16 - INFO - __main__ - Step 34886: {'lr': 0.00044152437555310174, 'samples': 6698112, 'steps': 34885, 'loss/train': 1.097977638244629}}}
+11/07/2021 02:09:19 - INFO - __main__ - Step 34891: {'lr': 0.0004415073206047958, 'samples': 6699072, 'steps': 34890, 'loss/train': 1.6461631059646606}}}
+11/07/2021 02:09:19 - INFO - __main__ - Step 34891: {'lr': 0.0004415073206047958, 'samples': 6699072, 'steps': 34890, 'loss/train': 1.6461631059646606}}}
+11/07/2021 02:09:22 - INFO - __main__ - Step 34898: {'lr': 0.0004414834400530203, 'samples': 6700416, 'steps': 34897, 'loss/train': 1.4663927555084229}}}
+11/07/2021 02:09:24 - INFO - __main__ - Step 34902: {'lr': 0.00044146979212525184, 'samples': 6701184, 'steps': 34901, 'loss/train': 1.720201015472412}}}
+11/07/2021 02:09:26 - INFO - __main__ - Step 34906: {'lr': 0.00044145614281711, 'samples': 6701952, 'steps': 34905, 'loss/train': 1.3921641111373901}2}}}
+11/07/2021 02:09:28 - INFO - __main__ - Step 34911: {'lr': 0.0004414390792409326, 'samples': 6702912, 'steps': 34910, 'loss/train': 1.1971884965896606}}}
+11/07/2021 02:09:30 - INFO - __main__ - Step 34915: {'lr': 0.0004414254268273107, 'samples': 6703680, 'steps': 34914, 'loss/train': 1.2348486185073853}}}
+11/07/2021 02:09:32 - INFO - __main__ - Step 34919: {'lr': 0.0004414117730336351, 'samples': 6704448, 'steps': 34918, 'loss/train': 1.4219346046447754}}}
+11/07/2021 02:09:34 - INFO - __main__ - Step 34923: {'lr': 0.0004413981178600046, 'samples': 6705216, 'steps': 34922, 'loss/train': 1.5527942180633545}}}
+11/07/2021 02:09:36 - INFO - __main__ - Step 34928: {'lr': 0.00044138104695255455, 'samples': 6706176, 'steps': 34927, 'loss/train': 1.990412712097168}}}
+11/07/2021 02:09:36 - INFO - __main__ - Step 34928: {'lr': 0.00044138104695255455, 'samples': 6706176, 'steps': 34927, 'loss/train': 1.990412712097168}}}
+11/07/2021 02:09:41 - INFO - __main__ - Step 34936: {'lr': 0.00044135372901658046, 'samples': 6707712, 'steps': 34935, 'loss/train': 1.6198914051055908}}
+11/07/2021 02:09:43 - INFO - __main__ - Step 34940: {'lr': 0.0004413400679792393, 'samples': 6708480, 'steps': 34939, 'loss/train': 1.1660223007202148}}}
+11/07/2021 02:09:44 - INFO - __main__ - Step 34944: {'lr': 0.00044132640556246, 'samples': 6709248, 'steps': 34943, 'loss/train': 1.5002176761627197}8}}}
+11/07/2021 02:09:46 - INFO - __main__ - Step 34948: {'lr': 0.00044131274176634113, 'samples': 6710016, 'steps': 34947, 'loss/train': 1.4638006687164307}}
+11/07/2021 02:09:49 - INFO - __main__ - Step 34953: {'lr': 0.0004412956600816462, 'samples': 6710976, 'steps': 34952, 'loss/train': 1.6466397047042847}}}
+11/07/2021 02:09:51 - INFO - __main__ - Step 34957: {'lr': 0.0004412819931823734, 'samples': 6711744, 'steps': 34956, 'loss/train': 1.5563851594924927}}}
+11/07/2021 02:09:51 - INFO - __main__ - Step 34957: {'lr': 0.0004412819931823734, 'samples': 6711744, 'steps': 34956, 'loss/train': 1.5563851594924927}}}
+11/07/2021 02:09:54 - INFO - __main__ - Step 34964: {'lr': 0.0004412580727904396, 'samples': 6713088, 'steps': 34963, 'loss/train': 1.7027897834777832}}}
+11/07/2021 02:09:56 - INFO - __main__ - Step 34968: {'lr': 0.0004412444020991004, 'samples': 6713856, 'steps': 34967, 'loss/train': 1.6180024147033691}}}
+11/07/2021 02:09:58 - INFO - __main__ - Step 34972: {'lr': 0.00044123073002901286, 'samples': 6714624, 'steps': 34971, 'loss/train': 0.8073616027832031}}
+11/07/2021 02:10:00 - INFO - __main__ - Step 34976: {'lr': 0.00044121705658027545, 'samples': 6715392, 'steps': 34975, 'loss/train': 1.497333288192749}}}
+11/07/2021 02:10:02 - INFO - __main__ - Step 34980: {'lr': 0.0004412033817529867, 'samples': 6716160, 'steps': 34979, 'loss/train': 1.5079094171524048}}}
+11/07/2021 02:10:04 - INFO - __main__ - Step 34985: {'lr': 0.0004411862862804382, 'samples': 6717120, 'steps': 34984, 'loss/train': 1.4085384607315063}}}
+11/07/2021 02:10:04 - INFO - __main__ - Step 34985: {'lr': 0.0004411862862804382, 'samples': 6717120, 'steps': 34984, 'loss/train': 1.4085384607315063}}}
+11/07/2021 02:10:08 - INFO - __main__ - Step 34993: {'lr': 0.0004411589290448701, 'samples': 6718656, 'steps': 34992, 'loss/train': 1.3170068264007568}}}
+11/07/2021 02:10:10 - INFO - __main__ - Step 34997: {'lr': 0.00044114524835983844, 'samples': 6719424, 'steps': 34996, 'loss/train': 1.6504180431365967}}
+11/07/2021 02:10:12 - INFO - __main__ - Step 35001: {'lr': 0.00044113156629677313, 'samples': 6720192, 'steps': 35000, 'loss/train': 1.2026489973068237}}
+11/07/2021 02:10:14 - INFO - __main__ - Step 35006: {'lr': 0.00044111446178023205, 'samples': 6721152, 'steps': 35005, 'loss/train': 1.3469408750534058}}
+11/07/2021 02:10:16 - INFO - __main__ - Step 35010: {'lr': 0.00044110077661695194, 'samples': 6721920, 'steps': 35009, 'loss/train': 1.402260661125183}}}
+11/07/2021 02:10:18 - INFO - __main__ - Step 35014: {'lr': 0.0004410870900759587, 'samples': 6722688, 'steps': 35013, 'loss/train': 1.4623432159423828}}}
+11/07/2021 02:10:20 - INFO - __main__ - Step 35018: {'lr': 0.00044107340215735125, 'samples': 6723456, 'steps': 35017, 'loss/train': 1.3238352537155151}}
+11/07/2021 02:10:22 - INFO - __main__ - Step 35022: {'lr': 0.00044105971286122816, 'samples': 6724224, 'steps': 35021, 'loss/train': 1.7440218925476074}}
+11/07/2021 02:10:24 - INFO - __main__ - Step 35027: {'lr': 0.0004410425993040933, 'samples': 6725184, 'steps': 35026, 'loss/train': 1.0795031785964966}}}
+11/07/2021 02:10:27 - INFO - __main__ - Step 35032: {'lr': 0.0004410254835949372, 'samples': 6726144, 'steps': 35031, 'loss/train': 2.850522041320801}}}}
+11/07/2021 02:10:27 - INFO - __main__ - Step 35032: {'lr': 0.0004410254835949372, 'samples': 6726144, 'steps': 35031, 'loss/train': 2.850522041320801}}}}
+11/07/2021 02:10:30 - INFO - __main__ - Step 35039: {'lr': 0.0004410015179870903, 'samples': 6727488, 'steps': 35038, 'loss/train': 1.1722732782363892}}}
+11/07/2021 02:10:32 - INFO - __main__ - Step 35043: {'lr': 0.00044098782146062955, 'samples': 6728256, 'steps': 35042, 'loss/train': 1.5331951379776}2}}}
+11/07/2021 02:10:34 - INFO - __main__ - Step 35047: {'lr': 0.0004409741235572701, 'samples': 6729024, 'steps': 35046, 'loss/train': 1.4944453239440918}}}
+11/07/2021 02:10:36 - INFO - __main__ - Step 35052: {'lr': 0.0004409569992419576, 'samples': 6729984, 'steps': 35051, 'loss/train': 1.4920984506607056}}}
+11/07/2021 02:10:39 - INFO - __main__ - Step 35057: {'lr': 0.0004409398727755882, 'samples': 6730944, 'steps': 35056, 'loss/train': 1.7569228410720825}}}
+11/07/2021 02:10:41 - INFO - __main__ - Step 35061: {'lr': 0.00044092617005386125, 'samples': 6731712, 'steps': 35060, 'loss/train': 1.2886829376220703}}
+11/07/2021 02:10:41 - INFO - __main__ - Step 35061: {'lr': 0.00044092617005386125, 'samples': 6731712, 'steps': 35060, 'loss/train': 1.2886829376220703}}
+11/07/2021 02:10:44 - INFO - __main__ - Step 35068: {'lr': 0.00044090218697880577, 'samples': 6733056, 'steps': 35067, 'loss/train': 1.7040773630142212}}
+11/07/2021 02:10:47 - INFO - __main__ - Step 35073: {'lr': 0.0004408850536303507, 'samples': 6734016, 'steps': 35072, 'loss/train': 1.6482864618301392}}}
+11/07/2021 02:10:47 - INFO - __main__ - Step 35073: {'lr': 0.0004408850536303507, 'samples': 6734016, 'steps': 35072, 'loss/train': 1.6482864618301392}}}
+11/07/2021 02:10:50 - INFO - __main__ - Step 35080: {'lr': 0.0004408610633301428, 'samples': 6735360, 'steps': 35079, 'loss/train': 1.6156529188156128}}}
+11/07/2021 02:10:52 - INFO - __main__ - Step 35084: {'lr': 0.00044084735269515375, 'samples': 6736128, 'steps': 35083, 'loss/train': 1.6152665615081787}}
+11/07/2021 02:10:55 - INFO - __main__ - Step 35089: {'lr': 0.0004408302124665894, 'samples': 6737088, 'steps': 35088, 'loss/train': 1.307666540145874}7}}
+11/07/2021 02:10:57 - INFO - __main__ - Step 35094: {'lr': 0.0004408130700883964, 'samples': 6738048, 'steps': 35093, 'loss/train': 1.5962964296340942}}}
+11/07/2021 02:10:57 - INFO - __main__ - Step 35094: {'lr': 0.0004408130700883964, 'samples': 6738048, 'steps': 35093, 'loss/train': 1.5962964296340942}}}
+11/07/2021 02:11:00 - INFO - __main__ - Step 35101: {'lr': 0.00044078906714791757, 'samples': 6739392, 'steps': 35100, 'loss/train': 1.0961785316467285}}
+11/07/2021 02:11:02 - INFO - __main__ - Step 35105: {'lr': 0.00044077534929063024, 'samples': 6740160, 'steps': 35104, 'loss/train': 0.9975321292877197}}
+11/07/2021 02:11:05 - INFO - __main__ - Step 35110: {'lr': 0.00044075820003492295, 'samples': 6741120, 'steps': 35109, 'loss/train': 1.5062674283981323}}
+11/07/2021 02:11:08 - INFO - __main__ - Step 35115: {'lr': 0.0004407410486303983, 'samples': 6742080, 'steps': 35114, 'loss/train': 1.7748589515686035}}}
+11/07/2021 02:11:11 - INFO - __main__ - Step 35121: {'lr': 0.00044072046410880143, 'samples': 6743232, 'steps': 35120, 'loss/train': 1.271795392036438}}}
+11/07/2021 02:11:11 - INFO - __main__ - Step 35121: {'lr': 0.00044072046410880143, 'samples': 6743232, 'steps': 35120, 'loss/train': 1.271795392036438}}}
+11/07/2021 02:11:14 - INFO - __main__ - Step 35128: {'lr': 0.0004406964449235544, 'samples': 6744576, 'steps': 35127, 'loss/train': 1.5889697074890137}}}
+11/07/2021 02:11:14 - INFO - __main__ - Step 35128: {'lr': 0.0004406964449235544, 'samples': 6744576, 'steps': 35127, 'loss/train': 1.5889697074890137}}}
+11/07/2021 02:11:17 - INFO - __main__ - Step 35133: {'lr': 0.00044067928578488645, 'samples': 6745536, 'steps': 35132, 'loss/train': 1.795264720916748}}}
+11/07/2021 02:11:20 - INFO - __main__ - Step 35139: {'lr': 0.00044065869198323614, 'samples': 6746688, 'steps': 35138, 'loss/train': 1.7210921049118042}}
+11/07/2021 02:11:22 - INFO - __main__ - Step 35144: {'lr': 0.0004406415281193805, 'samples': 6747648, 'steps': 35143, 'loss/train': 2.018486738204956}2}}
+11/07/2021 02:11:25 - INFO - __main__ - Step 35149: {'lr': 0.0004406243621080216, 'samples': 6748608, 'steps': 35148, 'loss/train': 1.8648744821548462}}}
+11/07/2021 02:11:27 - INFO - __main__ - Step 35153: {'lr': 0.000440610627752862, 'samples': 6749376, 'steps': 35152, 'loss/train': 1.7012907266616821}}}}
+11/07/2021 02:11:27 - INFO - __main__ - Step 35153: {'lr': 0.000440610627752862, 'samples': 6749376, 'steps': 35152, 'loss/train': 1.7012907266616821}}}}
+11/07/2021 02:11:30 - INFO - __main__ - Step 35160: {'lr': 0.00044058658932477336, 'samples': 6750720, 'steps': 35159, 'loss/train': 2.0084025859832764}}
+11/07/2021 02:11:32 - INFO - __main__ - Step 35164: {'lr': 0.00044057285119085887, 'samples': 6751488, 'steps': 35163, 'loss/train': 1.3808073997497559}}
+11/07/2021 02:11:35 - INFO - __main__ - Step 35169: {'lr': 0.00044055567659142083, 'samples': 6752448, 'steps': 35168, 'loss/train': 0.897270679473877}}}
+11/07/2021 02:11:35 - INFO - __main__ - Step 35169: {'lr': 0.00044055567659142083, 'samples': 6752448, 'steps': 35168, 'loss/train': 0.897270679473877}}}
+11/07/2021 02:11:39 - INFO - __main__ - Step 35177: {'lr': 0.0004405281927676051, 'samples': 6753984, 'steps': 35176, 'loss/train': 1.600562572479248}}}}
+11/07/2021 02:11:40 - INFO - __main__ - Step 35181: {'lr': 0.00044051444879527013, 'samples': 6754752, 'steps': 35180, 'loss/train': 1.525868535041809}}}
+11/07/2021 02:11:42 - INFO - __main__ - Step 35185: {'lr': 0.0004405007034494494, 'samples': 6755520, 'steps': 35184, 'loss/train': 1.5869981050491333}}}
+11/07/2021 02:11:45 - INFO - __main__ - Step 35190: {'lr': 0.00044048351983585966, 'samples': 6756480, 'steps': 35189, 'loss/train': 1.7315864562988281}}
+11/07/2021 02:11:47 - INFO - __main__ - Step 35194: {'lr': 0.00044046977140005774, 'samples': 6757248, 'steps': 35193, 'loss/train': 1.190617561340332}}}
+11/07/2021 02:11:49 - INFO - __main__ - Step 35198: {'lr': 0.00044045602159109207, 'samples': 6758016, 'steps': 35197, 'loss/train': 1.4819884300231934}}
+11/07/2021 02:11:49 - INFO - __main__ - Step 35198: {'lr': 0.00044045602159109207, 'samples': 6758016, 'steps': 35197, 'loss/train': 1.4819884300231934}}
+11/07/2021 02:11:52 - INFO - __main__ - Step 35205: {'lr': 0.00044043195612152475, 'samples': 6759360, 'steps': 35204, 'loss/train': 1.4423195123672485}}
+11/07/2021 02:11:55 - INFO - __main__ - Step 35211: {'lr': 0.00044041132522973885, 'samples': 6760512, 'steps': 35210, 'loss/train': 1.3795652389526367}}
+11/07/2021 02:11:57 - INFO - __main__ - Step 35215: {'lr': 0.00044039756958593287, 'samples': 6761280, 'steps': 35214, 'loss/train': 1.8432458639144897}}
+11/07/2021 02:11:59 - INFO - __main__ - Step 35219: {'lr': 0.00044038381256948357, 'samples': 6762048, 'steps': 35218, 'loss/train': 1.3994035720825195}}
+11/07/2021 02:11:59 - INFO - __main__ - Step 35219: {'lr': 0.00044038381256948357, 'samples': 6762048, 'steps': 35218, 'loss/train': 1.3994035720825195}}
+11/07/2021 02:12:02 - INFO - __main__ - Step 35226: {'lr': 0.00044035973448807266, 'samples': 6763392, 'steps': 35225, 'loss/train': 1.6354080438613892}}
+11/07/2021 02:12:05 - INFO - __main__ - Step 35231: {'lr': 0.00044034253328526765, 'samples': 6764352, 'steps': 35230, 'loss/train': 1.5945069789886475}}
+11/07/2021 02:12:07 - INFO - __main__ - Step 35236: {'lr': 0.0004403253299383274, 'samples': 6765312, 'steps': 35235, 'loss/train': 1.3000872135162354}}}
+11/07/2021 02:12:07 - INFO - __main__ - Step 35236: {'lr': 0.0004403253299383274, 'samples': 6765312, 'steps': 35235, 'loss/train': 1.3000872135162354}}}
+11/07/2021 02:12:10 - INFO - __main__ - Step 35243: {'lr': 0.0004403012416508329, 'samples': 6766656, 'steps': 35242, 'loss/train': 1.65208899974823}4}}}
+11/07/2021 02:12:12 - INFO - __main__ - Step 35247: {'lr': 0.00044028747502865794, 'samples': 6767424, 'steps': 35246, 'loss/train': 1.4407219886779785}}
+11/07/2021 02:12:12 - INFO - __main__ - Step 35247: {'lr': 0.00044028747502865794, 'samples': 6767424, 'steps': 35246, 'loss/train': 1.4407219886779785}}
+11/07/2021 02:12:17 - INFO - __main__ - Step 35255: {'lr': 0.00044025993766885866, 'samples': 6768960, 'steps': 35254, 'loss/train': 1.382339358329773}}}
+11/07/2021 02:12:18 - INFO - __main__ - Step 35259: {'lr': 0.0004402461669314327, 'samples': 6769728, 'steps': 35258, 'loss/train': 1.6906169652938843}}}
+11/07/2021 02:12:18 - INFO - __main__ - Step 35259: {'lr': 0.0004402461669314327, 'samples': 6769728, 'steps': 35258, 'loss/train': 1.6906169652938843}}}
+11/07/2021 02:12:22 - INFO - __main__ - Step 35265: {'lr': 0.00044022550825366526, 'samples': 6770880, 'steps': 35264, 'loss/train': 1.8454724550247192}}
+11/07/2021 02:12:25 - INFO - __main__ - Step 35270: {'lr': 0.00044020829033174615, 'samples': 6771840, 'steps': 35269, 'loss/train': 1.5778212547302246}}
+11/07/2021 02:12:27 - INFO - __main__ - Step 35274: {'lr': 0.00044019451445151305, 'samples': 6772608, 'steps': 35273, 'loss/train': 1.4892654418945312}}
+11/07/2021 02:12:29 - INFO - __main__ - Step 35278: {'lr': 0.0004401807372001004, 'samples': 6773376, 'steps': 35277, 'loss/train': 1.63253915309906}12}}
+11/07/2021 02:12:30 - INFO - __main__ - Step 35282: {'lr': 0.0004401669585776078, 'samples': 6774144, 'steps': 35281, 'loss/train': 1.5396783351898193}}}
+11/07/2021 02:12:32 - INFO - __main__ - Step 35286: {'lr': 0.0004401531785841344, 'samples': 6774912, 'steps': 35285, 'loss/train': 1.7355401515960693}}}
+11/07/2021 02:12:35 - INFO - __main__ - Step 35291: {'lr': 0.0004401359516645023, 'samples': 6775872, 'steps': 35290, 'loss/train': 1.8301565647125244}}}
+11/07/2021 02:12:35 - INFO - __main__ - Step 35291: {'lr': 0.0004401359516645023, 'samples': 6775872, 'steps': 35290, 'loss/train': 1.8301565647125244}}}
+11/07/2021 02:12:39 - INFO - __main__ - Step 35299: {'lr': 0.00044010838413821075, 'samples': 6777408, 'steps': 35298, 'loss/train': 1.658327341079712}}}
+11/07/2021 02:12:40 - INFO - __main__ - Step 35303: {'lr': 0.00044009459831917755, 'samples': 6778176, 'steps': 35302, 'loss/train': 1.5483982563018799}}
+11/07/2021 02:12:43 - INFO - __main__ - Step 35307: {'lr': 0.00044008081112968537, 'samples': 6778944, 'steps': 35306, 'loss/train': 1.7320812940597534}}
+11/07/2021 02:12:45 - INFO - __main__ - Step 35312: {'lr': 0.00044006357521576334, 'samples': 6779904, 'steps': 35311, 'loss/train': 0.9323607087135315}}
+11/07/2021 02:12:45 - INFO - __main__ - Step 35312: {'lr': 0.00044006357521576334, 'samples': 6779904, 'steps': 35311, 'loss/train': 0.9323607087135315}}
+11/07/2021 02:12:49 - INFO - __main__ - Step 35320: {'lr': 0.00044003599330030385, 'samples': 6781440, 'steps': 35319, 'loss/train': 1.5260698795318604}}
+11/07/2021 02:12:51 - INFO - __main__ - Step 35324: {'lr': 0.0004400222002874695, 'samples': 6782208, 'steps': 35323, 'loss/train': 1.541028380393982}4}}
+11/07/2021 02:12:53 - INFO - __main__ - Step 35328: {'lr': 0.000440008405904698, 'samples': 6782976, 'steps': 35327, 'loss/train': 1.5916683673858643}4}}
+11/07/2021 02:12:55 - INFO - __main__ - Step 35332: {'lr': 0.0004399946101520889, 'samples': 6783744, 'steps': 35331, 'loss/train': 1.4010270833969116}}}
+11/07/2021 02:12:57 - INFO - __main__ - Step 35336: {'lr': 0.0004399808130297415, 'samples': 6784512, 'steps': 35335, 'loss/train': 1.3630006313323975}}}
+11/07/2021 02:12:59 - INFO - __main__ - Step 35340: {'lr': 0.00043996701453775526, 'samples': 6785280, 'steps': 35339, 'loss/train': 1.4155287742614746}}
+11/07/2021 02:13:01 - INFO - __main__ - Step 35344: {'lr': 0.00043995321467622984, 'samples': 6786048, 'steps': 35343, 'loss/train': 1.4926680326461792}}
+11/07/2021 02:13:03 - INFO - __main__ - Step 35348: {'lr': 0.00043993941344526455, 'samples': 6786816, 'steps': 35347, 'loss/train': 1.232430100440979}}}
+11/07/2021 02:13:03 - INFO - __main__ - Step 35348: {'lr': 0.00043993941344526455, 'samples': 6786816, 'steps': 35347, 'loss/train': 1.232430100440979}}}
+11/07/2021 02:13:07 - INFO - __main__ - Step 35356: {'lr': 0.0004399118068754127, 'samples': 6788352, 'steps': 35355, 'loss/train': 1.4081023931503296}}}
+11/07/2021 02:13:09 - INFO - __main__ - Step 35360: {'lr': 0.0004398980015367251, 'samples': 6789120, 'steps': 35359, 'loss/train': 5.794185638427734}}}}
+11/07/2021 02:13:11 - INFO - __main__ - Step 35364: {'lr': 0.0004398841948289958, 'samples': 6789888, 'steps': 35363, 'loss/train': 0.6771053075790405}}}
+11/07/2021 02:13:13 - INFO - __main__ - Step 35369: {'lr': 0.00043986693451927074, 'samples': 6790848, 'steps': 35368, 'loss/train': 0.9575570225715637}}
+11/07/2021 02:13:13 - INFO - __main__ - Step 35369: {'lr': 0.00043986693451927074, 'samples': 6790848, 'steps': 35368, 'loss/train': 0.9575570225715637}}
+11/07/2021 02:13:17 - INFO - __main__ - Step 35377: {'lr': 0.0004398393135751338, 'samples': 6792384, 'steps': 35376, 'loss/train': 0.8111445903778076}}}
+11/07/2021 02:13:19 - INFO - __main__ - Step 35381: {'lr': 0.0004398255010500877, 'samples': 6793152, 'steps': 35380, 'loss/train': 1.5714269876480103}}}
+11/07/2021 02:13:21 - INFO - __main__ - Step 35385: {'lr': 0.0004398116871565224, 'samples': 6793920, 'steps': 35384, 'loss/train': 1.3924572467803955}}}
+11/07/2021 02:13:21 - INFO - __main__ - Step 35385: {'lr': 0.0004398116871565224, 'samples': 6793920, 'steps': 35384, 'loss/train': 1.3924572467803955}}}
+11/07/2021 02:13:21 - INFO - __main__ - Step 35385: {'lr': 0.0004398116871565224, 'samples': 6793920, 'steps': 35384, 'loss/train': 1.3924572467803955}}}
+11/07/2021 02:13:27 - INFO - __main__ - Step 35396: {'lr': 0.0004397736918936046, 'samples': 6796032, 'steps': 35395, 'loss/train': 1.4847302436828613}}}
+11/07/2021 02:13:29 - INFO - __main__ - Step 35401: {'lr': 0.0004397564178990626, 'samples': 6796992, 'steps': 35400, 'loss/train': 1.856229305267334}}}}
+11/07/2021 02:13:32 - INFO - __main__ - Step 35406: {'lr': 0.0004397391417669878, 'samples': 6797952, 'steps': 35405, 'loss/train': 1.601456880569458}}}}
+11/07/2021 02:13:34 - INFO - __main__ - Step 35410: {'lr': 0.00043972531932243516, 'samples': 6798720, 'steps': 35409, 'loss/train': 1.706610918045044}}}
+11/07/2021 02:13:34 - INFO - __main__ - Step 35410: {'lr': 0.00043972531932243516, 'samples': 6798720, 'steps': 35409, 'loss/train': 1.706610918045044}}}
+11/07/2021 02:13:37 - INFO - __main__ - Step 35417: {'lr': 0.0004397011267532668, 'samples': 6800064, 'steps': 35416, 'loss/train': 1.8843176364898682}}}
+11/07/2021 02:13:39 - INFO - __main__ - Step 35422: {'lr': 0.00043968384378239477, 'samples': 6801024, 'steps': 35421, 'loss/train': 1.3193522691726685}}
+11/07/2021 02:13:42 - INFO - __main__ - Step 35427: {'lr': 0.0004396665586748075, 'samples': 6801984, 'steps': 35426, 'loss/train': 1.7397141456604004}}}
+11/07/2021 02:13:44 - INFO - __main__ - Step 35431: {'lr': 0.0004396527290504334, 'samples': 6802752, 'steps': 35430, 'loss/train': 3.315039873123169}}}}
+11/07/2021 02:13:46 - INFO - __main__ - Step 35435: {'lr': 0.0004396388980587859, 'samples': 6803520, 'steps': 35434, 'loss/train': 1.7204598188400269}}}
+11/07/2021 02:13:47 - INFO - __main__ - Step 35439: {'lr': 0.0004396250656999646, 'samples': 6804288, 'steps': 35438, 'loss/train': 1.060101866722107}}}}
+11/07/2021 02:13:49 - INFO - __main__ - Step 35443: {'lr': 0.0004396112319740692, 'samples': 6805056, 'steps': 35442, 'loss/train': 1.7257599830627441}}}
+11/07/2021 02:13:49 - INFO - __main__ - Step 35443: {'lr': 0.0004396112319740692, 'samples': 6805056, 'steps': 35442, 'loss/train': 1.7257599830627441}}}
+11/07/2021 02:13:52 - INFO - __main__ - Step 35450: {'lr': 0.00043958701966453033, 'samples': 6806400, 'steps': 35449, 'loss/train': 1.6128551959991455}}
+11/07/2021 02:13:54 - INFO - __main__ - Step 35454: {'lr': 0.0004395731821796956, 'samples': 6807168, 'steps': 35453, 'loss/train': 1.5661472082138062}}}
+11/07/2021 02:13:57 - INFO - __main__ - Step 35459: {'lr': 0.00043955588340174195, 'samples': 6808128, 'steps': 35458, 'loss/train': 2.366567373275757}}}
+11/07/2021 02:14:00 - INFO - __main__ - Step 35465: {'lr': 0.0004395351220496532, 'samples': 6809280, 'steps': 35464, 'loss/train': 1.655928611755371}}}}
+11/07/2021 02:14:00 - INFO - __main__ - Step 35465: {'lr': 0.0004395351220496532, 'samples': 6809280, 'steps': 35464, 'loss/train': 1.655928611755371}}}}
+11/07/2021 02:14:03 - INFO - __main__ - Step 35471: {'lr': 0.00043951435762310686, 'samples': 6810432, 'steps': 35470, 'loss/train': 1.4175527095794678}}
+11/07/2021 02:14:05 - INFO - __main__ - Step 35475: {'lr': 0.00043950051296421023, 'samples': 6811200, 'steps': 35474, 'loss/train': 1.6213352680206299}}
+11/07/2021 02:14:07 - INFO - __main__ - Step 35480: {'lr': 0.00043948320521941596, 'samples': 6812160, 'steps': 35479, 'loss/train': 1.7159295082092285}}
+11/07/2021 02:14:07 - INFO - __main__ - Step 35480: {'lr': 0.00043948320521941596, 'samples': 6812160, 'steps': 35479, 'loss/train': 1.7159295082092285}}
+11/07/2021 02:14:12 - INFO - __main__ - Step 35488: {'lr': 0.00043945550838815953, 'samples': 6813696, 'steps': 35487, 'loss/train': 1.4050376415252686}}
+11/07/2021 02:14:13 - INFO - __main__ - Step 35492: {'lr': 0.00043944165792370385, 'samples': 6814464, 'steps': 35491, 'loss/train': 1.8067296743392944}}
+11/07/2021 02:14:15 - INFO - __main__ - Step 35496: {'lr': 0.00043942780609349636, 'samples': 6815232, 'steps': 35495, 'loss/train': 1.5365619659423828}}
+11/07/2021 02:14:18 - INFO - __main__ - Step 35501: {'lr': 0.0004394104893853007, 'samples': 6816192, 'steps': 35500, 'loss/train': 0.7865248918533325}}}
+11/07/2021 02:14:20 - INFO - __main__ - Step 35505: {'lr': 0.0004393966344825168, 'samples': 6816960, 'steps': 35504, 'loss/train': 2.8831872940063477}}}
+11/07/2021 02:14:20 - INFO - __main__ - Step 35505: {'lr': 0.0004393966344825168, 'samples': 6816960, 'steps': 35504, 'loss/train': 2.8831872940063477}}}
+11/07/2021 02:14:23 - INFO - __main__ - Step 35512: {'lr': 0.0004393723851171459, 'samples': 6818304, 'steps': 35511, 'loss/train': 2.5056517124176025}}}
+11/07/2021 02:14:25 - INFO - __main__ - Step 35517: {'lr': 0.00043935506158200143, 'samples': 6819264, 'steps': 35516, 'loss/train': 1.2624260187149048}}
+11/07/2021 02:14:28 - INFO - __main__ - Step 35522: {'lr': 0.0004393377359138454, 'samples': 6820224, 'steps': 35521, 'loss/train': 1.1675945520401}048}}
+11/07/2021 02:14:28 - INFO - __main__ - Step 35522: {'lr': 0.0004393377359138454, 'samples': 6820224, 'steps': 35521, 'loss/train': 1.1675945520401}048}}
+11/07/2021 02:14:31 - INFO - __main__ - Step 35529: {'lr': 0.0004393134763953387, 'samples': 6821568, 'steps': 35528, 'loss/train': 1.5105087757110596}}}
+11/07/2021 02:14:33 - INFO - __main__ - Step 35533: {'lr': 0.00043929961193666246, 'samples': 6822336, 'steps': 35532, 'loss/train': 1.3283123970031738}}
+11/07/2021 02:14:35 - INFO - __main__ - Step 35537: {'lr': 0.00043928574611325845, 'samples': 6823104, 'steps': 35536, 'loss/train': 2.5706093311309814}}
+11/07/2021 02:14:35 - INFO - __main__ - Step 35537: {'lr': 0.00043928574611325845, 'samples': 6823104, 'steps': 35536, 'loss/train': 2.5706093311309814}}
+11/07/2021 02:14:39 - INFO - __main__ - Step 35546: {'lr': 0.0004392545430213315, 'samples': 6824832, 'steps': 35545, 'loss/train': 1.476622462272644}4}}
+11/07/2021 02:14:39 - INFO - __main__ - Step 35546: {'lr': 0.0004392545430213315, 'samples': 6824832, 'steps': 35545, 'loss/train': 1.476622462272644}4}}
+11/07/2021 02:14:43 - INFO - __main__ - Step 35554: {'lr': 0.0004392268011408712, 'samples': 6826368, 'steps': 35553, 'loss/train': 1.6246516704559326}}}
+11/07/2021 02:14:45 - INFO - __main__ - Step 35558: {'lr': 0.0004392129281542868, 'samples': 6827136, 'steps': 35557, 'loss/train': 1.6843079328536987}}}
+11/07/2021 02:14:48 - INFO - __main__ - Step 35563: {'lr': 0.00043919558500279845, 'samples': 6828096, 'steps': 35562, 'loss/train': 1.2379157543182373}}
+11/07/2021 02:14:48 - INFO - __main__ - Step 35563: {'lr': 0.00043919558500279845, 'samples': 6828096, 'steps': 35562, 'loss/train': 1.2379157543182373}}
+11/07/2021 02:14:52 - INFO - __main__ - Step 35571: {'lr': 0.0004391678315275706, 'samples': 6829632, 'steps': 35570, 'loss/train': 1.577763557434082}3}}
+11/07/2021 02:14:53 - INFO - __main__ - Step 35575: {'lr': 0.0004391539527442401, 'samples': 6830400, 'steps': 35574, 'loss/train': 1.359189510345459}3}}
+11/07/2021 02:14:56 - INFO - __main__ - Step 35579: {'lr': 0.00043914007259723196, 'samples': 6831168, 'steps': 35578, 'loss/train': 0.13724112510681152}
+11/07/2021 02:14:58 - INFO - __main__ - Step 35583: {'lr': 0.0004391261910866463, 'samples': 6831936, 'steps': 35582, 'loss/train': 1.4237700700759888}2}
+11/07/2021 02:15:00 - INFO - __main__ - Step 35587: {'lr': 0.00043911230821258313, 'samples': 6832704, 'steps': 35586, 'loss/train': 1.623017430305481}2}
+11/07/2021 02:15:00 - INFO - __main__ - Step 35587: {'lr': 0.00043911230821258313, 'samples': 6832704, 'steps': 35586, 'loss/train': 1.623017430305481}2}
+11/07/2021 02:15:03 - INFO - __main__ - Step 35594: {'lr': 0.0004390880099024059, 'samples': 6834048, 'steps': 35593, 'loss/train': 0.9020565748214722}2}
+11/07/2021 02:15:06 - INFO - __main__ - Step 35599: {'lr': 0.00043907065141052953, 'samples': 6835008, 'steps': 35598, 'loss/train': 0.11254219710826874}
+11/07/2021 02:15:06 - INFO - __main__ - Step 35599: {'lr': 0.00043907065141052953, 'samples': 6835008, 'steps': 35598, 'loss/train': 0.11254219710826874}
+11/07/2021 02:15:10 - INFO - __main__ - Step 35607: {'lr': 0.0004390428733936082, 'samples': 6836544, 'steps': 35606, 'loss/train': 0.6637961268424988}4}
+11/07/2021 02:15:11 - INFO - __main__ - Step 35611: {'lr': 0.00043902898234078223, 'samples': 6837312, 'steps': 35610, 'loss/train': 1.6454213857650757}}
+11/07/2021 02:15:14 - INFO - __main__ - Step 35615: {'lr': 0.00043901508992517956, 'samples': 6838080, 'steps': 35614, 'loss/train': 0.969472348690033}}}
+11/07/2021 02:15:14 - INFO - __main__ - Step 35615: {'lr': 0.00043901508992517956, 'samples': 6838080, 'steps': 35614, 'loss/train': 0.969472348690033}}}
+11/07/2021 02:15:18 - INFO - __main__ - Step 35623: {'lr': 0.0004389873010060449, 'samples': 6839616, 'steps': 35622, 'loss/train': 0.8303018808364868}}}
+11/07/2021 02:15:19 - INFO - __main__ - Step 35627: {'lr': 0.00043897340450271317, 'samples': 6840384, 'steps': 35626, 'loss/train': 1.2990198135375977}}
+11/07/2021 02:15:21 - INFO - __main__ - Step 35631: {'lr': 0.00043895950663700546, 'samples': 6841152, 'steps': 35630, 'loss/train': 1.5904690027236938}}
+11/07/2021 02:15:24 - INFO - __main__ - Step 35636: {'lr': 0.0004389421323891822, 'samples': 6842112, 'steps': 35635, 'loss/train': 1.6761291027069092}}}
+11/07/2021 02:15:26 - INFO - __main__ - Step 35641: {'lr': 0.0004389247560129987, 'samples': 6843072, 'steps': 35640, 'loss/train': 1.627358078956604}}}}
+11/07/2021 02:15:26 - INFO - __main__ - Step 35641: {'lr': 0.0004389247560129987, 'samples': 6843072, 'steps': 35640, 'loss/train': 1.627358078956604}}}}
+11/07/2021 02:15:29 - INFO - __main__ - Step 35648: {'lr': 0.0004389004255110693, 'samples': 6844416, 'steps': 35647, 'loss/train': 1.8229610919952393}}}
+11/07/2021 02:15:31 - INFO - __main__ - Step 35652: {'lr': 0.00043888652049453163, 'samples': 6845184, 'steps': 35651, 'loss/train': 1.656050443649292}}}
+11/07/2021 02:15:33 - INFO - __main__ - Step 35656: {'lr': 0.00043887261411624433, 'samples': 6845952, 'steps': 35655, 'loss/train': 1.5127336978912354}}
+11/07/2021 02:15:36 - INFO - __main__ - Step 35660: {'lr': 0.00043885870637630763, 'samples': 6846720, 'steps': 35659, 'loss/train': 1.3242474794387817}}
+11/07/2021 02:15:37 - INFO - __main__ - Step 35664: {'lr': 0.00043884479727482193, 'samples': 6847488, 'steps': 35663, 'loss/train': 1.5567348003387451}}
+11/07/2021 02:15:39 - INFO - __main__ - Step 35668: {'lr': 0.0004388308868118873, 'samples': 6848256, 'steps': 35667, 'loss/train': 0.6823694109916687}}}
+11/07/2021 02:15:42 - INFO - __main__ - Step 35673: {'lr': 0.0004388134968188344, 'samples': 6849216, 'steps': 35672, 'loss/train': 1.7342904806137085}}}
+11/07/2021 02:15:44 - INFO - __main__ - Step 35677: {'lr': 0.0004387995832930067, 'samples': 6849984, 'steps': 35676, 'loss/train': 1.7262928485870361}}}
+11/07/2021 02:15:46 - INFO - __main__ - Step 35681: {'lr': 0.00043878566840605606, 'samples': 6850752, 'steps': 35680, 'loss/train': 0.8708986639976501}}
+11/07/2021 02:15:46 - INFO - __main__ - Step 35681: {'lr': 0.00043878566840605606, 'samples': 6850752, 'steps': 35680, 'loss/train': 0.8708986639976501}}
+11/07/2021 02:15:49 - INFO - __main__ - Step 35688: {'lr': 0.00043876131407899233, 'samples': 6852096, 'steps': 35687, 'loss/train': 0.9426607489585876}}
+11/07/2021 02:15:52 - INFO - __main__ - Step 35694: {'lr': 0.0004387404356244243, 'samples': 6853248, 'steps': 35693, 'loss/train': 1.674772024154663}6}}
+11/07/2021 02:15:54 - INFO - __main__ - Step 35698: {'lr': 0.00043872651495382076, 'samples': 6854016, 'steps': 35697, 'loss/train': 1.7205495834350586}}
+11/07/2021 02:15:54 - INFO - __main__ - Step 35698: {'lr': 0.00043872651495382076, 'samples': 6854016, 'steps': 35697, 'loss/train': 1.7205495834350586}}
+11/07/2021 02:15:57 - INFO - __main__ - Step 35705: {'lr': 0.00043870215050639073, 'samples': 6855360, 'steps': 35704, 'loss/train': 5.773858070373535}}}
+11/07/2021 02:15:59 - INFO - __main__ - Step 35710: {'lr': 0.00043868474477883523, 'samples': 6856320, 'steps': 35709, 'loss/train': 1.6956952810287476}}
+11/07/2021 02:15:59 - INFO - __main__ - Step 35710: {'lr': 0.00043868474477883523, 'samples': 6856320, 'steps': 35709, 'loss/train': 1.6956952810287476}}
+11/07/2021 02:16:04 - INFO - __main__ - Step 35717: {'lr': 0.00043866037318952735, 'samples': 6857664, 'steps': 35716, 'loss/train': 2.144253730773926}}}
+11/07/2021 02:16:05 - INFO - __main__ - Step 35721: {'lr': 0.00043864644469686717, 'samples': 6858432, 'steps': 35720, 'loss/train': 0.9276940226554871}}
+11/07/2021 02:16:08 - INFO - __main__ - Step 35725: {'lr': 0.0004386325148441882, 'samples': 6859200, 'steps': 35724, 'loss/train': 1.640588402748108}1}}
+11/07/2021 02:16:10 - INFO - __main__ - Step 35730: {'lr': 0.0004386151006159659, 'samples': 6860160, 'steps': 35729, 'loss/train': 1.2281548976898193}}}
+11/07/2021 02:16:12 - INFO - __main__ - Step 35734: {'lr': 0.0004386011677036118, 'samples': 6860928, 'steps': 35733, 'loss/train': 1.756344199180603}}}}
+11/07/2021 02:16:13 - INFO - __main__ - Step 35738: {'lr': 0.00043858723343156514, 'samples': 6861696, 'steps': 35737, 'loss/train': 1.6566646099090576}}
+11/07/2021 02:16:16 - INFO - __main__ - Step 35742: {'lr': 0.0004385732977999266, 'samples': 6862464, 'steps': 35741, 'loss/train': 1.0279544591903687}}}
+11/07/2021 02:16:18 - INFO - __main__ - Step 35747: {'lr': 0.0004385558763486053, 'samples': 6863424, 'steps': 35746, 'loss/train': 1.5872620344161987}}}
+11/07/2021 02:16:18 - INFO - __main__ - Step 35747: {'lr': 0.0004385558763486053, 'samples': 6863424, 'steps': 35746, 'loss/train': 1.5872620344161987}}}
+11/07/2021 02:16:21 - INFO - __main__ - Step 35754: {'lr': 0.000438531482748464, 'samples': 6864768, 'steps': 35753, 'loss/train': 1.4319709539413452}}}}
+11/07/2021 02:16:23 - INFO - __main__ - Step 35758: {'lr': 0.00043851754167946244, 'samples': 6865536, 'steps': 35757, 'loss/train': 1.4238637685775757}}
+11/07/2021 02:16:26 - INFO - __main__ - Step 35763: {'lr': 0.0004385001134320026, 'samples': 6866496, 'steps': 35762, 'loss/train': 1.5388737916946411}}}
+11/07/2021 02:16:26 - INFO - __main__ - Step 35763: {'lr': 0.0004385001134320026, 'samples': 6866496, 'steps': 35762, 'loss/train': 1.5388737916946411}}}
+11/07/2021 02:16:30 - INFO - __main__ - Step 35771: {'lr': 0.0004384722238195159, 'samples': 6868032, 'steps': 35770, 'loss/train': 0.987594723701477}}}}
+11/07/2021 02:16:32 - INFO - __main__ - Step 35775: {'lr': 0.000438458276975078, 'samples': 6868800, 'steps': 35774, 'loss/train': 1.3052928447723389}}}}
+11/07/2021 02:16:33 - INFO - __main__ - Step 35779: {'lr': 0.0004384443287719779, 'samples': 6869568, 'steps': 35778, 'loss/train': 1.264674186706543}}}}
+11/07/2021 02:16:36 - INFO - __main__ - Step 35783: {'lr': 0.00043843037921031616, 'samples': 6870336, 'steps': 35782, 'loss/train': 1.6619880199432373}}
+11/07/2021 02:16:38 - INFO - __main__ - Step 35788: {'lr': 0.00043841294034791466, 'samples': 6871296, 'steps': 35787, 'loss/train': 1.5242619514465332}}
+11/07/2021 02:16:38 - INFO - __main__ - Step 35788: {'lr': 0.00043841294034791466, 'samples': 6871296, 'steps': 35787, 'loss/train': 1.5242619514465332}}
+11/07/2021 02:16:42 - INFO - __main__ - Step 35796: {'lr': 0.000438385033753564, 'samples': 6872832, 'steps': 35795, 'loss/train': 1.5358773469924927}2}}
+11/07/2021 02:16:43 - INFO - __main__ - Step 35800: {'lr': 0.000438371078419137, 'samples': 6873600, 'steps': 35799, 'loss/train': 1.3921492099761963}2}}
+11/07/2021 02:16:45 - INFO - __main__ - Step 35804: {'lr': 0.00043835712172667643, 'samples': 6874368, 'steps': 35803, 'loss/train': 1.0208276510238647}}
+11/07/2021 02:16:48 - INFO - __main__ - Step 35809: {'lr': 0.0004383396739515192, 'samples': 6875328, 'steps': 35808, 'loss/train': 1.5520555973052979}}}
+11/07/2021 02:16:50 - INFO - __main__ - Step 35814: {'lr': 0.0004383222240547882, 'samples': 6876288, 'steps': 35813, 'loss/train': 0.9822989702224731}}}
+11/07/2021 02:16:50 - INFO - __main__ - Step 35814: {'lr': 0.0004383222240547882, 'samples': 6876288, 'steps': 35813, 'loss/train': 0.9822989702224731}}}
+11/07/2021 02:16:54 - INFO - __main__ - Step 35821: {'lr': 0.00043829779063549515, 'samples': 6877632, 'steps': 35820, 'loss/train': 1.6605607271194458}}
+11/07/2021 02:16:54 - INFO - __main__ - Step 35821: {'lr': 0.00043829779063549515, 'samples': 6877632, 'steps': 35820, 'loss/train': 1.6605607271194458}}
+11/07/2021 02:16:58 - INFO - __main__ - Step 35829: {'lr': 0.00043826986163711835, 'samples': 6879168, 'steps': 35828, 'loss/train': 1.2509788274765015}}
+11/07/2021 02:17:00 - INFO - __main__ - Step 35834: {'lr': 0.0004382524032560582, 'samples': 6880128, 'steps': 35833, 'loss/train': 1.533860683441162}5}}
+11/07/2021 02:17:02 - INFO - __main__ - Step 35839: {'lr': 0.00043823494275440733, 'samples': 6881088, 'steps': 35838, 'loss/train': 1.4565870761871338}}
+11/07/2021 02:17:04 - INFO - __main__ - Step 35843: {'lr': 0.0004382209728263935, 'samples': 6881856, 'steps': 35842, 'loss/train': 1.3423986434936523}}}
+11/07/2021 02:17:07 - INFO - __main__ - Step 35847: {'lr': 0.00043820700154142825, 'samples': 6882624, 'steps': 35846, 'loss/train': 1.7680792808532715}}
+11/07/2021 02:17:08 - INFO - __main__ - Step 35851: {'lr': 0.0004381930288996122, 'samples': 6883392, 'steps': 35850, 'loss/train': 1.5950745344161987}}}
+11/07/2021 02:17:10 - INFO - __main__ - Step 35855: {'lr': 0.00043817905490104613, 'samples': 6884160, 'steps': 35854, 'loss/train': 1.4157003164291382}}
+11/07/2021 02:17:12 - INFO - __main__ - Step 35860: {'lr': 0.0004381615854950625, 'samples': 6885120, 'steps': 35859, 'loss/train': 1.409956455230713}2}}
+11/07/2021 02:17:12 - INFO - __main__ - Step 35860: {'lr': 0.0004381615854950625, 'samples': 6885120, 'steps': 35859, 'loss/train': 1.409956455230713}2}}
+11/07/2021 02:17:15 - INFO - __main__ - Step 35866: {'lr': 0.00043814061941007, 'samples': 6886272, 'steps': 35865, 'loss/train': 1.0974922180175781}}2}}
+11/07/2021 02:17:17 - INFO - __main__ - Step 35871: {'lr': 0.00043812314534129716, 'samples': 6887232, 'steps': 35870, 'loss/train': 1.0092236995697021}}
+11/07/2021 02:17:20 - INFO - __main__ - Step 35875: {'lr': 0.00043810916456049257, 'samples': 6888000, 'steps': 35874, 'loss/train': 0.8110805153846741}}
+11/07/2021 02:17:20 - INFO - __main__ - Step 35875: {'lr': 0.00043810916456049257, 'samples': 6888000, 'steps': 35874, 'loss/train': 0.8110805153846741}}
+11/07/2021 02:17:24 - INFO - __main__ - Step 35883: {'lr': 0.00043808119893054787, 'samples': 6889536, 'steps': 35882, 'loss/train': 1.728338599205017}}}
+11/07/2021 02:17:25 - INFO - __main__ - Step 35887: {'lr': 0.0004380672140816095, 'samples': 6890304, 'steps': 35886, 'loss/train': 1.350689172744751}}}}
+11/07/2021 02:17:27 - INFO - __main__ - Step 35891: {'lr': 0.0004380532278768282, 'samples': 6891072, 'steps': 35890, 'loss/train': 1.6306557655334473}}}
+11/07/2021 02:17:27 - INFO - __main__ - Step 35891: {'lr': 0.0004380532278768282, 'samples': 6891072, 'steps': 35890, 'loss/train': 1.6306557655334473}}}
+11/07/2021 02:17:32 - INFO - __main__ - Step 35900: {'lr': 0.00043802175395929156, 'samples': 6892800, 'steps': 35899, 'loss/train': 1.3293200731277466}}
+11/07/2021 02:17:32 - INFO - __main__ - Step 35900: {'lr': 0.00043802175395929156, 'samples': 6892800, 'steps': 35899, 'loss/train': 1.3293200731277466}}
+11/07/2021 02:17:35 - INFO - __main__ - Step 35907: {'lr': 0.00043799726950128997, 'samples': 6894144, 'steps': 35906, 'loss/train': 1.206464171409607}}}
+11/07/2021 02:17:38 - INFO - __main__ - Step 35912: {'lr': 0.00043797977806142585, 'samples': 6895104, 'steps': 35911, 'loss/train': 1.616759181022644}}}
+11/07/2021 02:17:40 - INFO - __main__ - Step 35917: {'lr': 0.000437962284504042, 'samples': 6896064, 'steps': 35916, 'loss/train': 1.4445488452911377}}}}
+11/07/2021 02:17:40 - INFO - __main__ - Step 35917: {'lr': 0.000437962284504042, 'samples': 6896064, 'steps': 35916, 'loss/train': 1.4445488452911377}}}}
+11/07/2021 02:17:43 - INFO - __main__ - Step 35924: {'lr': 0.0004379377899666468, 'samples': 6897408, 'steps': 35923, 'loss/train': 1.3089522123336792}}}
+11/07/2021 02:17:45 - INFO - __main__ - Step 35928: {'lr': 0.0004379237912250994, 'samples': 6898176, 'steps': 35927, 'loss/train': 1.6177557706832886}}}
+11/07/2021 02:17:48 - INFO - __main__ - Step 35933: {'lr': 0.000437906290892977, 'samples': 6899136, 'steps': 35932, 'loss/train': 1.3447669744491577}}}}
+11/07/2021 02:17:48 - INFO - __main__ - Step 35933: {'lr': 0.000437906290892977, 'samples': 6899136, 'steps': 35932, 'loss/train': 1.3447669744491577}}}}
+11/07/2021 02:17:52 - INFO - __main__ - Step 35941: {'lr': 0.0004378782859589439, 'samples': 6900672, 'steps': 35940, 'loss/train': 1.4257400035858154}}}
+11/07/2021 02:17:52 - INFO - __main__ - Step 35941: {'lr': 0.0004378782859589439, 'samples': 6900672, 'steps': 35940, 'loss/train': 1.4257400035858154}}}
+11/07/2021 02:17:56 - INFO - __main__ - Step 35949: {'lr': 0.0004378502756069873, 'samples': 6902208, 'steps': 35948, 'loss/train': 0.6523028612136841}}}
+11/07/2021 02:17:58 - INFO - __main__ - Step 35954: {'lr': 0.0004378327663860839, 'samples': 6903168, 'steps': 35953, 'loss/train': 1.661206841468811}}}}
+11/07/2021 02:18:00 - INFO - __main__ - Step 35959: {'lr': 0.000437815255049317, 'samples': 6904128, 'steps': 35958, 'loss/train': 1.3309332132339478}}}}
+11/07/2021 02:18:02 - INFO - __main__ - Step 35963: {'lr': 0.00043780124445661416, 'samples': 6904896, 'steps': 35962, 'loss/train': 1.721779704093933}}}
+11/07/2021 02:18:04 - INFO - __main__ - Step 35967: {'lr': 0.0004377872325099858, 'samples': 6905664, 'steps': 35966, 'loss/train': 1.4563828706741333}}}
+11/07/2021 02:18:07 - INFO - __main__ - Step 35971: {'lr': 0.000437773219209533, 'samples': 6906432, 'steps': 35970, 'loss/train': 1.6383625268936157}}}}
+11/07/2021 02:18:08 - INFO - __main__ - Step 35975: {'lr': 0.0004377592045553568, 'samples': 6907200, 'steps': 35974, 'loss/train': 1.6243177652359009}}}
+11/07/2021 02:18:10 - INFO - __main__ - Step 35979: {'lr': 0.0004377451885475581, 'samples': 6907968, 'steps': 35978, 'loss/train': 0.8041215538978577}}}
+11/07/2021 02:18:13 - INFO - __main__ - Step 35984: {'lr': 0.0004377276666344322, 'samples': 6908928, 'steps': 35983, 'loss/train': 1.7502566576004028}}}
+11/07/2021 02:18:13 - INFO - __main__ - Step 35984: {'lr': 0.0004377276666344322, 'samples': 6908928, 'steps': 35983, 'loss/train': 1.7502566576004028}}}
+11/07/2021 02:18:16 - INFO - __main__ - Step 35990: {'lr': 0.0004377066375473213, 'samples': 6910080, 'steps': 35989, 'loss/train': 0.25427624583244324}}
+11/07/2021 02:18:18 - INFO - __main__ - Step 35995: {'lr': 0.0004376891109821606, 'samples': 6911040, 'steps': 35994, 'loss/train': 1.4026904106140137}}}
+11/07/2021 02:18:21 - INFO - __main__ - Step 36000: {'lr': 0.0004376715823027544, 'samples': 6912000, 'steps': 35999, 'loss/train': 1.4603431224822998}}}
+11/07/2021 02:18:21 - INFO - __main__ - Step 36000: {'lr': 0.0004376715823027544, 'samples': 6912000, 'steps': 35999, 'loss/train': 1.4603431224822998}}}
+11/07/2021 02:18:24 - INFO - __main__ - Step 36007: {'lr': 0.0004376470386000294, 'samples': 6913344, 'steps': 36006, 'loss/train': 1.5615692138671875}}}
+11/07/2021 02:18:26 - INFO - __main__ - Step 36011: {'lr': 0.00043763301176689, 'samples': 6914112, 'steps': 36010, 'loss/train': 2.8755180835723877}5}}}
+11/07/2021 02:18:29 - INFO - __main__ - Step 36016: {'lr': 0.0004376154763232255, 'samples': 6915072, 'steps': 36015, 'loss/train': 1.160670518875122}}}}
+11/07/2021 02:18:29 - INFO - __main__ - Step 36016: {'lr': 0.0004376154763232255, 'samples': 6915072, 'steps': 36015, 'loss/train': 1.160670518875122}}}}
+11/07/2021 02:18:32 - INFO - __main__ - Step 36023: {'lr': 0.00043759092315160064, 'samples': 6916416, 'steps': 36022, 'loss/train': 1.4155391454696655}}
+11/07/2021 02:18:34 - INFO - __main__ - Step 36027: {'lr': 0.0004375768909082175, 'samples': 6917184, 'steps': 36026, 'loss/train': 1.2582416534423828}}}
+11/07/2021 02:18:37 - INFO - __main__ - Step 36032: {'lr': 0.0004375593487023174, 'samples': 6918144, 'steps': 36031, 'loss/train': 1.5267812013626099}}}
+11/07/2021 02:18:39 - INFO - __main__ - Step 36036: {'lr': 0.00043754531341638346, 'samples': 6918912, 'steps': 36035, 'loss/train': 2.0117814540863037}}
+11/07/2021 02:18:41 - INFO - __main__ - Step 36040: {'lr': 0.00043753127677836917, 'samples': 6919680, 'steps': 36039, 'loss/train': 0.44519782066345215}
+11/07/2021 02:18:43 - INFO - __main__ - Step 36044: {'lr': 0.0004375172387883757, 'samples': 6920448, 'steps': 36043, 'loss/train': 1.5872255563735962}5}
+11/07/2021 02:18:44 - INFO - __main__ - Step 36048: {'lr': 0.0004375031994465042, 'samples': 6921216, 'steps': 36047, 'loss/train': 1.1131813526153564}5}
+11/07/2021 02:18:46 - INFO - __main__ - Step 36052: {'lr': 0.000437489158752856, 'samples': 6921984, 'steps': 36051, 'loss/train': 0.20430973172187805}5}
+11/07/2021 02:18:46 - INFO - __main__ - Step 36052: {'lr': 0.000437489158752856, 'samples': 6921984, 'steps': 36051, 'loss/train': 0.20430973172187805}5}
+11/07/2021 02:18:50 - INFO - __main__ - Step 36059: {'lr': 0.00043746458428656324, 'samples': 6923328, 'steps': 36058, 'loss/train': 1.5204285383224487}}
+11/07/2021 02:18:52 - INFO - __main__ - Step 36063: {'lr': 0.00043745053987605075, 'samples': 6924096, 'steps': 36062, 'loss/train': 1.710706353187561}}}
+11/07/2021 02:18:54 - INFO - __main__ - Step 36068: {'lr': 0.00043743298246251994, 'samples': 6925056, 'steps': 36067, 'loss/train': 1.7695902585983276}}
+11/07/2021 02:18:54 - INFO - __main__ - Step 36068: {'lr': 0.00043743298246251994, 'samples': 6925056, 'steps': 36067, 'loss/train': 1.7695902585983276}}
+11/07/2021 02:18:58 - INFO - __main__ - Step 36076: {'lr': 0.0004374048862093236, 'samples': 6926592, 'steps': 36075, 'loss/train': 1.6173049211502075}}}
+11/07/2021 02:19:00 - INFO - __main__ - Step 36080: {'lr': 0.00043739083605607275, 'samples': 6927360, 'steps': 36079, 'loss/train': 1.165663242340088}}}
+11/07/2021 02:19:02 - INFO - __main__ - Step 36084: {'lr': 0.00043737678455185524, 'samples': 6928128, 'steps': 36083, 'loss/train': 1.3838664293289185}}
+11/07/2021 02:19:04 - INFO - __main__ - Step 36089: {'lr': 0.0004373592182719408, 'samples': 6929088, 'steps': 36088, 'loss/train': 1.0795824527740479}}}
+11/07/2021 02:19:06 - INFO - __main__ - Step 36093: {'lr': 0.0004373451637284186, 'samples': 6929856, 'steps': 36092, 'loss/train': 2.1793367862701416}}}
+11/07/2021 02:19:08 - INFO - __main__ - Step 36097: {'lr': 0.00043733110783425894, 'samples': 6930624, 'steps': 36096, 'loss/train': 1.4539893865585327}}
+11/07/2021 02:19:11 - INFO - __main__ - Step 36101: {'lr': 0.0004373170505895632, 'samples': 6931392, 'steps': 36100, 'loss/train': 1.4807472229003906}}}
+11/07/2021 02:19:12 - INFO - __main__ - Step 36105: {'lr': 0.0004373029919944327, 'samples': 6932160, 'steps': 36104, 'loss/train': 0.14362464845180511}}
+11/07/2021 02:19:14 - INFO - __main__ - Step 36109: {'lr': 0.0004372889320489688, 'samples': 6932928, 'steps': 36108, 'loss/train': 1.5239927768707275}}}
+11/07/2021 02:19:16 - INFO - __main__ - Step 36114: {'lr': 0.00043727135521838697, 'samples': 6933888, 'steps': 36113, 'loss/train': 1.4923559427261353}}
+11/07/2021 02:19:16 - INFO - __main__ - Step 36114: {'lr': 0.00043727135521838697, 'samples': 6933888, 'steps': 36113, 'loss/train': 1.4923559427261353}}
+11/07/2021 02:19:20 - INFO - __main__ - Step 36121: {'lr': 0.0004372467441115903, 'samples': 6935232, 'steps': 36120, 'loss/train': 1.1723154783248901}}}
+11/07/2021 02:19:22 - INFO - __main__ - Step 36125: {'lr': 0.0004372326787658065, 'samples': 6936000, 'steps': 36124, 'loss/train': 0.9541419148445129}}}
+11/07/2021 02:19:24 - INFO - __main__ - Step 36130: {'lr': 0.00043721509518539507, 'samples': 6936960, 'steps': 36129, 'loss/train': 1.2257826328277588}}
+11/07/2021 02:19:27 - INFO - __main__ - Step 36135: {'lr': 0.0004371975094960778, 'samples': 6937920, 'steps': 36134, 'loss/train': 1.6989877223968506}}}
+11/07/2021 02:19:27 - INFO - __main__ - Step 36135: {'lr': 0.0004371975094960778, 'samples': 6937920, 'steps': 36134, 'loss/train': 1.6989877223968506}}}
+11/07/2021 02:19:30 - INFO - __main__ - Step 36142: {'lr': 0.00043717288598844916, 'samples': 6939264, 'steps': 36141, 'loss/train': 1.166265606880188}}}
+11/07/2021 02:19:32 - INFO - __main__ - Step 36146: {'lr': 0.00043715881355720776, 'samples': 6940032, 'steps': 36145, 'loss/train': 1.328829288482666}}}
+11/07/2021 02:19:34 - INFO - __main__ - Step 36150: {'lr': 0.0004371447397766724, 'samples': 6940800, 'steps': 36149, 'loss/train': 1.4469424486160278}}}
+11/07/2021 02:19:37 - INFO - __main__ - Step 36156: {'lr': 0.0004371236265761651, 'samples': 6941952, 'steps': 36155, 'loss/train': 1.5506919622421265}}}
+11/07/2021 02:19:39 - INFO - __main__ - Step 36160: {'lr': 0.00043710954942283875, 'samples': 6942720, 'steps': 36159, 'loss/train': 1.5076546669006348}}
+11/07/2021 02:19:39 - INFO - __main__ - Step 36160: {'lr': 0.00043710954942283875, 'samples': 6942720, 'steps': 36159, 'loss/train': 1.5076546669006348}}
+11/07/2021 02:19:42 - INFO - __main__ - Step 36167: {'lr': 0.0004370849111586946, 'samples': 6944064, 'steps': 36166, 'loss/train': 1.7870904207229614}}}
+11/07/2021 02:19:44 - INFO - __main__ - Step 36171: {'lr': 0.0004370708302960307, 'samples': 6944832, 'steps': 36170, 'loss/train': 1.1478573083877563}}}
+11/07/2021 02:19:47 - INFO - __main__ - Step 36176: {'lr': 0.00043705322732116007, 'samples': 6945792, 'steps': 36175, 'loss/train': 1.362337350845337}}}
+11/07/2021 02:19:49 - INFO - __main__ - Step 36180: {'lr': 0.00043703914342415473, 'samples': 6946560, 'steps': 36179, 'loss/train': 1.6111247539520264}}
+11/07/2021 02:19:51 - INFO - __main__ - Step 36184: {'lr': 0.0004370250581787181, 'samples': 6947328, 'steps': 36183, 'loss/train': 0.8045414686203003}}}
+11/07/2021 02:19:53 - INFO - __main__ - Step 36188: {'lr': 0.00043701097158495186, 'samples': 6948096, 'steps': 36187, 'loss/train': 1.0144716501235962}}
+11/07/2021 02:19:54 - INFO - __main__ - Step 36192: {'lr': 0.0004369968836429574, 'samples': 6948864, 'steps': 36191, 'loss/train': 1.3015068769454956}}}
+11/07/2021 02:19:56 - INFO - __main__ - Step 36196: {'lr': 0.00043698279435283637, 'samples': 6949632, 'steps': 36195, 'loss/train': 1.662702202796936}}}
+11/07/2021 02:19:59 - INFO - __main__ - Step 36201: {'lr': 0.000436965180844537, 'samples': 6950592, 'steps': 36200, 'loss/train': 1.7721482515335083}}}}
+11/07/2021 02:20:01 - INFO - __main__ - Step 36205: {'lr': 0.0004369510885215026, 'samples': 6951360, 'steps': 36204, 'loss/train': 1.2825634479522705}}}
+11/07/2021 02:20:03 - INFO - __main__ - Step 36209: {'lr': 0.00043693699485067186, 'samples': 6952128, 'steps': 36208, 'loss/train': 1.2388901710510254}}
+11/07/2021 02:20:04 - INFO - __main__ - Step 36213: {'lr': 0.00043692289983214626, 'samples': 6952896, 'steps': 36212, 'loss/train': 1.5022273063659668}}
+11/07/2021 02:20:06 - INFO - __main__ - Step 36217: {'lr': 0.00043690880346602755, 'samples': 6953664, 'steps': 36216, 'loss/train': 1.4669190645217896}}
+11/07/2021 02:20:09 - INFO - __main__ - Step 36222: {'lr': 0.00043689118111348105, 'samples': 6954624, 'steps': 36221, 'loss/train': 1.7597016096115112}}
+11/07/2021 02:20:09 - INFO - __main__ - Step 36222: {'lr': 0.00043689118111348105, 'samples': 6954624, 'steps': 36221, 'loss/train': 1.7597016096115112}}
+11/07/2021 02:20:13 - INFO - __main__ - Step 36230: {'lr': 0.00043686298097055456, 'samples': 6956160, 'steps': 36229, 'loss/train': 1.7766621112823486}}
+11/07/2021 02:20:15 - INFO - __main__ - Step 36234: {'lr': 0.00043684887887829863, 'samples': 6956928, 'steps': 36233, 'loss/train': 1.5048789978027344}}
+11/07/2021 02:20:16 - INFO - __main__ - Step 36238: {'lr': 0.00043683477543898314, 'samples': 6957696, 'steps': 36237, 'loss/train': 0.8398938775062561}}
+11/07/2021 02:20:18 - INFO - __main__ - Step 36242: {'lr': 0.0004368206706527098, 'samples': 6958464, 'steps': 36241, 'loss/train': 1.5783356428146362}}}
+11/07/2021 02:20:21 - INFO - __main__ - Step 36248: {'lr': 0.0004367995109479763, 'samples': 6959616, 'steps': 36247, 'loss/train': 1.4469062089920044}}}
+11/07/2021 02:20:23 - INFO - __main__ - Step 36252: {'lr': 0.00043678540279475314, 'samples': 6960384, 'steps': 36251, 'loss/train': 1.4475023746490479}}
+11/07/2021 02:20:23 - INFO - __main__ - Step 36252: {'lr': 0.00043678540279475314, 'samples': 6960384, 'steps': 36251, 'loss/train': 1.4475023746490479}}
+11/07/2021 02:20:26 - INFO - __main__ - Step 36258: {'lr': 0.0004367642380400717, 'samples': 6961536, 'steps': 36257, 'loss/train': 1.542945146560669}9}}
+11/07/2021 02:20:28 - INFO - __main__ - Step 36263: {'lr': 0.0004367465984302794, 'samples': 6962496, 'steps': 36262, 'loss/train': 1.3904285430908203}}}
+11/07/2021 02:20:31 - INFO - __main__ - Step 36268: {'lr': 0.0004367289567168588, 'samples': 6963456, 'steps': 36267, 'loss/train': 1.3548353910446167}}}
+11/07/2021 02:20:33 - INFO - __main__ - Step 36272: {'lr': 0.0004367148418316434, 'samples': 6964224, 'steps': 36271, 'loss/train': 1.1501420736312866}}}
+11/07/2021 02:20:33 - INFO - __main__ - Step 36272: {'lr': 0.0004367148418316434, 'samples': 6964224, 'steps': 36271, 'loss/train': 1.1501420736312866}}}
+11/07/2021 02:20:36 - INFO - __main__ - Step 36279: {'lr': 0.0004366901375435408, 'samples': 6965568, 'steps': 36278, 'loss/train': 1.6254451274871826}}}
+11/07/2021 02:20:38 - INFO - __main__ - Step 36283: {'lr': 0.000436676018956814, 'samples': 6966336, 'steps': 36282, 'loss/train': 1.441980004310608}6}}}
+11/07/2021 02:20:41 - INFO - __main__ - Step 36288: {'lr': 0.00043665836883086725, 'samples': 6967296, 'steps': 36287, 'loss/train': 1.3476370573043823}}
+11/07/2021 02:20:43 - INFO - __main__ - Step 36293: {'lr': 0.00043664071660228605, 'samples': 6968256, 'steps': 36292, 'loss/train': 1.2941185235977173}}
+11/07/2021 02:20:43 - INFO - __main__ - Step 36293: {'lr': 0.00043664071660228605, 'samples': 6968256, 'steps': 36292, 'loss/train': 1.2941185235977173}}
+11/07/2021 02:20:47 - INFO - __main__ - Step 36301: {'lr': 0.0004366124686635727, 'samples': 6969792, 'steps': 36300, 'loss/train': 1.804154396057129}3}}
+11/07/2021 02:20:49 - INFO - __main__ - Step 36305: {'lr': 0.00043659834267613227, 'samples': 6970560, 'steps': 36304, 'loss/train': 1.4944956302642822}}
+11/07/2021 02:20:51 - INFO - __main__ - Step 36309: {'lr': 0.00043658421534343856, 'samples': 6971328, 'steps': 36308, 'loss/train': 1.585021734237671}}}
+11/07/2021 02:20:51 - INFO - __main__ - Step 36309: {'lr': 0.00043658421534343856, 'samples': 6971328, 'steps': 36308, 'loss/train': 1.585021734237671}}}
+11/07/2021 02:20:55 - INFO - __main__ - Step 36317: {'lr': 0.0004365559566426985, 'samples': 6972864, 'steps': 36316, 'loss/train': 1.3983964920043945}}}
+11/07/2021 02:20:56 - INFO - __main__ - Step 36321: {'lr': 0.0004365418252748559, 'samples': 6973632, 'steps': 36320, 'loss/train': 1.5906174182891846}}}
+11/07/2021 02:20:58 - INFO - __main__ - Step 36325: {'lr': 0.0004365276925621674, 'samples': 6974400, 'steps': 36324, 'loss/train': 1.2448979616165161}}}
+11/07/2021 02:21:01 - INFO - __main__ - Step 36330: {'lr': 0.0004365100247802725, 'samples': 6975360, 'steps': 36329, 'loss/train': 1.696042776107788}}}}
+11/07/2021 02:21:01 - INFO - __main__ - Step 36330: {'lr': 0.0004365100247802725, 'samples': 6975360, 'steps': 36329, 'loss/train': 1.696042776107788}}}}
+11/07/2021 02:21:04 - INFO - __main__ - Step 36336: {'lr': 0.0004364888206687443, 'samples': 6976512, 'steps': 36335, 'loss/train': 2.372626304626465}}}}
+11/07/2021 02:21:07 - INFO - __main__ - Step 36341: {'lr': 0.0004364711482649925, 'samples': 6977472, 'steps': 36340, 'loss/train': 1.3252372741699219}}}
+11/07/2021 02:21:09 - INFO - __main__ - Step 36346: {'lr': 0.00043645347376071507, 'samples': 6978432, 'steps': 36345, 'loss/train': 1.7303555011749268}}
+11/07/2021 02:21:09 - INFO - __main__ - Step 36346: {'lr': 0.00043645347376071507, 'samples': 6978432, 'steps': 36345, 'loss/train': 1.7303555011749268}}
+11/07/2021 02:21:12 - INFO - __main__ - Step 36353: {'lr': 0.00043642872592622293, 'samples': 6979776, 'steps': 36352, 'loss/train': 1.3439143896102905}}
+11/07/2021 02:21:14 - INFO - __main__ - Step 36357: {'lr': 0.0004364145824584361, 'samples': 6980544, 'steps': 36356, 'loss/train': 1.4082454442977905}}}
+11/07/2021 02:21:17 - INFO - __main__ - Step 36362: {'lr': 0.00043639690123381503, 'samples': 6981504, 'steps': 36361, 'loss/train': 0.9121442437171936}}
+11/07/2021 02:21:19 - INFO - __main__ - Step 36366: {'lr': 0.0004363827547423324, 'samples': 6982272, 'steps': 36365, 'loss/train': 4.262648582458496}6}}
+11/07/2021 02:21:21 - INFO - __main__ - Step 36370: {'lr': 0.00043636860690715064, 'samples': 6983040, 'steps': 36369, 'loss/train': 1.4799058437347412}}
+11/07/2021 02:21:22 - INFO - __main__ - Step 36374: {'lr': 0.0004363544577283718, 'samples': 6983808, 'steps': 36373, 'loss/train': 1.4895075559616089}}}
+11/07/2021 02:21:25 - INFO - __main__ - Step 36378: {'lr': 0.000436340307206098, 'samples': 6984576, 'steps': 36377, 'loss/train': 1.4843051433563232}}}}
+11/07/2021 02:21:27 - INFO - __main__ - Step 36383: {'lr': 0.00043632261716412097, 'samples': 6985536, 'steps': 36382, 'loss/train': 0.906044065952301}}}
+11/07/2021 02:21:27 - INFO - __main__ - Step 36383: {'lr': 0.00043632261716412097, 'samples': 6985536, 'steps': 36382, 'loss/train': 0.906044065952301}}}
+11/07/2021 02:21:31 - INFO - __main__ - Step 36391: {'lr': 0.00043629430873142773, 'samples': 6987072, 'steps': 36390, 'loss/train': 0.39275264739990234}
+11/07/2021 02:21:33 - INFO - __main__ - Step 36395: {'lr': 0.00043628015250043794, 'samples': 6987840, 'steps': 36394, 'loss/train': 1.107160210609436}4}
+11/07/2021 02:21:35 - INFO - __main__ - Step 36399: {'lr': 0.00043626599492648877, 'samples': 6988608, 'steps': 36398, 'loss/train': 1.4821674823760986}}
+11/07/2021 02:21:37 - INFO - __main__ - Step 36403: {'lr': 0.00043625183600968224, 'samples': 6989376, 'steps': 36402, 'loss/train': 1.764100193977356}}}
+11/07/2021 02:21:39 - INFO - __main__ - Step 36408: {'lr': 0.00043623413547543645, 'samples': 6990336, 'steps': 36407, 'loss/train': 1.0938903093338013}}
+11/07/2021 02:21:41 - INFO - __main__ - Step 36412: {'lr': 0.0004362199735375742, 'samples': 6991104, 'steps': 36411, 'loss/train': 1.1211869716644287}}}
+11/07/2021 02:21:41 - INFO - __main__ - Step 36412: {'lr': 0.0004362199735375742, 'samples': 6991104, 'steps': 36411, 'loss/train': 1.1211869716644287}}}
+11/07/2021 02:21:45 - INFO - __main__ - Step 36419: {'lr': 0.00043619518691592453, 'samples': 6992448, 'steps': 36418, 'loss/train': 0.7464272975921631}}
+11/07/2021 02:21:47 - INFO - __main__ - Step 36424: {'lr': 0.0004361774796692425, 'samples': 6993408, 'steps': 36423, 'loss/train': 1.7541043758392334}}}
+11/07/2021 02:21:49 - INFO - __main__ - Step 36428: {'lr': 0.0004361633123618908, 'samples': 6994176, 'steps': 36427, 'loss/train': 1.10480797290802}4}}}
+11/07/2021 02:21:49 - INFO - __main__ - Step 36428: {'lr': 0.0004361633123618908, 'samples': 6994176, 'steps': 36427, 'loss/train': 1.10480797290802}4}}}
+11/07/2021 02:21:53 - INFO - __main__ - Step 36435: {'lr': 0.00043613851634461743, 'samples': 6995520, 'steps': 36434, 'loss/train': 1.5099252462387085}}
+11/07/2021 02:21:54 - INFO - __main__ - Step 36439: {'lr': 0.0004361243453466896, 'samples': 6996288, 'steps': 36438, 'loss/train': 1.8450305461883545}}}
+11/07/2021 02:21:57 - INFO - __main__ - Step 36443: {'lr': 0.0004361101730069256, 'samples': 6997056, 'steps': 36442, 'loss/train': 0.9707183837890625}}}
+11/07/2021 02:21:59 - INFO - __main__ - Step 36448: {'lr': 0.00043609245569541924, 'samples': 6998016, 'steps': 36447, 'loss/train': 1.5884859561920166}}
+11/07/2021 02:22:01 - INFO - __main__ - Step 36453: {'lr': 0.000436074736287653, 'samples': 6998976, 'steps': 36452, 'loss/train': 1.6394306421279907}6}}
+11/07/2021 02:22:01 - INFO - __main__ - Step 36453: {'lr': 0.000436074736287653, 'samples': 6998976, 'steps': 36452, 'loss/train': 1.6394306421279907}6}}
+11/07/2021 02:22:05 - INFO - __main__ - Step 36460: {'lr': 0.0004360499255954442, 'samples': 7000320, 'steps': 36459, 'loss/train': 1.176275372505188}6}}
+11/07/2021 02:22:07 - INFO - __main__ - Step 36464: {'lr': 0.0004360357462127171, 'samples': 7001088, 'steps': 36463, 'loss/train': 1.5522664785385132}}}
+11/07/2021 02:22:09 - INFO - __main__ - Step 36469: {'lr': 0.0004360180200982613, 'samples': 7002048, 'steps': 36468, 'loss/train': 1.7998279333114624}}}
+11/07/2021 02:22:09 - INFO - __main__ - Step 36469: {'lr': 0.0004360180200982613, 'samples': 7002048, 'steps': 36468, 'loss/train': 1.7998279333114624}}}
+11/07/2021 02:22:13 - INFO - __main__ - Step 36477: {'lr': 0.00043598965395673893, 'samples': 7003584, 'steps': 36476, 'loss/train': 1.5747464895248413}}
+11/07/2021 02:22:15 - INFO - __main__ - Step 36481: {'lr': 0.000435975468874629, 'samples': 7004352, 'steps': 36480, 'loss/train': 1.4760842323303223}3}}
+11/07/2021 02:22:17 - INFO - __main__ - Step 36485: {'lr': 0.0004359612824517563, 'samples': 7005120, 'steps': 36484, 'loss/train': 1.6380879878997803}}}
+11/07/2021 02:22:19 - INFO - __main__ - Step 36489: {'lr': 0.000435947094688223, 'samples': 7005888, 'steps': 36488, 'loss/train': 1.4367139339447021}}}}
+11/07/2021 02:22:21 - INFO - __main__ - Step 36494: {'lr': 0.0004359293580986583, 'samples': 7006848, 'steps': 36493, 'loss/train': 1.8951630592346191}}}
+11/07/2021 02:22:21 - INFO - __main__ - Step 36494: {'lr': 0.0004359293580986583, 'samples': 7006848, 'steps': 36493, 'loss/train': 1.8951630592346191}}}
+11/07/2021 02:22:25 - INFO - __main__ - Step 36501: {'lr': 0.00043590452335468265, 'samples': 7008192, 'steps': 36500, 'loss/train': 0.6577228307723999}}
+11/07/2021 02:22:27 - INFO - __main__ - Step 36505: {'lr': 0.0004358903302295301, 'samples': 7008960, 'steps': 36504, 'loss/train': 1.8605214357376099}}}
+11/07/2021 02:22:29 - INFO - __main__ - Step 36510: {'lr': 0.00043587258693851685, 'samples': 7009920, 'steps': 36509, 'loss/train': 1.5353094339370728}}
+11/07/2021 02:22:31 - INFO - __main__ - Step 36514: {'lr': 0.0004358583907981729, 'samples': 7010688, 'steps': 36513, 'loss/train': 1.7945281267166138}}}
+11/07/2021 02:22:31 - INFO - __main__ - Step 36514: {'lr': 0.0004358583907981729, 'samples': 7010688, 'steps': 36513, 'loss/train': 1.7945281267166138}}}
+11/07/2021 02:22:35 - INFO - __main__ - Step 36521: {'lr': 0.000435833544328453, 'samples': 7012032, 'steps': 36520, 'loss/train': 1.0032232999801636}}}}
+11/07/2021 02:22:37 - INFO - __main__ - Step 36526: {'lr': 0.0004358157943380379, 'samples': 7012992, 'steps': 36525, 'loss/train': 1.2418889999389648}}}
+11/07/2021 02:22:37 - INFO - __main__ - Step 36526: {'lr': 0.0004358157943380379, 'samples': 7012992, 'steps': 36525, 'loss/train': 1.2418889999389648}}}
+11/07/2021 02:22:42 - INFO - __main__ - Step 36534: {'lr': 0.00043578738999971886, 'samples': 7014528, 'steps': 36533, 'loss/train': 1.2998322248458862}}
+11/07/2021 02:22:43 - INFO - __main__ - Step 36538: {'lr': 0.0004357731858213978, 'samples': 7015296, 'steps': 36537, 'loss/train': 1.26777982711792}62}}
+11/07/2021 02:22:45 - INFO - __main__ - Step 36542: {'lr': 0.00043575898030377225, 'samples': 7016064, 'steps': 36541, 'loss/train': 1.8516111373901367}}
+11/07/2021 02:22:47 - INFO - __main__ - Step 36547: {'lr': 0.0004357412215234994, 'samples': 7017024, 'steps': 36546, 'loss/train': 1.2742689847946167}}}
+11/07/2021 02:22:50 - INFO - __main__ - Step 36551: {'lr': 0.00043572701299281327, 'samples': 7017792, 'steps': 36550, 'loss/train': 1.5491282939910889}}
+11/07/2021 02:22:51 - INFO - __main__ - Step 36555: {'lr': 0.00043571280312315543, 'samples': 7018560, 'steps': 36554, 'loss/train': 0.42579716444015503}
+11/07/2021 02:22:54 - INFO - __main__ - Step 36559: {'lr': 0.00043569859191462847, 'samples': 7019328, 'steps': 36558, 'loss/train': 1.3331043720245361}}
+11/07/2021 02:22:55 - INFO - __main__ - Step 36563: {'lr': 0.00043568437936733473, 'samples': 7020096, 'steps': 36562, 'loss/train': 1.5390021800994873}}
+11/07/2021 02:22:57 - INFO - __main__ - Step 36567: {'lr': 0.00043567016548137685, 'samples': 7020864, 'steps': 36566, 'loss/train': 1.0905752182006836}}
+11/07/2021 02:22:57 - INFO - __main__ - Step 36567: {'lr': 0.00043567016548137685, 'samples': 7020864, 'steps': 36566, 'loss/train': 1.0905752182006836}}
+11/07/2021 02:22:57 - INFO - __main__ - Step 36567: {'lr': 0.00043567016548137685, 'samples': 7020864, 'steps': 36566, 'loss/train': 1.0905752182006836}}
+11/07/2021 02:23:03 - INFO - __main__ - Step 36578: {'lr': 0.0004356310703933415, 'samples': 7022976, 'steps': 36577, 'loss/train': 0.35052648186683655}}
+11/07/2021 02:23:06 - INFO - __main__ - Step 36583: {'lr': 0.000435613296552952, 'samples': 7023936, 'steps': 36582, 'loss/train': 1.6587493419647217}5}}
+11/07/2021 02:23:06 - INFO - __main__ - Step 36583: {'lr': 0.000435613296552952, 'samples': 7023936, 'steps': 36582, 'loss/train': 1.6587493419647217}5}}
+11/07/2021 02:23:06 - INFO - __main__ - Step 36583: {'lr': 0.000435613296552952, 'samples': 7023936, 'steps': 36582, 'loss/train': 1.6587493419647217}5}}
+11/07/2021 02:23:11 - INFO - __main__ - Step 36594: {'lr': 0.0004355741867445423, 'samples': 7026048, 'steps': 36593, 'loss/train': 1.5897024869918823}}}
+11/07/2021 02:23:13 - INFO - __main__ - Step 36598: {'lr': 0.00043555996248741157, 'samples': 7026816, 'steps': 36597, 'loss/train': 1.5443997383117676}}
+11/07/2021 02:23:13 - INFO - __main__ - Step 36598: {'lr': 0.00043555996248741157, 'samples': 7026816, 'steps': 36597, 'loss/train': 1.5443997383117676}}
+11/07/2021 02:23:18 - INFO - __main__ - Step 36607: {'lr': 0.000435527953017812, 'samples': 7028544, 'steps': 36606, 'loss/train': 2.162864923477173}76}}
+11/07/2021 02:23:18 - INFO - __main__ - Step 36607: {'lr': 0.000435527953017812, 'samples': 7028544, 'steps': 36606, 'loss/train': 2.162864923477173}76}}
+11/07/2021 02:23:21 - INFO - __main__ - Step 36614: {'lr': 0.0004355030520822414, 'samples': 7029888, 'steps': 36613, 'loss/train': 1.3485804796218872}}}
+11/07/2021 02:23:24 - INFO - __main__ - Step 36620: {'lr': 0.0004354817051633523, 'samples': 7031040, 'steps': 36619, 'loss/train': 1.7353585958480835}}}
+11/07/2021 02:23:24 - INFO - __main__ - Step 36620: {'lr': 0.0004354817051633523, 'samples': 7031040, 'steps': 36619, 'loss/train': 1.7353585958480835}}}
+11/07/2021 02:23:28 - INFO - __main__ - Step 36627: {'lr': 0.0004354567966220013, 'samples': 7032384, 'steps': 36626, 'loss/train': 0.542655348777771}}}}
+11/07/2021 02:23:28 - INFO - __main__ - Step 36627: {'lr': 0.0004354567966220013, 'samples': 7032384, 'steps': 36626, 'loss/train': 0.542655348777771}}}}
+11/07/2021 02:23:31 - INFO - __main__ - Step 36635: {'lr': 0.00043542832470379415, 'samples': 7033920, 'steps': 36634, 'loss/train': 0.9428682923316956}}
+11/07/2021 02:23:34 - INFO - __main__ - Step 36640: {'lr': 0.00043541052703945034, 'samples': 7034880, 'steps': 36639, 'loss/train': 1.4707204103469849}}
+11/07/2021 02:23:36 - INFO - __main__ - Step 36645: {'lr': 0.0004353927272865285, 'samples': 7035840, 'steps': 36644, 'loss/train': 1.5697284936904907}}}
+11/07/2021 02:23:36 - INFO - __main__ - Step 36645: {'lr': 0.0004353927272865285, 'samples': 7035840, 'steps': 36644, 'loss/train': 1.5697284936904907}}}
+11/07/2021 02:23:40 - INFO - __main__ - Step 36652: {'lr': 0.00043536780412400857, 'samples': 7037184, 'steps': 36651, 'loss/train': 1.5300203561782837}}
+11/07/2021 02:23:41 - INFO - __main__ - Step 36656: {'lr': 0.00043535356047929387, 'samples': 7037952, 'steps': 36655, 'loss/train': 1.262406826019287}}}
+11/07/2021 02:23:44 - INFO - __main__ - Step 36661: {'lr': 0.00043533575404426986, 'samples': 7038912, 'steps': 36660, 'loss/train': 1.4423415660858154}}
+11/07/2021 02:23:46 - INFO - __main__ - Step 36665: {'lr': 0.0004353215073930712, 'samples': 7039680, 'steps': 36664, 'loss/train': 1.543150544166565}4}}
+11/07/2021 02:23:48 - INFO - __main__ - Step 36669: {'lr': 0.0004353072594058243, 'samples': 7040448, 'steps': 36668, 'loss/train': 1.6925253868103027}}}
+11/07/2021 02:23:50 - INFO - __main__ - Step 36673: {'lr': 0.000435293010082632, 'samples': 7041216, 'steps': 36672, 'loss/train': 1.4857127666473389}}}}
+11/07/2021 02:23:51 - INFO - __main__ - Step 36677: {'lr': 0.00043527875942359697, 'samples': 7041984, 'steps': 36676, 'loss/train': 1.895818829536438}}}
+11/07/2021 02:23:54 - INFO - __main__ - Step 36682: {'lr': 0.0004352609442214309, 'samples': 7042944, 'steps': 36681, 'loss/train': 1.5160088539123535}}}
+11/07/2021 02:23:56 - INFO - __main__ - Step 36687: {'lr': 0.00043524312693237166, 'samples': 7043904, 'steps': 36686, 'loss/train': 1.4041990041732788}}
+11/07/2021 02:23:56 - INFO - __main__ - Step 36687: {'lr': 0.00043524312693237166, 'samples': 7043904, 'steps': 36686, 'loss/train': 1.4041990041732788}}
+11/07/2021 02:24:00 - INFO - __main__ - Step 36694: {'lr': 0.00043521817922209064, 'samples': 7045248, 'steps': 36693, 'loss/train': 1.047343134880066}}}
+11/07/2021 02:24:02 - INFO - __main__ - Step 36698: {'lr': 0.00043520392155156694, 'samples': 7046016, 'steps': 36697, 'loss/train': 1.2285186052322388}}
+11/07/2021 02:24:02 - INFO - __main__ - Step 36698: {'lr': 0.00043520392155156694, 'samples': 7046016, 'steps': 36697, 'loss/train': 1.2285186052322388}}
+11/07/2021 02:24:06 - INFO - __main__ - Step 36705: {'lr': 0.00043517896741538634, 'samples': 7047360, 'steps': 36704, 'loss/train': 1.3965660333633423}}
+11/07/2021 02:24:08 - INFO - __main__ - Step 36709: {'lr': 0.0004351647060733088, 'samples': 7048128, 'steps': 36708, 'loss/train': 1.5138906240463257}}}
+11/07/2021 02:24:10 - INFO - __main__ - Step 36714: {'lr': 0.0004351468775184959, 'samples': 7049088, 'steps': 36713, 'loss/train': 1.2794389724731445}}}
+11/07/2021 02:24:10 - INFO - __main__ - Step 36714: {'lr': 0.0004351468775184959, 'samples': 7049088, 'steps': 36713, 'loss/train': 1.2794389724731445}}}
+11/07/2021 02:24:13 - INFO - __main__ - Step 36721: {'lr': 0.00043512191403798095, 'samples': 7050432, 'steps': 36720, 'loss/train': 1.3332635164260864}}
+11/07/2021 02:24:15 - INFO - __main__ - Step 36725: {'lr': 0.00043510764735684945, 'samples': 7051200, 'steps': 36724, 'loss/train': 1.5401238203048706}}
+11/07/2021 02:24:18 - INFO - __main__ - Step 36730: {'lr': 0.00043508981212879737, 'samples': 7052160, 'steps': 36729, 'loss/train': 1.5463894605636597}}
+11/07/2021 02:24:20 - INFO - __main__ - Step 36735: {'lr': 0.0004350719748157801, 'samples': 7053120, 'steps': 36734, 'loss/train': 1.727805733680725}7}}
+11/07/2021 02:24:20 - INFO - __main__ - Step 36735: {'lr': 0.0004350719748157801, 'samples': 7053120, 'steps': 36734, 'loss/train': 1.727805733680725}7}}
+11/07/2021 02:24:23 - INFO - __main__ - Step 36742: {'lr': 0.0004350469990751966, 'samples': 7054464, 'steps': 36741, 'loss/train': 1.233171820640564}7}}
+11/07/2021 02:24:25 - INFO - __main__ - Step 36746: {'lr': 0.00043503272538905423, 'samples': 7055232, 'steps': 36745, 'loss/train': 1.5790698528289795}}
+11/07/2021 02:24:28 - INFO - __main__ - Step 36751: {'lr': 0.00043501488140549824, 'samples': 7056192, 'steps': 36750, 'loss/train': 1.3899540901184082}}
+11/07/2021 02:24:28 - INFO - __main__ - Step 36751: {'lr': 0.00043501488140549824, 'samples': 7056192, 'steps': 36750, 'loss/train': 1.3899540901184082}}
+11/07/2021 02:24:32 - INFO - __main__ - Step 36759: {'lr': 0.00043498632669692, 'samples': 7057728, 'steps': 36758, 'loss/train': 1.6395902633666992}82}}
+11/07/2021 02:24:33 - INFO - __main__ - Step 36763: {'lr': 0.0004349720473421318, 'samples': 7058496, 'steps': 36762, 'loss/train': 1.6168584823608398}}}
+11/07/2021 02:24:36 - INFO - __main__ - Step 36767: {'lr': 0.0004349577666538148, 'samples': 7059264, 'steps': 36766, 'loss/train': 1.339677333831787}}}}
+11/07/2021 02:24:38 - INFO - __main__ - Step 36772: {'lr': 0.0004349399139183005, 'samples': 7060224, 'steps': 36771, 'loss/train': 1.70767080783844}}}}}
+11/07/2021 02:24:38 - INFO - __main__ - Step 36772: {'lr': 0.0004349399139183005, 'samples': 7060224, 'steps': 36771, 'loss/train': 1.70767080783844}}}}}
+11/07/2021 02:24:42 - INFO - __main__ - Step 36780: {'lr': 0.0004349113452083456, 'samples': 7061760, 'steps': 36779, 'loss/train': 0.10330658406019211}}
+11/07/2021 02:24:44 - INFO - __main__ - Step 36784: {'lr': 0.00043489705885367986, 'samples': 7062528, 'steps': 36783, 'loss/train': 1.6908950805664062}}
+11/07/2021 02:24:46 - INFO - __main__ - Step 36788: {'lr': 0.000434882771166026, 'samples': 7063296, 'steps': 36787, 'loss/train': 1.6882917881011963}2}}
+11/07/2021 02:24:48 - INFO - __main__ - Step 36792: {'lr': 0.00043486848214548693, 'samples': 7064064, 'steps': 36791, 'loss/train': 1.5211457014083862}}
+11/07/2021 02:24:48 - INFO - __main__ - Step 36792: {'lr': 0.00043486848214548693, 'samples': 7064064, 'steps': 36791, 'loss/train': 1.5211457014083862}}
+11/07/2021 02:24:52 - INFO - __main__ - Step 36799: {'lr': 0.0004348434731525984, 'samples': 7065408, 'steps': 36798, 'loss/train': 1.167148232460022}2}}
+11/07/2021 02:24:54 - INFO - __main__ - Step 36804: {'lr': 0.00043482560708758876, 'samples': 7066368, 'steps': 36803, 'loss/train': 1.4844629764556885}}
+11/07/2021 02:24:54 - INFO - __main__ - Step 36804: {'lr': 0.00043482560708758876, 'samples': 7066368, 'steps': 36803, 'loss/train': 1.4844629764556885}}
+11/07/2021 02:24:58 - INFO - __main__ - Step 36812: {'lr': 0.0004347970170531197, 'samples': 7067904, 'steps': 36811, 'loss/train': 0.178208589553833}5}}
+11/07/2021 02:25:00 - INFO - __main__ - Step 36816: {'lr': 0.00043478272003743315, 'samples': 7068672, 'steps': 36815, 'loss/train': 1.3449026346206665}}
+11/07/2021 02:25:02 - INFO - __main__ - Step 36820: {'lr': 0.00043476842168958276, 'samples': 7069440, 'steps': 36819, 'loss/train': 1.308180332183838}}}
+11/07/2021 02:25:05 - INFO - __main__ - Step 36825: {'lr': 0.00043475054688157136, 'samples': 7070400, 'steps': 36824, 'loss/train': 1.386857509613037}}}
+11/07/2021 02:25:07 - INFO - __main__ - Step 36829: {'lr': 0.0004347362455367292, 'samples': 7071168, 'steps': 36828, 'loss/train': 1.2976011037826538}}}
+11/07/2021 02:25:07 - INFO - __main__ - Step 36829: {'lr': 0.0004347362455367292, 'samples': 7071168, 'steps': 36828, 'loss/train': 1.2976011037826538}}}
+11/07/2021 02:25:10 - INFO - __main__ - Step 36836: {'lr': 0.0004347112149786042, 'samples': 7072512, 'steps': 36835, 'loss/train': 1.5071020126342773}}}
+11/07/2021 02:25:12 - INFO - __main__ - Step 36840: {'lr': 0.00043469690997148086, 'samples': 7073280, 'steps': 36839, 'loss/train': 2.168046474456787}}}
+11/07/2021 02:25:14 - INFO - __main__ - Step 36845: {'lr': 0.0004346790268401033, 'samples': 7074240, 'steps': 36844, 'loss/train': 2.1799943447113037}}}
+11/07/2021 02:25:14 - INFO - __main__ - Step 36845: {'lr': 0.0004346790268401033, 'samples': 7074240, 'steps': 36844, 'loss/train': 2.1799943447113037}}}
+11/07/2021 02:25:19 - INFO - __main__ - Step 36853: {'lr': 0.0004346504095028799, 'samples': 7075776, 'steps': 36852, 'loss/train': 0.6996008157730103}}}
+11/07/2021 02:25:20 - INFO - __main__ - Step 36857: {'lr': 0.0004346360988374016, 'samples': 7076544, 'steps': 36856, 'loss/train': 1.0569288730621338}}}
+11/07/2021 02:25:22 - INFO - __main__ - Step 36861: {'lr': 0.00043462178684081657, 'samples': 7077312, 'steps': 36860, 'loss/train': 1.1887201070785522}}
+11/07/2021 02:25:25 - INFO - __main__ - Step 36866: {'lr': 0.0004346038949733734, 'samples': 7078272, 'steps': 36865, 'loss/train': 1.4717979431152344}}}
+11/07/2021 02:25:27 - INFO - __main__ - Step 36870: {'lr': 0.00043458957998217517, 'samples': 7079040, 'steps': 36869, 'loss/train': 0.5438855290412903}}
+11/07/2021 02:25:27 - INFO - __main__ - Step 36870: {'lr': 0.00043458957998217517, 'samples': 7079040, 'steps': 36869, 'loss/train': 0.5438855290412903}}
+11/07/2021 02:25:30 - INFO - __main__ - Step 36877: {'lr': 0.00043456452554547153, 'samples': 7080384, 'steps': 36876, 'loss/train': 1.5580357313156128}}
+11/07/2021 02:25:32 - INFO - __main__ - Step 36882: {'lr': 0.0004345466270243646, 'samples': 7081344, 'steps': 36881, 'loss/train': 1.5124123096466064}}}
+11/07/2021 02:25:35 - INFO - __main__ - Step 36887: {'lr': 0.00043452872642441124, 'samples': 7082304, 'steps': 36886, 'loss/train': 1.3987716436386108}}
+11/07/2021 02:25:37 - INFO - __main__ - Step 36891: {'lr': 0.0004345144044478144, 'samples': 7083072, 'steps': 36890, 'loss/train': 1.3742188215255737}}}
+11/07/2021 02:25:39 - INFO - __main__ - Step 36895: {'lr': 0.0004345000811409881, 'samples': 7083840, 'steps': 36894, 'loss/train': 1.6039793491363525}}}
+11/07/2021 02:25:40 - INFO - __main__ - Step 36899: {'lr': 0.00043448575650403555, 'samples': 7084608, 'steps': 36898, 'loss/train': 1.2332217693328857}}
+11/07/2021 02:25:43 - INFO - __main__ - Step 36903: {'lr': 0.00043447143053706007, 'samples': 7085376, 'steps': 36902, 'loss/train': 0.938480794429779}}}
+11/07/2021 02:25:45 - INFO - __main__ - Step 36908: {'lr': 0.0004344535212081533, 'samples': 7086336, 'steps': 36907, 'loss/train': 1.481315016746521}}}}
+11/07/2021 02:25:47 - INFO - __main__ - Step 36912: {'lr': 0.0004344391922490037, 'samples': 7087104, 'steps': 36911, 'loss/train': 1.4719501733779907}}}
+11/07/2021 02:25:47 - INFO - __main__ - Step 36912: {'lr': 0.0004344391922490037, 'samples': 7087104, 'steps': 36911, 'loss/train': 1.4719501733779907}}}
+11/07/2021 02:25:50 - INFO - __main__ - Step 36919: {'lr': 0.0004344141133709943, 'samples': 7088448, 'steps': 36918, 'loss/train': 1.3123325109481812}}}
+11/07/2021 02:25:52 - INFO - __main__ - Step 36923: {'lr': 0.00043439978075545337, 'samples': 7089216, 'steps': 36922, 'loss/train': 1.4996906518936157}}
+11/07/2021 02:25:55 - INFO - __main__ - Step 36928: {'lr': 0.00043438186311656624, 'samples': 7090176, 'steps': 36927, 'loss/train': 1.6770905256271362}}
+11/07/2021 02:25:57 - INFO - __main__ - Step 36933: {'lr': 0.0004343639434006885, 'samples': 7091136, 'steps': 36932, 'loss/train': 1.7856611013412476}}}
+11/07/2021 02:25:57 - INFO - __main__ - Step 36933: {'lr': 0.0004343639434006885, 'samples': 7091136, 'steps': 36932, 'loss/train': 1.7856611013412476}}}
+11/07/2021 02:26:00 - INFO - __main__ - Step 36940: {'lr': 0.0004343388523095, 'samples': 7092480, 'steps': 36939, 'loss/train': 0.7859086394309998}76}}}
+11/07/2021 02:26:02 - INFO - __main__ - Step 36944: {'lr': 0.0004343245127157456, 'samples': 7093248, 'steps': 36943, 'loss/train': 1.1533764600753784}}}
+11/07/2021 02:26:05 - INFO - __main__ - Step 36949: {'lr': 0.0004343065863548548, 'samples': 7094208, 'steps': 36948, 'loss/train': 1.6003363132476807}}}
+11/07/2021 02:26:07 - INFO - __main__ - Step 36953: {'lr': 0.00043429224377130964, 'samples': 7094976, 'steps': 36952, 'loss/train': 1.239585041999817}}}
+11/07/2021 02:26:09 - INFO - __main__ - Step 36957: {'lr': 0.00043427789985913675, 'samples': 7095744, 'steps': 36956, 'loss/train': 1.3179750442504883}}
+11/07/2021 02:26:11 - INFO - __main__ - Step 36961: {'lr': 0.00043426355461843934, 'samples': 7096512, 'steps': 36960, 'loss/train': 1.260001540184021}}}
+11/07/2021 02:26:13 - INFO - __main__ - Step 36965: {'lr': 0.000434249208049321, 'samples': 7097280, 'steps': 36964, 'loss/train': 1.5644744634628296}}}}
+11/07/2021 02:26:15 - INFO - __main__ - Step 36970: {'lr': 0.00043423127296998845, 'samples': 7098240, 'steps': 36969, 'loss/train': 1.783840298652649}}}
+11/07/2021 02:26:17 - INFO - __main__ - Step 36974: {'lr': 0.0004342169234123009, 'samples': 7099008, 'steps': 36973, 'loss/train': 1.6480128765106201}}}
+11/07/2021 02:26:19 - INFO - __main__ - Step 36978: {'lr': 0.0004342025725265285, 'samples': 7099776, 'steps': 36977, 'loss/train': 1.5415979623794556}}}
+11/07/2021 02:26:19 - INFO - __main__ - Step 36978: {'lr': 0.0004342025725265285, 'samples': 7099776, 'steps': 36977, 'loss/train': 1.5415979623794556}}}
+11/07/2021 02:26:22 - INFO - __main__ - Step 36985: {'lr': 0.0004341774552810339, 'samples': 7101120, 'steps': 36984, 'loss/train': 0.09527873247861862}}
+11/07/2021 02:26:25 - INFO - __main__ - Step 36991: {'lr': 0.00043415592297693276, 'samples': 7102272, 'steps': 36990, 'loss/train': 1.5589598417282104}}
+11/07/2021 02:26:27 - INFO - __main__ - Step 36995: {'lr': 0.0004341415664479541, 'samples': 7103040, 'steps': 36994, 'loss/train': 1.4736157655715942}}}
+11/07/2021 02:26:27 - INFO - __main__ - Step 36995: {'lr': 0.0004341415664479541, 'samples': 7103040, 'steps': 36994, 'loss/train': 1.4736157655715942}}}
+11/07/2021 02:26:31 - INFO - __main__ - Step 37002: {'lr': 0.00043411643932790686, 'samples': 7104384, 'steps': 37001, 'loss/train': 0.5130859613418579}}
+11/07/2021 02:26:33 - INFO - __main__ - Step 37006: {'lr': 0.000434102079148438, 'samples': 7105152, 'steps': 37005, 'loss/train': 1.5979087352752686}9}}
+11/07/2021 02:26:35 - INFO - __main__ - Step 37012: {'lr': 0.0004340805363906603, 'samples': 7106304, 'steps': 37011, 'loss/train': 1.3931164741516113}}}
+11/07/2021 02:26:35 - INFO - __main__ - Step 37012: {'lr': 0.0004340805363906603, 'samples': 7106304, 'steps': 37011, 'loss/train': 1.3931164741516113}}}
+11/07/2021 02:26:39 - INFO - __main__ - Step 37019: {'lr': 0.0004340553993993325, 'samples': 7107648, 'steps': 37018, 'loss/train': 1.8460217714309692}}}
+11/07/2021 02:26:41 - INFO - __main__ - Step 37023: {'lr': 0.00043404103357973684, 'samples': 7108416, 'steps': 37022, 'loss/train': 1.1846529245376587}}
+11/07/2021 02:26:43 - INFO - __main__ - Step 37027: {'lr': 0.00043402666643332444, 'samples': 7109184, 'steps': 37026, 'loss/train': 1.3075718879699707}}
+11/07/2021 02:26:45 - INFO - __main__ - Step 37031: {'lr': 0.0004340122979601989, 'samples': 7109952, 'steps': 37030, 'loss/train': 1.4986871480941772}}}
+11/07/2021 02:26:45 - INFO - __main__ - Step 37031: {'lr': 0.0004340122979601989, 'samples': 7109952, 'steps': 37030, 'loss/train': 1.4986871480941772}}}
+11/07/2021 02:26:48 - INFO - __main__ - Step 37038: {'lr': 0.00043398714994013696, 'samples': 7111296, 'steps': 37037, 'loss/train': 1.315832257270813}}}
+11/07/2021 02:26:50 - INFO - __main__ - Step 37042: {'lr': 0.0004339727778190842, 'samples': 7112064, 'steps': 37041, 'loss/train': 1.5488569736480713}}}
+11/07/2021 02:26:53 - INFO - __main__ - Step 37047: {'lr': 0.00043395481080263614, 'samples': 7113024, 'steps': 37046, 'loss/train': 1.3028538227081299}}
+11/07/2021 02:26:55 - INFO - __main__ - Step 37051: {'lr': 0.00043394043569749843, 'samples': 7113792, 'steps': 37050, 'loss/train': 1.555881381034851}}}
+11/07/2021 02:26:55 - INFO - __main__ - Step 37051: {'lr': 0.00043394043569749843, 'samples': 7113792, 'steps': 37050, 'loss/train': 1.555881381034851}}}
+11/07/2021 02:26:59 - INFO - __main__ - Step 37058: {'lr': 0.000433915276072662, 'samples': 7115136, 'steps': 37057, 'loss/train': 1.7411218881607056}}}}
+11/07/2021 02:26:59 - INFO - __main__ - Step 37058: {'lr': 0.000433915276072662, 'samples': 7115136, 'steps': 37057, 'loss/train': 1.7411218881607056}}}}
+11/07/2021 02:27:03 - INFO - __main__ - Step 37066: {'lr': 0.0004338865172435754, 'samples': 7116672, 'steps': 37065, 'loss/train': 1.5191227197647095}}}
+11/07/2021 02:27:04 - INFO - __main__ - Step 37070: {'lr': 0.000433872135840426, 'samples': 7117440, 'steps': 37069, 'loss/train': 0.9483161568641663}}}}
+11/07/2021 02:27:06 - INFO - __main__ - Step 37074: {'lr': 0.00043385775311167746, 'samples': 7118208, 'steps': 37073, 'loss/train': 1.103857398033142}}}
+11/07/2021 02:27:09 - INFO - __main__ - Step 37079: {'lr': 0.0004338397728367759, 'samples': 7119168, 'steps': 37078, 'loss/train': 1.6730190515518188}}}
+11/07/2021 02:27:09 - INFO - __main__ - Step 37079: {'lr': 0.0004338397728367759, 'samples': 7119168, 'steps': 37078, 'loss/train': 1.6730190515518188}}}
+11/07/2021 02:27:13 - INFO - __main__ - Step 37087: {'lr': 0.0004338110000895787, 'samples': 7120704, 'steps': 37086, 'loss/train': 1.9725539684295654}}}
+11/07/2021 02:27:14 - INFO - __main__ - Step 37091: {'lr': 0.00043379661172819075, 'samples': 7121472, 'steps': 37090, 'loss/train': 1.3050607442855835}}
+11/07/2021 02:27:17 - INFO - __main__ - Step 37095: {'lr': 0.00043378222204174807, 'samples': 7122240, 'steps': 37094, 'loss/train': 1.6674373149871826}}
+11/07/2021 02:27:19 - INFO - __main__ - Step 37100: {'lr': 0.00043376423307049455, 'samples': 7123200, 'steps': 37099, 'loss/train': 0.8144013285636902}}
+11/07/2021 02:27:21 - INFO - __main__ - Step 37105: {'lr': 0.00043374624202920786, 'samples': 7124160, 'steps': 37104, 'loss/train': 1.4684909582138062}}
+11/07/2021 02:27:21 - INFO - __main__ - Step 37105: {'lr': 0.00043374624202920786, 'samples': 7124160, 'steps': 37104, 'loss/train': 1.4684909582138062}}
+11/07/2021 02:27:24 - INFO - __main__ - Step 37112: {'lr': 0.0004337210510941366, 'samples': 7125504, 'steps': 37111, 'loss/train': 1.1224045753479004}}}
+11/07/2021 02:27:27 - INFO - __main__ - Step 37116: {'lr': 0.0004337066544528591, 'samples': 7126272, 'steps': 37115, 'loss/train': 0.6512836217880249}}}
+11/07/2021 02:27:29 - INFO - __main__ - Step 37121: {'lr': 0.00043368865678882824, 'samples': 7127232, 'steps': 37120, 'loss/train': 1.4385783672332764}}
+11/07/2021 02:27:29 - INFO - __main__ - Step 37121: {'lr': 0.00043368865678882824, 'samples': 7127232, 'steps': 37120, 'loss/train': 1.4385783672332764}}
+11/07/2021 02:27:29 - INFO - __main__ - Step 37121: {'lr': 0.00043368865678882824, 'samples': 7127232, 'steps': 37120, 'loss/train': 1.4385783672332764}}
+11/07/2021 02:27:34 - INFO - __main__ - Step 37132: {'lr': 0.00043364905464472563, 'samples': 7129344, 'steps': 37131, 'loss/train': 1.628318428993225}}}
+11/07/2021 02:27:37 - INFO - __main__ - Step 37137: {'lr': 0.0004336310503600266, 'samples': 7130304, 'steps': 37136, 'loss/train': 1.0943663120269775}}}
+11/07/2021 02:27:37 - INFO - __main__ - Step 37137: {'lr': 0.0004336310503600266, 'samples': 7130304, 'steps': 37136, 'loss/train': 1.0943663120269775}}}
+11/07/2021 02:27:41 - INFO - __main__ - Step 37145: {'lr': 0.0004336022392020439, 'samples': 7131840, 'steps': 37144, 'loss/train': 1.4522278308868408}}}
+11/07/2021 02:27:43 - INFO - __main__ - Step 37149: {'lr': 0.0004335878316375206, 'samples': 7132608, 'steps': 37148, 'loss/train': 1.4561712741851807}}}
+11/07/2021 02:27:45 - INFO - __main__ - Step 37153: {'lr': 0.0004335734227494478, 'samples': 7133376, 'steps': 37152, 'loss/train': 1.6425676345825195}}}
+11/07/2021 02:27:47 - INFO - __main__ - Step 37157: {'lr': 0.0004335590125379293, 'samples': 7134144, 'steps': 37156, 'loss/train': 1.66996169090271}5}}}
+11/07/2021 02:27:49 - INFO - __main__ - Step 37162: {'lr': 0.00043354099791259414, 'samples': 7135104, 'steps': 37161, 'loss/train': 0.9119004011154175}}
+11/07/2021 02:27:51 - INFO - __main__ - Step 37166: {'lr': 0.00043352658472370294, 'samples': 7135872, 'steps': 37165, 'loss/train': 1.2007473707199097}}
+11/07/2021 02:27:53 - INFO - __main__ - Step 37170: {'lr': 0.0004335121702117038, 'samples': 7136640, 'steps': 37169, 'loss/train': 1.431115746498108}7}}
+11/07/2021 02:27:55 - INFO - __main__ - Step 37174: {'lr': 0.00043349775437670046, 'samples': 7137408, 'steps': 37173, 'loss/train': 0.5817450881004333}}
+11/07/2021 02:27:57 - INFO - __main__ - Step 37178: {'lr': 0.0004334833372187972, 'samples': 7138176, 'steps': 37177, 'loss/train': 1.3863235712051392}}}
+11/07/2021 02:27:59 - INFO - __main__ - Step 37183: {'lr': 0.0004334653139112481, 'samples': 7139136, 'steps': 37182, 'loss/train': 1.3545410633087158}}}
+11/07/2021 02:27:59 - INFO - __main__ - Step 37183: {'lr': 0.0004334653139112481, 'samples': 7139136, 'steps': 37182, 'loss/train': 1.3545410633087158}}}
+11/07/2021 02:28:03 - INFO - __main__ - Step 37190: {'lr': 0.000433440077808726, 'samples': 7140480, 'steps': 37189, 'loss/train': 1.7172496318817139}}}}
+11/07/2021 02:28:05 - INFO - __main__ - Step 37195: {'lr': 0.00043342204954151963, 'samples': 7141440, 'steps': 37194, 'loss/train': 1.5363059043884277}}
+11/07/2021 02:28:08 - INFO - __main__ - Step 37200: {'lr': 0.0004334040192081347, 'samples': 7142400, 'steps': 37199, 'loss/train': 1.625350832939148}7}}
+11/07/2021 02:28:10 - INFO - __main__ - Step 37204: {'lr': 0.0004333895934539146, 'samples': 7143168, 'steps': 37203, 'loss/train': 1.299027442932129}7}}
+11/07/2021 02:28:12 - INFO - __main__ - Step 37208: {'lr': 0.00043337516637757416, 'samples': 7143936, 'steps': 37207, 'loss/train': 1.1694921255111694}}
+11/07/2021 02:28:12 - INFO - __main__ - Step 37208: {'lr': 0.00043337516637757416, 'samples': 7143936, 'steps': 37207, 'loss/train': 1.1694921255111694}}
+11/07/2021 02:28:15 - INFO - __main__ - Step 37215: {'lr': 0.00043334991581293924, 'samples': 7145280, 'steps': 37214, 'loss/train': 1.2101293802261353}}
+11/07/2021 02:28:17 - INFO - __main__ - Step 37220: {'lr': 0.00043333187721687104, 'samples': 7146240, 'steps': 37219, 'loss/train': 1.8787128925323486}}
+11/07/2021 02:28:20 - INFO - __main__ - Step 37225: {'lr': 0.00043331383655564003, 'samples': 7147200, 'steps': 37224, 'loss/train': 1.7596057653427124}}
+11/07/2021 02:28:20 - INFO - __main__ - Step 37225: {'lr': 0.00043331383655564003, 'samples': 7147200, 'steps': 37224, 'loss/train': 1.7596057653427124}}
+11/07/2021 02:28:23 - INFO - __main__ - Step 37232: {'lr': 0.00043328857616082986, 'samples': 7148544, 'steps': 37231, 'loss/train': 1.354921579360962}}}
+11/07/2021 02:28:25 - INFO - __main__ - Step 37236: {'lr': 0.0004332741398325599, 'samples': 7149312, 'steps': 37235, 'loss/train': 1.7749427556991577}}}
+11/07/2021 02:28:27 - INFO - __main__ - Step 37240: {'lr': 0.000433259702183002, 'samples': 7150080, 'steps': 37239, 'loss/train': 1.4372882843017578}}}}
+11/07/2021 02:28:29 - INFO - __main__ - Step 37244: {'lr': 0.0004332452632122601, 'samples': 7150848, 'steps': 37243, 'loss/train': 1.967123031616211}}}}
+11/07/2021 02:28:31 - INFO - __main__ - Step 37248: {'lr': 0.0004332308229204385, 'samples': 7151616, 'steps': 37247, 'loss/train': 1.775602102279663}}}}
+11/07/2021 02:28:33 - INFO - __main__ - Step 37252: {'lr': 0.00043321638130764116, 'samples': 7152384, 'steps': 37251, 'loss/train': 1.5859137773513794}}
+11/07/2021 02:28:35 - INFO - __main__ - Step 37257: {'lr': 0.000433198327434181, 'samples': 7153344, 'steps': 37256, 'loss/train': 1.7939229011535645}4}}
+11/07/2021 02:28:38 - INFO - __main__ - Step 37262: {'lr': 0.0004331802714970624, 'samples': 7154304, 'steps': 37261, 'loss/train': 1.487119197845459}4}}
+11/07/2021 02:28:40 - INFO - __main__ - Step 37266: {'lr': 0.00043316582526167004, 'samples': 7155072, 'steps': 37265, 'loss/train': 1.634678602218628}}}
+11/07/2021 02:28:42 - INFO - __main__ - Step 37270: {'lr': 0.0004331513777057706, 'samples': 7155840, 'steps': 37269, 'loss/train': 1.3365075588226318}}}
+11/07/2021 02:28:44 - INFO - __main__ - Step 37274: {'lr': 0.0004331369288294681, 'samples': 7156608, 'steps': 37273, 'loss/train': 1.0709071159362793}}}
+11/07/2021 02:28:45 - INFO - __main__ - Step 37278: {'lr': 0.000433122478632867, 'samples': 7157376, 'steps': 37277, 'loss/train': 0.8798840641975403}}}}
+11/07/2021 02:28:45 - INFO - __main__ - Step 37278: {'lr': 0.000433122478632867, 'samples': 7157376, 'steps': 37277, 'loss/train': 0.8798840641975403}}}}
+11/07/2021 02:28:50 - INFO - __main__ - Step 37286: {'lr': 0.0004330935742791849, 'samples': 7158912, 'steps': 37285, 'loss/train': 1.4151886701583862}}}
+11/07/2021 02:28:50 - INFO - __main__ - Step 37286: {'lr': 0.0004330935742791849, 'samples': 7158912, 'steps': 37285, 'loss/train': 1.4151886701583862}}}
+11/07/2021 02:28:53 - INFO - __main__ - Step 37293: {'lr': 0.00043306827863847985, 'samples': 7160256, 'steps': 37292, 'loss/train': 1.3688923120498657}}
+11/07/2021 02:28:55 - INFO - __main__ - Step 37298: {'lr': 0.0004330502078490258, 'samples': 7161216, 'steps': 37297, 'loss/train': 1.2880827188491821}}}
+11/07/2021 02:28:55 - INFO - __main__ - Step 37298: {'lr': 0.0004330502078490258, 'samples': 7161216, 'steps': 37297, 'loss/train': 1.2880827188491821}}}
+11/07/2021 02:28:59 - INFO - __main__ - Step 37306: {'lr': 0.0004330212902970447, 'samples': 7162752, 'steps': 37305, 'loss/train': 1.4084619283676147}}}
+11/07/2021 02:29:01 - INFO - __main__ - Step 37310: {'lr': 0.0004330068295418044, 'samples': 7163520, 'steps': 37309, 'loss/train': 1.5030561685562134}}}
+11/07/2021 02:29:03 - INFO - __main__ - Step 37314: {'lr': 0.0004329923674672032, 'samples': 7164288, 'steps': 37313, 'loss/train': 1.4974441528320312}}}
+11/07/2021 02:29:05 - INFO - __main__ - Step 37319: {'lr': 0.0004329742880187594, 'samples': 7165248, 'steps': 37318, 'loss/train': 1.1523969173431396}}}
+11/07/2021 02:29:05 - INFO - __main__ - Step 37319: {'lr': 0.0004329742880187594, 'samples': 7165248, 'steps': 37318, 'loss/train': 1.1523969173431396}}}
+11/07/2021 02:29:09 - INFO - __main__ - Step 37327: {'lr': 0.0004329453566141737, 'samples': 7166784, 'steps': 37326, 'loss/train': 1.637865424156189}}}}
+11/07/2021 02:29:11 - INFO - __main__ - Step 37331: {'lr': 0.0004329308889334522, 'samples': 7167552, 'steps': 37330, 'loss/train': 1.1413021087646484}}}
+11/07/2021 02:29:13 - INFO - __main__ - Step 37335: {'lr': 0.00043291641993391727, 'samples': 7168320, 'steps': 37334, 'loss/train': 1.5530239343643188}}
+11/07/2021 02:29:15 - INFO - __main__ - Step 37340: {'lr': 0.0004328983318300763, 'samples': 7169280, 'steps': 37339, 'loss/train': 1.6685435771942139}}}
+11/07/2021 02:29:17 - INFO - __main__ - Step 37344: {'lr': 0.00043288385986359266, 'samples': 7170048, 'steps': 37343, 'loss/train': 1.6947556734085083}}
+11/07/2021 02:29:20 - INFO - __main__ - Step 37348: {'lr': 0.00043286938657863483, 'samples': 7170816, 'steps': 37347, 'loss/train': 1.6188071966171265}}
+11/07/2021 02:29:21 - INFO - __main__ - Step 37352: {'lr': 0.00043285491197530694, 'samples': 7171584, 'steps': 37351, 'loss/train': 0.8640336394309998}}
+11/07/2021 02:29:23 - INFO - __main__ - Step 37356: {'lr': 0.00043284043605371346, 'samples': 7172352, 'steps': 37355, 'loss/train': 1.0829873085021973}}
+11/07/2021 02:29:25 - INFO - __main__ - Step 37361: {'lr': 0.0004328223392980696, 'samples': 7173312, 'steps': 37360, 'loss/train': 1.577709436416626}3}}
+11/07/2021 02:29:28 - INFO - __main__ - Step 37365: {'lr': 0.00043280786041076006, 'samples': 7174080, 'steps': 37364, 'loss/train': 0.9891050457954407}}
+11/07/2021 02:29:30 - INFO - __main__ - Step 37369: {'lr': 0.0004327933802055241, 'samples': 7174848, 'steps': 37368, 'loss/train': 1.428175449371338}7}}
+11/07/2021 02:29:32 - INFO - __main__ - Step 37373: {'lr': 0.00043277889868246605, 'samples': 7175616, 'steps': 37372, 'loss/train': 1.78399658203125}7}}
+11/07/2021 02:29:33 - INFO - __main__ - Step 37377: {'lr': 0.0004327644158416905, 'samples': 7176384, 'steps': 37376, 'loss/train': 1.8409719467163086}}}
+11/07/2021 02:29:35 - INFO - __main__ - Step 37381: {'lr': 0.0004327499316833016, 'samples': 7177152, 'steps': 37380, 'loss/train': 1.8813824653625488}}}
+11/07/2021 02:29:38 - INFO - __main__ - Step 37386: {'lr': 0.0004327318246325811, 'samples': 7178112, 'steps': 37385, 'loss/train': 1.6646647453308105}}}
+11/07/2021 02:29:38 - INFO - __main__ - Step 37386: {'lr': 0.0004327318246325811, 'samples': 7178112, 'steps': 37385, 'loss/train': 1.6646647453308105}}}
+11/07/2021 02:29:41 - INFO - __main__ - Step 37393: {'lr': 0.0004327064713035002, 'samples': 7179456, 'steps': 37392, 'loss/train': 1.3795374631881714}}}
+11/07/2021 02:29:43 - INFO - __main__ - Step 37397: {'lr': 0.0004326919818757028, 'samples': 7180224, 'steps': 37396, 'loss/train': 0.8401727676391602}}}
+11/07/2021 02:29:45 - INFO - __main__ - Step 37402: {'lr': 0.00043267386823880904, 'samples': 7181184, 'steps': 37401, 'loss/train': 1.6912891864776611}}
+11/07/2021 02:29:45 - INFO - __main__ - Step 37402: {'lr': 0.00043267386823880904, 'samples': 7181184, 'steps': 37401, 'loss/train': 1.6912891864776611}}
+11/07/2021 02:29:45 - INFO - __main__ - Step 37402: {'lr': 0.00043267386823880904, 'samples': 7181184, 'steps': 37401, 'loss/train': 1.6912891864776611}}
+11/07/2021 02:29:51 - INFO - __main__ - Step 37413: {'lr': 0.00043263401099464805, 'samples': 7183296, 'steps': 37412, 'loss/train': 3.1627933979034424}}
+11/07/2021 02:29:54 - INFO - __main__ - Step 37418: {'lr': 0.0004326158907736706, 'samples': 7184256, 'steps': 37417, 'loss/train': 1.6083804368972778}}}
+11/07/2021 02:29:56 - INFO - __main__ - Step 37422: {'lr': 0.00043260139311576863, 'samples': 7185024, 'steps': 37421, 'loss/train': 2.185137987136841}}}
+11/07/2021 02:29:56 - INFO - __main__ - Step 37422: {'lr': 0.00043260139311576863, 'samples': 7185024, 'steps': 37421, 'loss/train': 2.185137987136841}}}
+11/07/2021 02:29:59 - INFO - __main__ - Step 37429: {'lr': 0.0004325760190468243, 'samples': 7186368, 'steps': 37428, 'loss/train': 1.5231657028198242}}}
+11/07/2021 02:30:02 - INFO - __main__ - Step 37435: {'lr': 0.0004325542666364793, 'samples': 7187520, 'steps': 37434, 'loss/train': 1.3707133531570435}}}
+11/07/2021 02:30:04 - INFO - __main__ - Step 37439: {'lr': 0.00043253976338443814, 'samples': 7188288, 'steps': 37438, 'loss/train': 0.7496334314346313}}
+11/07/2021 02:30:06 - INFO - __main__ - Step 37443: {'lr': 0.0004325252588164033, 'samples': 7189056, 'steps': 37442, 'loss/train': 1.2332797050476074}}}
+11/07/2021 02:30:06 - INFO - __main__ - Step 37443: {'lr': 0.0004325252588164033, 'samples': 7189056, 'steps': 37442, 'loss/train': 1.2332797050476074}}}
+11/07/2021 02:30:09 - INFO - __main__ - Step 37450: {'lr': 0.0004324998726560473, 'samples': 7190400, 'steps': 37449, 'loss/train': 1.1127818822860718}}}
+11/07/2021 02:30:12 - INFO - __main__ - Step 37456: {'lr': 0.0004324781098829732, 'samples': 7191552, 'steps': 37455, 'loss/train': 1.2282586097717285}}}
+11/07/2021 02:30:12 - INFO - __main__ - Step 37456: {'lr': 0.0004324781098829732, 'samples': 7191552, 'steps': 37455, 'loss/train': 1.2282586097717285}}}
+11/07/2021 02:30:16 - INFO - __main__ - Step 37463: {'lr': 0.0004324527162399854, 'samples': 7192896, 'steps': 37462, 'loss/train': 1.5770810842514038}}}
+11/07/2021 02:30:17 - INFO - __main__ - Step 37467: {'lr': 0.00043243820377818524, 'samples': 7193664, 'steps': 37466, 'loss/train': 1.4279179573059082}}
+11/07/2021 02:30:20 - INFO - __main__ - Step 37471: {'lr': 0.00043242369000112365, 'samples': 7194432, 'steps': 37470, 'loss/train': 1.961127519607544}}}
+11/07/2021 02:30:22 - INFO - __main__ - Step 37475: {'lr': 0.0004324091749089052, 'samples': 7195200, 'steps': 37474, 'loss/train': 1.4887938499450684}}}
+11/07/2021 02:30:23 - INFO - __main__ - Step 37479: {'lr': 0.0004323946585016347, 'samples': 7195968, 'steps': 37478, 'loss/train': 1.6027249097824097}}}
+11/07/2021 02:30:25 - INFO - __main__ - Step 37483: {'lr': 0.00043238014077941656, 'samples': 7196736, 'steps': 37482, 'loss/train': 1.6039621829986572}}
+11/07/2021 02:30:28 - INFO - __main__ - Step 37488: {'lr': 0.00043236199177765856, 'samples': 7197696, 'steps': 37487, 'loss/train': 1.7081737518310547}}
+11/07/2021 02:30:30 - INFO - __main__ - Step 37493: {'lr': 0.0004323438407216631, 'samples': 7198656, 'steps': 37492, 'loss/train': 1.6030843257904053}}}
+11/07/2021 02:30:30 - INFO - __main__ - Step 37493: {'lr': 0.0004323438407216631, 'samples': 7198656, 'steps': 37492, 'loss/train': 1.6030843257904053}}}
+11/07/2021 02:30:34 - INFO - __main__ - Step 37500: {'lr': 0.0004323184257925397, 'samples': 7200000, 'steps': 37499, 'loss/train': 1.5604526996612549}}}
+11/07/2021 02:30:35 - INFO - __main__ - Step 37504: {'lr': 0.00043230390116856467, 'samples': 7200768, 'steps': 37503, 'loss/train': 0.5808529257774353}}
+11/07/2021 02:30:38 - INFO - __main__ - Step 37509: {'lr': 0.00043228574354038326, 'samples': 7201728, 'steps': 37508, 'loss/train': 1.5501351356506348}}
+11/07/2021 02:30:40 - INFO - __main__ - Step 37514: {'lr': 0.0004322675838588234, 'samples': 7202688, 'steps': 37513, 'loss/train': 1.200168490409851}8}}
+11/07/2021 02:30:42 - INFO - __main__ - Step 37518: {'lr': 0.0004322530546352803, 'samples': 7203456, 'steps': 37517, 'loss/train': 1.74091374874115}}8}}
+11/07/2021 02:30:42 - INFO - __main__ - Step 37518: {'lr': 0.0004322530546352803, 'samples': 7203456, 'steps': 37517, 'loss/train': 1.74091374874115}}8}}
+11/07/2021 02:30:46 - INFO - __main__ - Step 37525: {'lr': 0.000432227625332507, 'samples': 7204800, 'steps': 37524, 'loss/train': 0.7475195527076721}8}}
+11/07/2021 02:30:48 - INFO - __main__ - Step 37529: {'lr': 0.0004322130924959178, 'samples': 7205568, 'steps': 37528, 'loss/train': 1.5095049142837524}}}
+11/07/2021 02:30:48 - INFO - __main__ - Step 37529: {'lr': 0.0004322130924959178, 'samples': 7205568, 'steps': 37528, 'loss/train': 1.5095049142837524}}}
+11/07/2021 02:30:52 - INFO - __main__ - Step 37537: {'lr': 0.0004321840228819286, 'samples': 7207104, 'steps': 37536, 'loss/train': 1.0783336162567139}}}
+11/07/2021 02:30:54 - INFO - __main__ - Step 37541: {'lr': 0.00043216948610473816, 'samples': 7207872, 'steps': 37540, 'loss/train': 1.5212979316711426}}
+11/07/2021 02:30:56 - INFO - __main__ - Step 37546: {'lr': 0.0004321513132864003, 'samples': 7208832, 'steps': 37545, 'loss/train': 1.4994314908981323}}}
+11/07/2021 02:30:58 - INFO - __main__ - Step 37550: {'lr': 0.00043213677355437795, 'samples': 7209600, 'steps': 37549, 'loss/train': 1.087836742401123}}}
+11/07/2021 02:30:58 - INFO - __main__ - Step 37550: {'lr': 0.00043213677355437795, 'samples': 7209600, 'steps': 37549, 'loss/train': 1.087836742401123}}}
+11/07/2021 02:31:02 - INFO - __main__ - Step 37557: {'lr': 0.0004321113258637832, 'samples': 7210944, 'steps': 37556, 'loss/train': 1.3894625902175903}}}
+11/07/2021 02:31:04 - INFO - __main__ - Step 37562: {'lr': 0.00043209314648020035, 'samples': 7211904, 'steps': 37561, 'loss/train': 1.5488879680633545}}
+11/07/2021 02:31:04 - INFO - __main__ - Step 37562: {'lr': 0.00043209314648020035, 'samples': 7211904, 'steps': 37561, 'loss/train': 1.5488879680633545}}
+11/07/2021 02:31:08 - INFO - __main__ - Step 37570: {'lr': 0.00043206405520003824, 'samples': 7213440, 'steps': 37569, 'loss/train': 1.5961387157440186}}
+11/07/2021 02:31:10 - INFO - __main__ - Step 37574: {'lr': 0.00043204950759105865, 'samples': 7214208, 'steps': 37573, 'loss/train': 0.9354721903800964}}
+11/07/2021 02:31:12 - INFO - __main__ - Step 37578: {'lr': 0.00043203495866961996, 'samples': 7214976, 'steps': 37577, 'loss/train': 1.2092102766036987}}
+11/07/2021 02:31:14 - INFO - __main__ - Step 37583: {'lr': 0.00043201677067233554, 'samples': 7215936, 'steps': 37582, 'loss/train': 2.1765105724334717}}
+11/07/2021 02:31:16 - INFO - __main__ - Step 37587: {'lr': 0.00043200221879824706, 'samples': 7216704, 'steps': 37586, 'loss/train': 1.7899430990219116}}
+11/07/2021 02:31:18 - INFO - __main__ - Step 37591: {'lr': 0.00043198766561204047, 'samples': 7217472, 'steps': 37590, 'loss/train': 1.7535258531570435}}
+11/07/2021 02:31:20 - INFO - __main__ - Step 37595: {'lr': 0.00043197311111382045, 'samples': 7218240, 'steps': 37594, 'loss/train': 1.6020832061767578}}
+11/07/2021 02:31:22 - INFO - __main__ - Step 37599: {'lr': 0.000431958555303692, 'samples': 7219008, 'steps': 37598, 'loss/train': 1.4375860691070557}8}}
+11/07/2021 02:31:22 - INFO - __main__ - Step 37599: {'lr': 0.000431958555303692, 'samples': 7219008, 'steps': 37598, 'loss/train': 1.4375860691070557}8}}
+11/07/2021 02:31:22 - INFO - __main__ - Step 37599: {'lr': 0.000431958555303692, 'samples': 7219008, 'steps': 37598, 'loss/train': 1.4375860691070557}8}}
+11/07/2021 02:31:28 - INFO - __main__ - Step 37610: {'lr': 0.0004319185200621678, 'samples': 7221120, 'steps': 37609, 'loss/train': 0.6669997572898865}}}
+11/07/2021 02:31:30 - INFO - __main__ - Step 37615: {'lr': 0.00043190031894619306, 'samples': 7222080, 'steps': 37614, 'loss/train': 1.7094345092773438}}
+11/07/2021 02:31:33 - INFO - __main__ - Step 37619: {'lr': 0.00043188575657809685, 'samples': 7222848, 'steps': 37618, 'loss/train': 1.844686508178711}}}
+11/07/2021 02:31:33 - INFO - __main__ - Step 37619: {'lr': 0.00043188575657809685, 'samples': 7222848, 'steps': 37618, 'loss/train': 1.844686508178711}}}
+11/07/2021 02:31:36 - INFO - __main__ - Step 37626: {'lr': 0.00043186026927872736, 'samples': 7224192, 'steps': 37625, 'loss/train': 1.1585700511932373}}
+11/07/2021 02:31:39 - INFO - __main__ - Step 37632: {'lr': 0.0004318384198263099, 'samples': 7225344, 'steps': 37631, 'loss/train': 1.4363213777542114}}}
+11/07/2021 02:31:39 - INFO - __main__ - Step 37632: {'lr': 0.0004318384198263099, 'samples': 7225344, 'steps': 37631, 'loss/train': 1.4363213777542114}}}
+11/07/2021 02:31:42 - INFO - __main__ - Step 37639: {'lr': 0.0004318129250705361, 'samples': 7226688, 'steps': 37638, 'loss/train': 1.8374136686325073}}}
+11/07/2021 02:31:44 - INFO - __main__ - Step 37643: {'lr': 0.0004317983548363431, 'samples': 7227456, 'steps': 37642, 'loss/train': 1.6383424997329712}}}
+11/07/2021 02:31:46 - INFO - __main__ - Step 37647: {'lr': 0.0004317837832915016, 'samples': 7228224, 'steps': 37646, 'loss/train': 1.8266150951385498}}}
+11/07/2021 02:31:48 - INFO - __main__ - Step 37652: {'lr': 0.0004317655670175102, 'samples': 7229184, 'steps': 37651, 'loss/train': 1.1823043823242188}}}
+11/07/2021 02:31:48 - INFO - __main__ - Step 37652: {'lr': 0.0004317655670175102, 'samples': 7229184, 'steps': 37651, 'loss/train': 1.1823043823242188}}}
+11/07/2021 02:31:51 - INFO - __main__ - Step 37659: {'lr': 0.0004317400607941364, 'samples': 7230528, 'steps': 37658, 'loss/train': 1.5288509130477905}}}
+11/07/2021 02:31:54 - INFO - __main__ - Step 37663: {'lr': 0.0004317254840077514, 'samples': 7231296, 'steps': 37662, 'loss/train': 1.6886277198791504}}}
+11/07/2021 02:31:56 - INFO - __main__ - Step 37668: {'lr': 0.00043170726118242164, 'samples': 7232256, 'steps': 37667, 'loss/train': 2.937180280685425}}}
+11/07/2021 02:31:58 - INFO - __main__ - Step 37673: {'lr': 0.0004316890363102298, 'samples': 7233216, 'steps': 37672, 'loss/train': 1.3016736507415771}}}
+11/07/2021 02:31:58 - INFO - __main__ - Step 37673: {'lr': 0.0004316890363102298, 'samples': 7233216, 'steps': 37672, 'loss/train': 1.3016736507415771}}}
+11/07/2021 02:32:02 - INFO - __main__ - Step 37680: {'lr': 0.0004316635180508235, 'samples': 7234560, 'steps': 37679, 'loss/train': 1.6097488403320312}}}
+11/07/2021 02:32:04 - INFO - __main__ - Step 37684: {'lr': 0.0004316489343874644, 'samples': 7235328, 'steps': 37683, 'loss/train': 1.3470348119735718}}}
+11/07/2021 02:32:06 - INFO - __main__ - Step 37689: {'lr': 0.00043163070296669317, 'samples': 7236288, 'steps': 37688, 'loss/train': 1.1718648672103882}}
+11/07/2021 02:32:08 - INFO - __main__ - Step 37694: {'lr': 0.0004316124694999222, 'samples': 7237248, 'steps': 37693, 'loss/train': 1.347544550895691}2}}
+11/07/2021 02:32:10 - INFO - __main__ - Step 37698: {'lr': 0.00043159788125352353, 'samples': 7238016, 'steps': 37697, 'loss/train': 1.798108458518982}}}
+11/07/2021 02:32:10 - INFO - __main__ - Step 37698: {'lr': 0.00043159788125352353, 'samples': 7238016, 'steps': 37697, 'loss/train': 1.798108458518982}}}
+11/07/2021 02:32:14 - INFO - __main__ - Step 37705: {'lr': 0.0004315723486721188, 'samples': 7239360, 'steps': 37704, 'loss/train': 0.9939437508583069}}}
+11/07/2021 02:32:16 - INFO - __main__ - Step 37710: {'lr': 0.0004315541086595288, 'samples': 7240320, 'steps': 37709, 'loss/train': 1.5813043117523193}}}
+11/07/2021 02:32:18 - INFO - __main__ - Step 37714: {'lr': 0.00043153951517694824, 'samples': 7241088, 'steps': 37713, 'loss/train': 1.300570011138916}}}
+11/07/2021 02:32:20 - INFO - __main__ - Step 37718: {'lr': 0.00043152492038558526, 'samples': 7241856, 'steps': 37717, 'loss/train': 1.6024607419967651}}
+11/07/2021 02:32:20 - INFO - __main__ - Step 37718: {'lr': 0.00043152492038558526, 'samples': 7241856, 'steps': 37717, 'loss/train': 1.6024607419967651}}
+11/07/2021 02:32:24 - INFO - __main__ - Step 37725: {'lr': 0.00043149937635175874, 'samples': 7243200, 'steps': 37724, 'loss/train': 1.3453290462493896}}
+11/07/2021 02:32:27 - INFO - __main__ - Step 37731: {'lr': 0.0004314774782761484, 'samples': 7244352, 'steps': 37730, 'loss/train': 1.2930500507354736}}}
+11/07/2021 02:32:29 - INFO - __main__ - Step 37735: {'lr': 0.0004314628779236339, 'samples': 7245120, 'steps': 37734, 'loss/train': 1.8617697954177856}}}
+11/07/2021 02:32:31 - INFO - __main__ - Step 37739: {'lr': 0.00043144827626288943, 'samples': 7245888, 'steps': 37738, 'loss/train': 1.5663368701934814}}
+11/07/2021 02:32:32 - INFO - __main__ - Step 37743: {'lr': 0.0004314336732940202, 'samples': 7246656, 'steps': 37742, 'loss/train': 0.8476759195327759}}}
+11/07/2021 02:32:34 - INFO - __main__ - Step 37747: {'lr': 0.0004314190690171317, 'samples': 7247424, 'steps': 37746, 'loss/train': 1.3477909564971924}}}
+11/07/2021 02:32:37 - INFO - __main__ - Step 37752: {'lr': 0.000431400811831779, 'samples': 7248384, 'steps': 37751, 'loss/train': 1.698687195777893}4}}}
+11/07/2021 02:32:37 - INFO - __main__ - Step 37752: {'lr': 0.000431400811831779, 'samples': 7248384, 'steps': 37751, 'loss/train': 1.698687195777893}4}}}
+11/07/2021 02:32:40 - INFO - __main__ - Step 37759: {'lr': 0.00043137524833940233, 'samples': 7249728, 'steps': 37758, 'loss/train': 1.6888084411621094}}
+11/07/2021 02:32:42 - INFO - __main__ - Step 37763: {'lr': 0.00043136063883148905, 'samples': 7250496, 'steps': 37762, 'loss/train': 1.5382124185562134}}
+11/07/2021 02:32:44 - INFO - __main__ - Step 37767: {'lr': 0.00043134602801608293, 'samples': 7251264, 'steps': 37766, 'loss/train': 1.1817660331726074}}
+11/07/2021 02:32:47 - INFO - __main__ - Step 37773: {'lr': 0.000431324109341655, 'samples': 7252416, 'steps': 37772, 'loss/train': 1.9840986728668213}4}}
+11/07/2021 02:32:49 - INFO - __main__ - Step 37777: {'lr': 0.0004313094952579775, 'samples': 7253184, 'steps': 37776, 'loss/train': 1.7181931734085083}}}
+11/07/2021 02:32:49 - INFO - __main__ - Step 37777: {'lr': 0.0004313094952579775, 'samples': 7253184, 'steps': 37776, 'loss/train': 1.7181931734085083}}}
+11/07/2021 02:32:52 - INFO - __main__ - Step 37784: {'lr': 0.0004312839174663377, 'samples': 7254528, 'steps': 37783, 'loss/train': 1.327996850013733}}}}
+11/07/2021 02:32:54 - INFO - __main__ - Step 37788: {'lr': 0.00043126929978832217, 'samples': 7255296, 'steps': 37787, 'loss/train': 1.6394915580749512}}
+11/07/2021 02:32:56 - INFO - __main__ - Step 37793: {'lr': 0.0004312510258530794, 'samples': 7256256, 'steps': 37792, 'loss/train': 1.8957017660140991}}}
+11/07/2021 02:32:56 - INFO - __main__ - Step 37793: {'lr': 0.0004312510258530794, 'samples': 7256256, 'steps': 37792, 'loss/train': 1.8957017660140991}}}
+11/07/2021 02:33:00 - INFO - __main__ - Step 37800: {'lr': 0.0004312254389136911, 'samples': 7257600, 'steps': 37799, 'loss/train': 1.2227293252944946}}}
+11/07/2021 02:33:02 - INFO - __main__ - Step 37804: {'lr': 0.0004312108160089706, 'samples': 7258368, 'steps': 37803, 'loss/train': 1.2928982973098755}}}
+11/07/2021 02:33:05 - INFO - __main__ - Step 37809: {'lr': 0.0004311925355409393, 'samples': 7259328, 'steps': 37808, 'loss/train': 1.3604049682617188}}}
+11/07/2021 02:33:05 - INFO - __main__ - Step 37809: {'lr': 0.0004311925355409393, 'samples': 7259328, 'steps': 37808, 'loss/train': 1.3604049682617188}}}
+11/07/2021 02:33:05 - INFO - __main__ - Step 37809: {'lr': 0.0004311925355409393, 'samples': 7259328, 'steps': 37808, 'loss/train': 1.3604049682617188}}}
+11/07/2021 02:33:11 - INFO - __main__ - Step 37819: {'lr': 0.0004311559684818905, 'samples': 7261248, 'steps': 37818, 'loss/train': 1.7777564525604248}}}
+11/07/2021 02:33:12 - INFO - __main__ - Step 37823: {'lr': 0.00043114133937264843, 'samples': 7262016, 'steps': 37822, 'loss/train': 1.4681305885314941}}
+11/07/2021 02:33:14 - INFO - __main__ - Step 37827: {'lr': 0.0004311267089574944, 'samples': 7262784, 'steps': 37826, 'loss/train': 1.7053385972976685}}}
+11/07/2021 02:33:17 - INFO - __main__ - Step 37832: {'lr': 0.0004311084191022741, 'samples': 7263744, 'steps': 37831, 'loss/train': 1.5728517770767212}}}
+11/07/2021 02:33:19 - INFO - __main__ - Step 37836: {'lr': 0.000431093785749204, 'samples': 7264512, 'steps': 37835, 'loss/train': 1.6409319639205933}}}}
+11/07/2021 02:33:19 - INFO - __main__ - Step 37836: {'lr': 0.000431093785749204, 'samples': 7264512, 'steps': 37835, 'loss/train': 1.6409319639205933}}}}
+11/07/2021 02:33:22 - INFO - __main__ - Step 37843: {'lr': 0.00043106817423986933, 'samples': 7265856, 'steps': 37842, 'loss/train': 1.6606569290161133}}
+11/07/2021 02:33:25 - INFO - __main__ - Step 37848: {'lr': 0.0004310498778570016, 'samples': 7266816, 'steps': 37847, 'loss/train': 1.5267208814620972}}}
+11/07/2021 02:33:25 - INFO - __main__ - Step 37848: {'lr': 0.0004310498778570016, 'samples': 7266816, 'steps': 37847, 'loss/train': 1.5267208814620972}}}
+11/07/2021 02:33:29 - INFO - __main__ - Step 37856: {'lr': 0.00043102059940242825, 'samples': 7268352, 'steps': 37855, 'loss/train': 1.6300129890441895}}
+11/07/2021 02:33:31 - INFO - __main__ - Step 37860: {'lr': 0.00043100595821752674, 'samples': 7269120, 'steps': 37859, 'loss/train': 1.3307468891143799}}
+11/07/2021 02:33:32 - INFO - __main__ - Step 37864: {'lr': 0.00043099131572768936, 'samples': 7269888, 'steps': 37863, 'loss/train': 1.4234338998794556}}
+11/07/2021 02:33:35 - INFO - __main__ - Step 37869: {'lr': 0.00043097301078048736, 'samples': 7270848, 'steps': 37868, 'loss/train': 2.2756893634796143}}
+11/07/2021 02:33:37 - INFO - __main__ - Step 37874: {'lr': 0.0004309547037946941, 'samples': 7271808, 'steps': 37873, 'loss/train': 1.276893138885498}3}}
+11/07/2021 02:33:37 - INFO - __main__ - Step 37874: {'lr': 0.0004309547037946941, 'samples': 7271808, 'steps': 37873, 'loss/train': 1.276893138885498}3}}
+11/07/2021 02:33:41 - INFO - __main__ - Step 37881: {'lr': 0.00043092907059014325, 'samples': 7273152, 'steps': 37880, 'loss/train': 1.5659189224243164}}
+11/07/2021 02:33:42 - INFO - __main__ - Step 37885: {'lr': 0.0004309144212511246, 'samples': 7273920, 'steps': 37884, 'loss/train': 2.258639097213745}4}}
+11/07/2021 02:33:45 - INFO - __main__ - Step 37890: {'lr': 0.00043089610774322575, 'samples': 7274880, 'steps': 37889, 'loss/train': 1.6858359575271606}}
+11/07/2021 02:33:47 - INFO - __main__ - Step 37894: {'lr': 0.0004308814554697348, 'samples': 7275648, 'steps': 37893, 'loss/train': 1.5547536611557007}}}
+11/07/2021 02:33:47 - INFO - __main__ - Step 37894: {'lr': 0.0004308814554697348, 'samples': 7275648, 'steps': 37893, 'loss/train': 1.5547536611557007}}}
+11/07/2021 02:33:50 - INFO - __main__ - Step 37900: {'lr': 0.0004308594746144596, 'samples': 7276800, 'steps': 37899, 'loss/train': 1.532272219657898}}}}
+11/07/2021 02:33:53 - INFO - __main__ - Step 37905: {'lr': 0.00043084115499400505, 'samples': 7277760, 'steps': 37904, 'loss/train': 1.2803417444229126}}
+11/07/2021 02:33:53 - INFO - __main__ - Step 37905: {'lr': 0.00043084115499400505, 'samples': 7277760, 'steps': 37904, 'loss/train': 1.2803417444229126}}
+11/07/2021 02:33:53 - INFO - __main__ - Step 37905: {'lr': 0.00043084115499400505, 'samples': 7277760, 'steps': 37904, 'loss/train': 1.2803417444229126}}
+11/07/2021 02:33:58 - INFO - __main__ - Step 37916: {'lr': 0.00043080084465868307, 'samples': 7279872, 'steps': 37915, 'loss/train': 1.9730298519134521}}
+11/07/2021 02:34:01 - INFO - __main__ - Step 37921: {'lr': 0.00043078251852021634, 'samples': 7280832, 'steps': 37920, 'loss/train': 1.6662101745605469}}
+11/07/2021 02:34:03 - INFO - __main__ - Step 37925: {'lr': 0.00043076785614319234, 'samples': 7281600, 'steps': 37924, 'loss/train': 1.733856201171875}}}
+11/07/2021 02:34:03 - INFO - __main__ - Step 37925: {'lr': 0.00043076785614319234, 'samples': 7281600, 'steps': 37924, 'loss/train': 1.733856201171875}}}
+11/07/2021 02:34:06 - INFO - __main__ - Step 37933: {'lr': 0.0004307385274795923, 'samples': 7283136, 'steps': 37932, 'loss/train': 1.5373013019561768}}}
+11/07/2021 02:34:08 - INFO - __main__ - Step 37937: {'lr': 0.0004307238611932276, 'samples': 7283904, 'steps': 37936, 'loss/train': 1.5360777378082275}}}
+11/07/2021 02:34:08 - INFO - __main__ - Step 37937: {'lr': 0.0004307238611932276, 'samples': 7283904, 'steps': 37936, 'loss/train': 1.5360777378082275}}}
+11/07/2021 02:34:12 - INFO - __main__ - Step 37944: {'lr': 0.0004306981920570447, 'samples': 7285248, 'steps': 37943, 'loss/train': 1.4249544143676758}}}
+11/07/2021 02:34:15 - INFO - __main__ - Step 37949: {'lr': 0.00043067985451714373, 'samples': 7286208, 'steps': 37948, 'loss/train': 1.5056431293487549}}
+11/07/2021 02:34:15 - INFO - __main__ - Step 37949: {'lr': 0.00043067985451714373, 'samples': 7286208, 'steps': 37948, 'loss/train': 1.5056431293487549}}
+11/07/2021 02:34:18 - INFO - __main__ - Step 37956: {'lr': 0.00043065417854204333, 'samples': 7287552, 'steps': 37955, 'loss/train': 1.7715234756469727}}
+11/07/2021 02:34:20 - INFO - __main__ - Step 37960: {'lr': 0.00043063950476543563, 'samples': 7288320, 'steps': 37959, 'loss/train': 2.0494678020477295}}
+11/07/2021 02:34:23 - INFO - __main__ - Step 37965: {'lr': 0.00043062116071333745, 'samples': 7289280, 'steps': 37964, 'loss/train': 1.1325451135635376}}
+11/07/2021 02:34:23 - INFO - __main__ - Step 37965: {'lr': 0.00043062116071333745, 'samples': 7289280, 'steps': 37964, 'loss/train': 1.1325451135635376}}
+11/07/2021 02:34:27 - INFO - __main__ - Step 37972: {'lr': 0.00043059547562227185, 'samples': 7290624, 'steps': 37971, 'loss/train': 1.5636862516403198}}
+11/07/2021 02:34:28 - INFO - __main__ - Step 37976: {'lr': 0.00043058079663712304, 'samples': 7291392, 'steps': 37975, 'loss/train': 1.4831064939498901}}
+11/07/2021 02:34:28 - INFO - __main__ - Step 37976: {'lr': 0.00043058079663712304, 'samples': 7291392, 'steps': 37975, 'loss/train': 1.4831064939498901}}
+11/07/2021 02:34:32 - INFO - __main__ - Step 37983: {'lr': 0.0004305551052805499, 'samples': 7292736, 'steps': 37982, 'loss/train': 1.0468441247940063}}}
+11/07/2021 02:34:35 - INFO - __main__ - Step 37987: {'lr': 0.0004305404227155113, 'samples': 7293504, 'steps': 37986, 'loss/train': 1.0172924995422363}}}
+11/07/2021 02:34:35 - INFO - __main__ - Step 37987: {'lr': 0.0004305404227155113, 'samples': 7293504, 'steps': 37986, 'loss/train': 1.0172924995422363}}}
+11/07/2021 02:34:39 - INFO - __main__ - Step 37995: {'lr': 0.00043051105368080103, 'samples': 7295040, 'steps': 37994, 'loss/train': 1.5717216730117798}}
+11/07/2021 02:34:40 - INFO - __main__ - Step 37999: {'lr': 0.000430496367211341, 'samples': 7295808, 'steps': 37998, 'loss/train': 1.7385200262069702}8}}
+11/07/2021 02:34:42 - INFO - __main__ - Step 38003: {'lr': 0.000430481679440619, 'samples': 7296576, 'steps': 38002, 'loss/train': 0.9746781587600708}8}}
+11/07/2021 02:34:42 - INFO - __main__ - Step 38003: {'lr': 0.000430481679440619, 'samples': 7296576, 'steps': 38002, 'loss/train': 0.9746781587600708}8}}
+11/07/2021 02:34:47 - INFO - __main__ - Step 38011: {'lr': 0.0004304522999958124, 'samples': 7298112, 'steps': 38010, 'loss/train': 2.6189193725585938}}}
+11/07/2021 02:34:48 - INFO - __main__ - Step 38015: {'lr': 0.0004304376083219396, 'samples': 7298880, 'steps': 38014, 'loss/train': 1.4761950969696045}}}
+11/07/2021 02:34:50 - INFO - __main__ - Step 38019: {'lr': 0.0004304229153472283, 'samples': 7299648, 'steps': 38018, 'loss/train': 1.200123906135559}}}}
+11/07/2021 02:34:53 - INFO - __main__ - Step 38024: {'lr': 0.0004304045472996966, 'samples': 7300608, 'steps': 38023, 'loss/train': 1.5964939594268799}}}
+11/07/2021 02:34:55 - INFO - __main__ - Step 38029: {'lr': 0.0004303861772199773, 'samples': 7301568, 'steps': 38028, 'loss/train': 1.200292706489563}}}}
+11/07/2021 02:34:57 - INFO - __main__ - Step 38033: {'lr': 0.0004303714796931658, 'samples': 7302336, 'steps': 38032, 'loss/train': 1.8147969245910645}}}
+11/07/2021 02:34:59 - INFO - __main__ - Step 38037: {'lr': 0.00043035678086599265, 'samples': 7303104, 'steps': 38036, 'loss/train': 1.323421597480774}}}
+11/07/2021 02:35:01 - INFO - __main__ - Step 38041: {'lr': 0.00043034208073856374, 'samples': 7303872, 'steps': 38040, 'loss/train': 1.8999801874160767}}
+11/07/2021 02:35:03 - INFO - __main__ - Step 38045: {'lr': 0.00043032737931098517, 'samples': 7304640, 'steps': 38044, 'loss/train': 1.5681344270706177}}
+11/07/2021 02:35:05 - INFO - __main__ - Step 38050: {'lr': 0.00043030900069833774, 'samples': 7305600, 'steps': 38049, 'loss/train': 1.630570888519287}}}
+11/07/2021 02:35:05 - INFO - __main__ - Step 38050: {'lr': 0.00043030900069833774, 'samples': 7305600, 'steps': 38049, 'loss/train': 1.630570888519287}}}
+11/07/2021 02:35:08 - INFO - __main__ - Step 38057: {'lr': 0.00043028326722841073, 'samples': 7306944, 'steps': 38056, 'loss/train': 1.8193788528442383}}
+11/07/2021 02:35:10 - INFO - __main__ - Step 38061: {'lr': 0.00043026856060129307, 'samples': 7307712, 'steps': 38060, 'loss/train': 1.5397465229034424}}
+11/07/2021 02:35:13 - INFO - __main__ - Step 38066: {'lr': 0.0004302501754898183, 'samples': 7308672, 'steps': 38065, 'loss/train': 1.7628917694091797}}}
+11/07/2021 02:35:15 - INFO - __main__ - Step 38071: {'lr': 0.00043023178834789477, 'samples': 7309632, 'steps': 38070, 'loss/train': 1.4251023530960083}}
+11/07/2021 02:35:17 - INFO - __main__ - Step 38075: {'lr': 0.0004302170771725721, 'samples': 7310400, 'steps': 38074, 'loss/train': 1.5847716331481934}}}
+11/07/2021 02:35:19 - INFO - __main__ - Step 38079: {'lr': 0.0004302023646980009, 'samples': 7311168, 'steps': 38078, 'loss/train': 1.669752597808838}}}}
+11/07/2021 02:35:19 - INFO - __main__ - Step 38079: {'lr': 0.0004302023646980009, 'samples': 7311168, 'steps': 38078, 'loss/train': 1.669752597808838}}}}
+11/07/2021 02:35:22 - INFO - __main__ - Step 38086: {'lr': 0.00043017661474150347, 'samples': 7312512, 'steps': 38085, 'loss/train': 1.5643198490142822}}
+11/07/2021 02:35:25 - INFO - __main__ - Step 38091: {'lr': 0.0004301582194798567, 'samples': 7313472, 'steps': 38090, 'loss/train': 1.1627254486083984}}}
+11/07/2021 02:35:27 - INFO - __main__ - Step 38096: {'lr': 0.0004301398221887971, 'samples': 7314432, 'steps': 38095, 'loss/train': 2.0996835231781006}}}
+11/07/2021 02:35:29 - INFO - __main__ - Step 38100: {'lr': 0.0004301251028949114, 'samples': 7315200, 'steps': 38099, 'loss/train': 1.506402850151062}}}}
+11/07/2021 02:35:29 - INFO - __main__ - Step 38100: {'lr': 0.0004301251028949114, 'samples': 7315200, 'steps': 38099, 'loss/train': 1.506402850151062}}}}
+11/07/2021 02:35:33 - INFO - __main__ - Step 38107: {'lr': 0.00043009934100595403, 'samples': 7316544, 'steps': 38106, 'loss/train': 1.5879276990890503}}
+11/07/2021 02:35:35 - INFO - __main__ - Step 38112: {'lr': 0.00043008093722216603, 'samples': 7317504, 'steps': 38111, 'loss/train': 1.3977137804031372}}
+11/07/2021 02:35:37 - INFO - __main__ - Step 38116: {'lr': 0.00043006621273457523, 'samples': 7318272, 'steps': 38115, 'loss/train': 1.7254838943481445}}
+11/07/2021 02:35:39 - INFO - __main__ - Step 38120: {'lr': 0.0004300514869488236, 'samples': 7319040, 'steps': 38119, 'loss/train': 1.5329667329788208}}}
+11/07/2021 02:35:41 - INFO - __main__ - Step 38124: {'lr': 0.00043003675986501717, 'samples': 7319808, 'steps': 38123, 'loss/train': 1.5655076503753662}}
+11/07/2021 02:35:43 - INFO - __main__ - Step 38128: {'lr': 0.00043002203148326213, 'samples': 7320576, 'steps': 38127, 'loss/train': 1.8233729600906372}}
+11/07/2021 02:35:45 - INFO - __main__ - Step 38132: {'lr': 0.0004300073018036648, 'samples': 7321344, 'steps': 38131, 'loss/train': 1.5343341827392578}}}
+11/07/2021 02:35:47 - INFO - __main__ - Step 38136: {'lr': 0.0004299925708263312, 'samples': 7322112, 'steps': 38135, 'loss/train': 1.7947341203689575}}}
+11/07/2021 02:35:49 - INFO - __main__ - Step 38140: {'lr': 0.0004299778385513676, 'samples': 7322880, 'steps': 38139, 'loss/train': 1.8368099927902222}}}
+11/07/2021 02:35:51 - INFO - __main__ - Step 38144: {'lr': 0.00042996310497888025, 'samples': 7323648, 'steps': 38143, 'loss/train': 1.9385180473327637}}
+11/07/2021 02:35:53 - INFO - __main__ - Step 38149: {'lr': 0.00042994468618879, 'samples': 7324608, 'steps': 38148, 'loss/train': 1.6510372161865234}37}}
+11/07/2021 02:35:53 - INFO - __main__ - Step 38149: {'lr': 0.00042994468618879, 'samples': 7324608, 'steps': 38148, 'loss/train': 1.6510372161865234}37}}
+11/07/2021 02:35:57 - INFO - __main__ - Step 38157: {'lr': 0.0004299152119085564, 'samples': 7326144, 'steps': 38156, 'loss/train': 1.5574463605880737}}}
+11/07/2021 02:35:59 - INFO - __main__ - Step 38161: {'lr': 0.0004299004728227781, 'samples': 7326912, 'steps': 38160, 'loss/train': 1.3330954313278198}}}
+11/07/2021 02:36:01 - INFO - __main__ - Step 38165: {'lr': 0.0004298857324400337, 'samples': 7327680, 'steps': 38164, 'loss/train': 1.8268216848373413}}}
+11/07/2021 02:36:03 - INFO - __main__ - Step 38169: {'lr': 0.0004298709907604296, 'samples': 7328448, 'steps': 38168, 'loss/train': 1.229674220085144}}}}
+11/07/2021 02:36:05 - INFO - __main__ - Step 38174: {'lr': 0.00042985256183737723, 'samples': 7329408, 'steps': 38173, 'loss/train': 0.975612998008728}}}
+11/07/2021 02:36:05 - INFO - __main__ - Step 38174: {'lr': 0.00042985256183737723, 'samples': 7329408, 'steps': 38173, 'loss/train': 0.975612998008728}}}
+11/07/2021 02:36:09 - INFO - __main__ - Step 38181: {'lr': 0.00042982675794152135, 'samples': 7330752, 'steps': 38180, 'loss/train': 2.0016207695007324}}
+11/07/2021 02:36:11 - INFO - __main__ - Step 38185: {'lr': 0.000429812011075541, 'samples': 7331520, 'steps': 38184, 'loss/train': 1.148552417755127}24}}
+11/07/2021 02:36:13 - INFO - __main__ - Step 38190: {'lr': 0.00042979357567011643, 'samples': 7332480, 'steps': 38189, 'loss/train': 1.3136870861053467}}
+11/07/2021 02:36:13 - INFO - __main__ - Step 38190: {'lr': 0.00042979357567011643, 'samples': 7332480, 'steps': 38189, 'loss/train': 1.3136870861053467}}
+11/07/2021 02:36:17 - INFO - __main__ - Step 38198: {'lr': 0.0004297640748088886, 'samples': 7334016, 'steps': 38197, 'loss/train': 1.6281474828720093}}}
+11/07/2021 02:36:19 - INFO - __main__ - Step 38202: {'lr': 0.00042974932243424743, 'samples': 7334784, 'steps': 38201, 'loss/train': 2.0515167713165283}}
+11/07/2021 02:36:21 - INFO - __main__ - Step 38206: {'lr': 0.0004297345687637299, 'samples': 7335552, 'steps': 38205, 'loss/train': 2.14150333404541}83}}
+11/07/2021 02:36:23 - INFO - __main__ - Step 38211: {'lr': 0.00042971612485341896, 'samples': 7336512, 'steps': 38210, 'loss/train': 0.9586760997772217}}
+11/07/2021 02:36:26 - INFO - __main__ - Step 38216: {'lr': 0.0004296976789186753, 'samples': 7337472, 'steps': 38215, 'loss/train': 1.534716010093689}7}}
+11/07/2021 02:36:28 - INFO - __main__ - Step 38220: {'lr': 0.0004296829207134283, 'samples': 7338240, 'steps': 38219, 'loss/train': 1.2776870727539062}}}
+11/07/2021 02:36:28 - INFO - __main__ - Step 38220: {'lr': 0.0004296829207134283, 'samples': 7338240, 'steps': 38219, 'loss/train': 1.2776870727539062}}}
+11/07/2021 02:36:31 - INFO - __main__ - Step 38227: {'lr': 0.00042965709073725957, 'samples': 7339584, 'steps': 38226, 'loss/train': 1.9048470258712769}}
+11/07/2021 02:36:31 - INFO - __main__ - Step 38227: {'lr': 0.00042965709073725957, 'samples': 7339584, 'steps': 38226, 'loss/train': 1.9048470258712769}}
+11/07/2021 02:36:35 - INFO - __main__ - Step 38235: {'lr': 0.0004296275659074858, 'samples': 7341120, 'steps': 38234, 'loss/train': 1.2817461490631104}}}
+11/07/2021 02:36:37 - INFO - __main__ - Step 38239: {'lr': 0.00042961280155004786, 'samples': 7341888, 'steps': 38238, 'loss/train': 0.6085673570632935}}
+11/07/2021 02:36:39 - INFO - __main__ - Step 38243: {'lr': 0.0004295980358977178, 'samples': 7342656, 'steps': 38242, 'loss/train': 1.4010951519012451}}}
+11/07/2021 02:36:41 - INFO - __main__ - Step 38247: {'lr': 0.00042958326895060206, 'samples': 7343424, 'steps': 38246, 'loss/train': 1.1405773162841797}}
+11/07/2021 02:36:43 - INFO - __main__ - Step 38252: {'lr': 0.00042956480844607734, 'samples': 7344384, 'steps': 38251, 'loss/train': 0.6693893074989319}}
+11/07/2021 02:36:45 - INFO - __main__ - Step 38256: {'lr': 0.0004295500385860832, 'samples': 7345152, 'steps': 38255, 'loss/train': 2.0637753009796143}}}
+11/07/2021 02:36:45 - INFO - __main__ - Step 38256: {'lr': 0.0004295500385860832, 'samples': 7345152, 'steps': 38255, 'loss/train': 2.0637753009796143}}}
+11/07/2021 02:36:49 - INFO - __main__ - Step 38263: {'lr': 0.0004295241882164121, 'samples': 7346496, 'steps': 38262, 'loss/train': 1.4554109573364258}}}
+11/07/2021 02:36:51 - INFO - __main__ - Step 38268: {'lr': 0.0004295057212398889, 'samples': 7347456, 'steps': 38267, 'loss/train': 1.5185699462890625}}}
+11/07/2021 02:36:51 - INFO - __main__ - Step 38268: {'lr': 0.0004295057212398889, 'samples': 7347456, 'steps': 38267, 'loss/train': 1.5185699462890625}}}
+11/07/2021 02:36:55 - INFO - __main__ - Step 38276: {'lr': 0.00042947616987164787, 'samples': 7348992, 'steps': 38275, 'loss/train': 1.8463332653045654}}
+11/07/2021 02:36:57 - INFO - __main__ - Step 38280: {'lr': 0.0004294613922466135, 'samples': 7349760, 'steps': 38279, 'loss/train': 1.591142177581787}4}}
+11/07/2021 02:36:59 - INFO - __main__ - Step 38284: {'lr': 0.0004294466133277786, 'samples': 7350528, 'steps': 38283, 'loss/train': 1.229430079460144}4}}
+11/07/2021 02:36:59 - INFO - __main__ - Step 38284: {'lr': 0.0004294466133277786, 'samples': 7350528, 'steps': 38283, 'loss/train': 1.229430079460144}4}}
+11/07/2021 02:37:03 - INFO - __main__ - Step 38292: {'lr': 0.0004294170516091332, 'samples': 7352064, 'steps': 38291, 'loss/train': 1.6080865859985352}}}
+11/07/2021 02:37:05 - INFO - __main__ - Step 38296: {'lr': 0.00042940226880953605, 'samples': 7352832, 'steps': 38295, 'loss/train': 1.732701301574707}}}
+11/07/2021 02:37:07 - INFO - __main__ - Step 38301: {'lr': 0.0004293837884912444, 'samples': 7353792, 'steps': 38300, 'loss/train': 2.025219678878784}}}}
+11/07/2021 02:37:07 - INFO - __main__ - Step 38301: {'lr': 0.0004293837884912444, 'samples': 7353792, 'steps': 38300, 'loss/train': 2.025219678878784}}}}
+11/07/2021 02:37:11 - INFO - __main__ - Step 38309: {'lr': 0.0004293542157790308, 'samples': 7355328, 'steps': 38308, 'loss/train': 1.512961983680725}}}}
+11/07/2021 02:37:13 - INFO - __main__ - Step 38313: {'lr': 0.0004293394274833289, 'samples': 7356096, 'steps': 38312, 'loss/train': 1.530188798904419}}}}
+11/07/2021 02:37:15 - INFO - __main__ - Step 38317: {'lr': 0.0004293246378947058, 'samples': 7356864, 'steps': 38316, 'loss/train': 1.9374382495880127}}}
+11/07/2021 02:37:17 - INFO - __main__ - Step 38322: {'lr': 0.0004293061490909187, 'samples': 7357824, 'steps': 38321, 'loss/train': 1.3759467601776123}}}
+11/07/2021 02:37:20 - INFO - __main__ - Step 38327: {'lr': 0.0004292876582673171, 'samples': 7358784, 'steps': 38326, 'loss/train': 0.9394339323043823}}}
+11/07/2021 02:37:20 - INFO - __main__ - Step 38327: {'lr': 0.0004292876582673171, 'samples': 7358784, 'steps': 38326, 'loss/train': 0.9394339323043823}}}
+11/07/2021 02:37:23 - INFO - __main__ - Step 38334: {'lr': 0.00042926176772138295, 'samples': 7360128, 'steps': 38333, 'loss/train': 1.29563307762146}}}}
+11/07/2021 02:37:25 - INFO - __main__ - Step 38338: {'lr': 0.0004292469713466727, 'samples': 7360896, 'steps': 38337, 'loss/train': 1.8090503215789795}}}
+11/07/2021 02:37:28 - INFO - __main__ - Step 38343: {'lr': 0.0004292284740610642, 'samples': 7361856, 'steps': 38342, 'loss/train': 1.0337316989898682}}}
+11/07/2021 02:37:30 - INFO - __main__ - Step 38347: {'lr': 0.0004292136747789309, 'samples': 7362624, 'steps': 38346, 'loss/train': 1.6750733852386475}}}
+11/07/2021 02:37:32 - INFO - __main__ - Step 38351: {'lr': 0.0004291988742047829, 'samples': 7363392, 'steps': 38350, 'loss/train': 1.636959433555603}}}}
+11/07/2021 02:37:33 - INFO - __main__ - Step 38355: {'lr': 0.0004291840723387269, 'samples': 7364160, 'steps': 38354, 'loss/train': 1.572365164756775}}}}
+11/07/2021 02:37:36 - INFO - __main__ - Step 38359: {'lr': 0.00042916926918086973, 'samples': 7364928, 'steps': 38358, 'loss/train': 0.26775655150413513}
+11/07/2021 02:37:38 - INFO - __main__ - Step 38363: {'lr': 0.00042915446473131805, 'samples': 7365696, 'steps': 38362, 'loss/train': 1.0548052787780762}}
+11/07/2021 02:37:40 - INFO - __main__ - Step 38367: {'lr': 0.00042913965899017855, 'samples': 7366464, 'steps': 38366, 'loss/train': 1.445980191230774}}}
+11/07/2021 02:37:41 - INFO - __main__ - Step 38371: {'lr': 0.000429124851957558, 'samples': 7367232, 'steps': 38370, 'loss/train': 1.5229068994522095}}}}
+11/07/2021 02:37:43 - INFO - __main__ - Step 38375: {'lr': 0.0004291100436335631, 'samples': 7368000, 'steps': 38374, 'loss/train': 1.2032063007354736}}}
+11/07/2021 02:37:46 - INFO - __main__ - Step 38380: {'lr': 0.00042909153141273705, 'samples': 7368960, 'steps': 38379, 'loss/train': 1.791010856628418}}}
+11/07/2021 02:37:48 - INFO - __main__ - Step 38384: {'lr': 0.00042907672018354027, 'samples': 7369728, 'steps': 38383, 'loss/train': 1.2648224830627441}}
+11/07/2021 02:37:48 - INFO - __main__ - Step 38384: {'lr': 0.00042907672018354027, 'samples': 7369728, 'steps': 38383, 'loss/train': 1.2648224830627441}}
+11/07/2021 02:37:51 - INFO - __main__ - Step 38391: {'lr': 0.0004290507974259759, 'samples': 7371072, 'steps': 38390, 'loss/train': 1.5398764610290527}}}
+11/07/2021 02:37:54 - INFO - __main__ - Step 38396: {'lr': 0.0004290322787502135, 'samples': 7372032, 'steps': 38395, 'loss/train': 1.1739457845687866}}}
+11/07/2021 02:37:56 - INFO - __main__ - Step 38401: {'lr': 0.0004290137580577216, 'samples': 7372992, 'steps': 38400, 'loss/train': 1.6494174003601074}}}
+11/07/2021 02:37:56 - INFO - __main__ - Step 38401: {'lr': 0.0004290137580577216, 'samples': 7372992, 'steps': 38400, 'loss/train': 1.6494174003601074}}}
+11/07/2021 02:37:59 - INFO - __main__ - Step 38408: {'lr': 0.00042898782570052453, 'samples': 7374336, 'steps': 38407, 'loss/train': 1.9118536710739136}}
+11/07/2021 02:38:01 - INFO - __main__ - Step 38412: {'lr': 0.0004289730054363795, 'samples': 7375104, 'steps': 38411, 'loss/train': 1.6180638074874878}}}
+11/07/2021 02:38:04 - INFO - __main__ - Step 38417: {'lr': 0.00042895447829175516, 'samples': 7376064, 'steps': 38416, 'loss/train': 1.3981465101242065}}
+11/07/2021 02:38:06 - INFO - __main__ - Step 38421: {'lr': 0.0004289396551246313, 'samples': 7376832, 'steps': 38420, 'loss/train': 1.5289490222930908}}}
+11/07/2021 02:38:08 - INFO - __main__ - Step 38425: {'lr': 0.00042892483066746836, 'samples': 7377600, 'steps': 38424, 'loss/train': 1.5883793830871582}}
+11/07/2021 02:38:08 - INFO - __main__ - Step 38425: {'lr': 0.00042892483066746836, 'samples': 7377600, 'steps': 38424, 'loss/train': 1.5883793830871582}}
+11/07/2021 02:38:08 - INFO - __main__ - Step 38425: {'lr': 0.00042892483066746836, 'samples': 7377600, 'steps': 38424, 'loss/train': 1.5883793830871582}}
+11/07/2021 02:38:13 - INFO - __main__ - Step 38434: {'lr': 0.00042889147092269964, 'samples': 7379328, 'steps': 38433, 'loss/train': 2.4124293327331543}}
+11/07/2021 02:38:13 - INFO - __main__ - Step 38434: {'lr': 0.00042889147092269964, 'samples': 7379328, 'steps': 38433, 'loss/train': 2.4124293327331543}}
+11/07/2021 02:38:13 - INFO - __main__ - Step 38434: {'lr': 0.00042889147092269964, 'samples': 7379328, 'steps': 38433, 'loss/train': 2.4124293327331543}}
+11/07/2021 02:38:19 - INFO - __main__ - Step 38445: {'lr': 0.00042885068903480717, 'samples': 7381440, 'steps': 38444, 'loss/train': 0.9094494581222534}}
+11/07/2021 02:38:22 - INFO - __main__ - Step 38451: {'lr': 0.0004288284402585866, 'samples': 7382592, 'steps': 38450, 'loss/train': 1.5371888875961304}}}
+11/07/2021 02:38:22 - INFO - __main__ - Step 38451: {'lr': 0.0004288284402585866, 'samples': 7382592, 'steps': 38450, 'loss/train': 1.5371888875961304}}}
+11/07/2021 02:38:26 - INFO - __main__ - Step 38458: {'lr': 0.00042880247968675255, 'samples': 7383936, 'steps': 38457, 'loss/train': 1.191347360610962}}}
+11/07/2021 02:38:27 - INFO - __main__ - Step 38462: {'lr': 0.0004287876433017951, 'samples': 7384704, 'steps': 38461, 'loss/train': 1.1448413133621216}}}
+11/07/2021 02:38:29 - INFO - __main__ - Step 38466: {'lr': 0.0004287728056278944, 'samples': 7385472, 'steps': 38465, 'loss/train': 1.7644872665405273}}}
+11/07/2021 02:38:32 - INFO - __main__ - Step 38471: {'lr': 0.00042875425672310506, 'samples': 7386432, 'steps': 38470, 'loss/train': 1.6783102750778198}}
+11/07/2021 02:38:34 - INFO - __main__ - Step 38475: {'lr': 0.0004287394161494733, 'samples': 7387200, 'steps': 38474, 'loss/train': 1.8952447175979614}}}
+11/07/2021 02:38:36 - INFO - __main__ - Step 38479: {'lr': 0.00042872457428724586, 'samples': 7387968, 'steps': 38478, 'loss/train': 1.7590001821517944}}
+11/07/2021 02:38:37 - INFO - __main__ - Step 38483: {'lr': 0.0004287097311365299, 'samples': 7388736, 'steps': 38482, 'loss/train': 1.6136687994003296}}}
+11/07/2021 02:38:39 - INFO - __main__ - Step 38487: {'lr': 0.0004286948866974323, 'samples': 7389504, 'steps': 38486, 'loss/train': 1.2108365297317505}}}
+11/07/2021 02:38:42 - INFO - __main__ - Step 38492: {'lr': 0.0004286763293369369, 'samples': 7390464, 'steps': 38491, 'loss/train': 1.2377177476882935}}}
+11/07/2021 02:38:44 - INFO - __main__ - Step 38496: {'lr': 0.00042866148199937216, 'samples': 7391232, 'steps': 38495, 'loss/train': 1.4726425409317017}}
+11/07/2021 02:38:46 - INFO - __main__ - Step 38501: {'lr': 0.00042864292101613133, 'samples': 7392192, 'steps': 38500, 'loss/train': 1.4850726127624512}}
+11/07/2021 02:38:46 - INFO - __main__ - Step 38501: {'lr': 0.00042864292101613133, 'samples': 7392192, 'steps': 38500, 'loss/train': 1.4850726127624512}}
+11/07/2021 02:38:49 - INFO - __main__ - Step 38508: {'lr': 0.00042861693225890385, 'samples': 7393536, 'steps': 38507, 'loss/train': 1.6027082204818726}}
+11/07/2021 02:38:52 - INFO - __main__ - Step 38513: {'lr': 0.00042859836644638976, 'samples': 7394496, 'steps': 38512, 'loss/train': 3.527266502380371}}}
+11/07/2021 02:38:52 - INFO - __main__ - Step 38513: {'lr': 0.00042859836644638976, 'samples': 7394496, 'steps': 38512, 'loss/train': 3.527266502380371}}}
+11/07/2021 02:38:56 - INFO - __main__ - Step 38521: {'lr': 0.0004285686569618235, 'samples': 7396032, 'steps': 38520, 'loss/train': 1.7476186752319336}}}
+11/07/2021 02:38:57 - INFO - __main__ - Step 38525: {'lr': 0.00042855380028844004, 'samples': 7396800, 'steps': 38524, 'loss/train': 1.3176720142364502}}
+11/07/2021 02:38:59 - INFO - __main__ - Step 38529: {'lr': 0.00042853894232779924, 'samples': 7397568, 'steps': 38528, 'loss/train': 1.7133264541625977}}
+11/07/2021 02:39:02 - INFO - __main__ - Step 38534: {'lr': 0.00042852036806695565, 'samples': 7398528, 'steps': 38533, 'loss/train': 1.6784566640853882}}
+11/07/2021 02:39:02 - INFO - __main__ - Step 38534: {'lr': 0.00042852036806695565, 'samples': 7398528, 'steps': 38533, 'loss/train': 1.6784566640853882}}
+11/07/2021 02:39:02 - INFO - __main__ - Step 38534: {'lr': 0.00042852036806695565, 'samples': 7398528, 'steps': 38533, 'loss/train': 1.6784566640853882}}
+11/07/2021 02:39:08 - INFO - __main__ - Step 38545: {'lr': 0.0004284794976148044, 'samples': 7400640, 'steps': 38544, 'loss/train': 0.7191889882087708}}}
+11/07/2021 02:39:08 - INFO - __main__ - Step 38545: {'lr': 0.0004284794976148044, 'samples': 7400640, 'steps': 38544, 'loss/train': 0.7191889882087708}}}
+11/07/2021 02:39:12 - INFO - __main__ - Step 38553: {'lr': 0.0004284497675375482, 'samples': 7402176, 'steps': 38552, 'loss/train': 1.730039358139038}}}}
+11/07/2021 02:39:13 - INFO - __main__ - Step 38557: {'lr': 0.00042843490056910534, 'samples': 7402944, 'steps': 38556, 'loss/train': 1.7708011865615845}}
+11/07/2021 02:39:15 - INFO - __main__ - Step 38561: {'lr': 0.0004284200323142623, 'samples': 7403712, 'steps': 38560, 'loss/train': 2.0764431953430176}}}
+11/07/2021 02:39:18 - INFO - __main__ - Step 38566: {'lr': 0.0004284014451868716, 'samples': 7404672, 'steps': 38565, 'loss/train': 1.763478398323059}}}}
+11/07/2021 02:39:20 - INFO - __main__ - Step 38571: {'lr': 0.0004283828560498574, 'samples': 7405632, 'steps': 38570, 'loss/train': 0.9588892459869385}}}
+11/07/2021 02:39:20 - INFO - __main__ - Step 38571: {'lr': 0.0004283828560498574, 'samples': 7405632, 'steps': 38570, 'loss/train': 0.9588892459869385}}}
+11/07/2021 02:39:24 - INFO - __main__ - Step 38578: {'lr': 0.0004283568278822688, 'samples': 7406976, 'steps': 38577, 'loss/train': 0.8108773827552795}}}
+11/07/2021 02:39:26 - INFO - __main__ - Step 38582: {'lr': 0.00042834195287558356, 'samples': 7407744, 'steps': 38581, 'loss/train': 1.4471834897994995}}
+11/07/2021 02:39:28 - INFO - __main__ - Step 38587: {'lr': 0.00042832335730918147, 'samples': 7408704, 'steps': 38586, 'loss/train': 1.4644055366516113}}
+11/07/2021 02:39:30 - INFO - __main__ - Step 38591: {'lr': 0.0004283084794097543, 'samples': 7409472, 'steps': 38590, 'loss/train': 1.6175768375396729}}}
+11/07/2021 02:39:32 - INFO - __main__ - Step 38595: {'lr': 0.0004282936002248383, 'samples': 7410240, 'steps': 38594, 'loss/train': 1.3758429288864136}}}
+11/07/2021 02:39:34 - INFO - __main__ - Step 38599: {'lr': 0.0004282787197545408, 'samples': 7411008, 'steps': 38598, 'loss/train': 1.0509960651397705}}}
+11/07/2021 02:39:36 - INFO - __main__ - Step 38603: {'lr': 0.00042826383799896906, 'samples': 7411776, 'steps': 38602, 'loss/train': 1.4507431983947754}}
+11/07/2021 02:39:38 - INFO - __main__ - Step 38608: {'lr': 0.0004282452339972509, 'samples': 7412736, 'steps': 38607, 'loss/train': 0.5122175216674805}}}
+11/07/2021 02:39:41 - INFO - __main__ - Step 38613: {'lr': 0.000428226627987669, 'samples': 7413696, 'steps': 38612, 'loss/train': 1.3209978342056274}}}}
+11/07/2021 02:39:41 - INFO - __main__ - Step 38613: {'lr': 0.000428226627987669, 'samples': 7413696, 'steps': 38612, 'loss/train': 1.3209978342056274}}}}
+11/07/2021 02:39:44 - INFO - __main__ - Step 38620: {'lr': 0.00042820057620144214, 'samples': 7415040, 'steps': 38619, 'loss/train': 1.3826243877410889}}
+11/07/2021 02:39:46 - INFO - __main__ - Step 38624: {'lr': 0.00042818568769994103, 'samples': 7415808, 'steps': 38623, 'loss/train': 0.15500399470329285}
+11/07/2021 02:39:48 - INFO - __main__ - Step 38628: {'lr': 0.00042817079791383636, 'samples': 7416576, 'steps': 38627, 'loss/train': 1.77236807346344}85}
+11/07/2021 02:39:50 - INFO - __main__ - Step 38633: {'lr': 0.00042815218387489535, 'samples': 7417536, 'steps': 38632, 'loss/train': 1.3826674222946167}}
+11/07/2021 02:39:50 - INFO - __main__ - Step 38633: {'lr': 0.00042815218387489535, 'samples': 7417536, 'steps': 38632, 'loss/train': 1.3826674222946167}}
+11/07/2021 02:39:53 - INFO - __main__ - Step 38640: {'lr': 0.0004281261208489747, 'samples': 7418880, 'steps': 38639, 'loss/train': 1.198464274406433}7}}
+11/07/2021 02:39:56 - INFO - __main__ - Step 38644: {'lr': 0.00042811122592552943, 'samples': 7419648, 'steps': 38643, 'loss/train': 1.4061126708984375}}
+11/07/2021 02:39:58 - INFO - __main__ - Step 38649: {'lr': 0.0004280926054655165, 'samples': 7420608, 'steps': 38648, 'loss/train': 1.7997180223464966}}}
+11/07/2021 02:40:00 - INFO - __main__ - Step 38653: {'lr': 0.00042807770765307217, 'samples': 7421376, 'steps': 38652, 'loss/train': 0.7365889549255371}}
+11/07/2021 02:40:02 - INFO - __main__ - Step 38657: {'lr': 0.0004280628085568028, 'samples': 7422144, 'steps': 38656, 'loss/train': 1.452724814414978}1}}
+11/07/2021 02:40:04 - INFO - __main__ - Step 38661: {'lr': 0.00042804790817681574, 'samples': 7422912, 'steps': 38660, 'loss/train': 1.398537039756775}}}
+11/07/2021 02:40:04 - INFO - __main__ - Step 38661: {'lr': 0.00042804790817681574, 'samples': 7422912, 'steps': 38660, 'loss/train': 1.398537039756775}}}
+11/07/2021 02:40:08 - INFO - __main__ - Step 38668: {'lr': 0.00042802182942321576, 'samples': 7424256, 'steps': 38667, 'loss/train': 1.372496485710144}}}
+11/07/2021 02:40:10 - INFO - __main__ - Step 38672: {'lr': 0.000428006925513559, 'samples': 7425024, 'steps': 38671, 'loss/train': 1.8654686212539673}}}}
+11/07/2021 02:40:12 - INFO - __main__ - Step 38676: {'lr': 0.0004279920203205875, 'samples': 7425792, 'steps': 38675, 'loss/train': 1.5036089420318604}}}
+11/07/2021 02:40:14 - INFO - __main__ - Step 38681: {'lr': 0.0004279733870248754, 'samples': 7426752, 'steps': 38680, 'loss/train': 1.6720571517944336}}}
+11/07/2021 02:40:16 - INFO - __main__ - Step 38685: {'lr': 0.0004279584789448385, 'samples': 7427520, 'steps': 38684, 'loss/train': 1.6397520303726196}}}
+11/07/2021 02:40:19 - INFO - __main__ - Step 38689: {'lr': 0.0004279435695818361, 'samples': 7428288, 'steps': 38688, 'loss/train': 1.785889983177185}}}}
+11/07/2021 02:40:20 - INFO - __main__ - Step 38693: {'lr': 0.0004279286589359757, 'samples': 7429056, 'steps': 38692, 'loss/train': 1.4303791522979736}}}
+11/07/2021 02:40:22 - INFO - __main__ - Step 38697: {'lr': 0.0004279137470073648, 'samples': 7429824, 'steps': 38696, 'loss/train': 1.5088738203048706}}}
+11/07/2021 02:40:24 - INFO - __main__ - Step 38702: {'lr': 0.000427895105292897, 'samples': 7430784, 'steps': 38701, 'loss/train': 1.3261916637420654}}}}
+11/07/2021 02:40:27 - INFO - __main__ - Step 38706: {'lr': 0.0004278801904784904, 'samples': 7431552, 'steps': 38705, 'loss/train': 1.5037397146224976}}}
+11/07/2021 02:40:29 - INFO - __main__ - Step 38710: {'lr': 0.0004278652743816828, 'samples': 7432320, 'steps': 38709, 'loss/train': 1.3880391120910645}}}
+11/07/2021 02:40:30 - INFO - __main__ - Step 38714: {'lr': 0.0004278503570025816, 'samples': 7433088, 'steps': 38713, 'loss/train': 1.1154862642288208}}}
+11/07/2021 02:40:32 - INFO - __main__ - Step 38718: {'lr': 0.0004278354383412943, 'samples': 7433856, 'steps': 38717, 'loss/train': 1.4579813480377197}}}
+11/07/2021 02:40:35 - INFO - __main__ - Step 38723: {'lr': 0.000427816788211775, 'samples': 7434816, 'steps': 38722, 'loss/train': 1.6787524223327637}}}}
+11/07/2021 02:40:35 - INFO - __main__ - Step 38723: {'lr': 0.000427816788211775, 'samples': 7434816, 'steps': 38722, 'loss/train': 1.6787524223327637}}}}
+11/07/2021 02:40:38 - INFO - __main__ - Step 38730: {'lr': 0.000427790674665392, 'samples': 7436160, 'steps': 38729, 'loss/train': 1.3973135948181152}}}}
+11/07/2021 02:40:40 - INFO - __main__ - Step 38734: {'lr': 0.0004277757508764363, 'samples': 7436928, 'steps': 38733, 'loss/train': 1.2723112106323242}}}
+11/07/2021 02:40:42 - INFO - __main__ - Step 38739: {'lr': 0.00042775709433793657, 'samples': 7437888, 'steps': 38738, 'loss/train': 1.4090418815612793}}
+11/07/2021 02:40:45 - INFO - __main__ - Step 38744: {'lr': 0.0004277384357970717, 'samples': 7438848, 'steps': 38743, 'loss/train': 1.289526104927063}3}}
+11/07/2021 02:40:47 - INFO - __main__ - Step 38748: {'lr': 0.00042772350752281823, 'samples': 7439616, 'steps': 38747, 'loss/train': 1.8541260957717896}}
+11/07/2021 02:40:47 - INFO - __main__ - Step 38748: {'lr': 0.00042772350752281823, 'samples': 7439616, 'steps': 38747, 'loss/train': 1.8541260957717896}}
+11/07/2021 02:40:50 - INFO - __main__ - Step 38755: {'lr': 0.0004276973799598798, 'samples': 7440960, 'steps': 38754, 'loss/train': 1.5014312267303467}}}
+11/07/2021 02:40:52 - INFO - __main__ - Step 38760: {'lr': 0.00042767871501285916, 'samples': 7441920, 'steps': 38759, 'loss/train': 1.5829507112503052}}
+11/07/2021 02:40:55 - INFO - __main__ - Step 38765: {'lr': 0.00042766004806435643, 'samples': 7442880, 'steps': 38764, 'loss/train': 1.5389777421951294}}
+11/07/2021 02:40:57 - INFO - __main__ - Step 38769: {'lr': 0.0004276451130646283, 'samples': 7443648, 'steps': 38768, 'loss/train': 1.5693845748901367}}}
+11/07/2021 02:40:59 - INFO - __main__ - Step 38773: {'lr': 0.0004276301767841939, 'samples': 7444416, 'steps': 38772, 'loss/train': 1.301182746887207}}}}
+11/07/2021 02:40:59 - INFO - __main__ - Step 38773: {'lr': 0.0004276301767841939, 'samples': 7444416, 'steps': 38772, 'loss/train': 1.301182746887207}}}}
+11/07/2021 02:41:02 - INFO - __main__ - Step 38780: {'lr': 0.0004276040352120578, 'samples': 7445760, 'steps': 38779, 'loss/train': 1.2119277715682983}}}
+11/07/2021 02:41:05 - INFO - __main__ - Step 38785: {'lr': 0.0004275853602597294, 'samples': 7446720, 'steps': 38784, 'loss/train': 0.8429235219955444}}}
+11/07/2021 02:41:07 - INFO - __main__ - Step 38790: {'lr': 0.00042756668330697024, 'samples': 7447680, 'steps': 38789, 'loss/train': 1.5498528480529785}}
+11/07/2021 02:41:07 - INFO - __main__ - Step 38790: {'lr': 0.00042756668330697024, 'samples': 7447680, 'steps': 38789, 'loss/train': 1.5498528480529785}}
+11/07/2021 02:41:10 - INFO - __main__ - Step 38797: {'lr': 0.00042754053221278476, 'samples': 7449024, 'steps': 38796, 'loss/train': 1.9527474641799927}}
+11/07/2021 02:41:12 - INFO - __main__ - Step 38801: {'lr': 0.00042752558697042143, 'samples': 7449792, 'steps': 38800, 'loss/train': 1.6765644550323486}}
+11/07/2021 02:41:15 - INFO - __main__ - Step 38806: {'lr': 0.0004275069036176985, 'samples': 7450752, 'steps': 38805, 'loss/train': 1.706905722618103}6}}
+11/07/2021 02:41:15 - INFO - __main__ - Step 38806: {'lr': 0.0004275069036176985, 'samples': 7450752, 'steps': 38805, 'loss/train': 1.706905722618103}6}}
+11/07/2021 02:41:18 - INFO - __main__ - Step 38813: {'lr': 0.0004274807435646948, 'samples': 7452096, 'steps': 38812, 'loss/train': 1.7396658658981323}}}
+11/07/2021 02:41:20 - INFO - __main__ - Step 38817: {'lr': 0.00042746579320359956, 'samples': 7452864, 'steps': 38816, 'loss/train': 1.5527185201644897}}
+11/07/2021 02:41:23 - INFO - __main__ - Step 38822: {'lr': 0.00042744710345306774, 'samples': 7453824, 'steps': 38821, 'loss/train': 1.780123233795166}}}
+11/07/2021 02:41:25 - INFO - __main__ - Step 38826: {'lr': 0.0004274321502134435, 'samples': 7454592, 'steps': 38825, 'loss/train': 1.3130568265914917}}}
+11/07/2021 02:41:27 - INFO - __main__ - Step 38830: {'lr': 0.00042741719569464834, 'samples': 7455360, 'steps': 38829, 'loss/train': 1.382586121559143}}}
+11/07/2021 02:41:29 - INFO - __main__ - Step 38834: {'lr': 0.00042740223989678984, 'samples': 7456128, 'steps': 38833, 'loss/train': 1.2758821249008179}}
+11/07/2021 02:41:31 - INFO - __main__ - Step 38839: {'lr': 0.0004273835433509484, 'samples': 7457088, 'steps': 38838, 'loss/train': 1.5911930799484253}}}
+11/07/2021 02:41:33 - INFO - __main__ - Step 38843: {'lr': 0.000427368584675592, 'samples': 7457856, 'steps': 38842, 'loss/train': 1.8798352479934692}}}}
+11/07/2021 02:41:33 - INFO - __main__ - Step 38843: {'lr': 0.000427368584675592, 'samples': 7457856, 'steps': 38842, 'loss/train': 1.8798352479934692}}}}
+11/07/2021 02:41:36 - INFO - __main__ - Step 38850: {'lr': 0.0004273424039168805, 'samples': 7459200, 'steps': 38849, 'loss/train': 1.733851671218872}}}}
+11/07/2021 02:41:38 - INFO - __main__ - Step 38854: {'lr': 0.0004273274417253235, 'samples': 7459968, 'steps': 38853, 'loss/train': 1.4414904117584229}}}
+11/07/2021 02:41:41 - INFO - __main__ - Step 38860: {'lr': 0.0004273049960409915, 'samples': 7461120, 'steps': 38859, 'loss/train': 1.8021929264068604}}}
+11/07/2021 02:41:41 - INFO - __main__ - Step 38860: {'lr': 0.0004273049960409915, 'samples': 7461120, 'steps': 38859, 'loss/train': 1.8021929264068604}}}
+11/07/2021 02:41:44 - INFO - __main__ - Step 38865: {'lr': 0.00042728628910703305, 'samples': 7462080, 'steps': 38864, 'loss/train': 2.429159164428711}}}
+11/07/2021 02:41:46 - INFO - __main__ - Step 38870: {'lr': 0.00042726758017601297, 'samples': 7463040, 'steps': 38869, 'loss/train': 1.5700926780700684}}
+11/07/2021 02:41:46 - INFO - __main__ - Step 38870: {'lr': 0.00042726758017601297, 'samples': 7463040, 'steps': 38869, 'loss/train': 1.5700926780700684}}
+11/07/2021 02:41:50 - INFO - __main__ - Step 38877: {'lr': 0.00042724138431792245, 'samples': 7464384, 'steps': 38876, 'loss/train': 0.17262661457061768}
+11/07/2021 02:41:52 - INFO - __main__ - Step 38882: {'lr': 0.0004272226705948143, 'samples': 7465344, 'steps': 38881, 'loss/train': 0.8323983550071716}8}
+11/07/2021 02:41:55 - INFO - __main__ - Step 38887: {'lr': 0.00042720395487536115, 'samples': 7466304, 'steps': 38886, 'loss/train': 2.7242424488067627}}
+11/07/2021 02:41:55 - INFO - __main__ - Step 38887: {'lr': 0.00042720395487536115, 'samples': 7466304, 'steps': 38886, 'loss/train': 2.7242424488067627}}
+11/07/2021 02:41:59 - INFO - __main__ - Step 38894: {'lr': 0.0004271777495146685, 'samples': 7467648, 'steps': 38893, 'loss/train': 1.3811542987823486}}}
+11/07/2021 02:42:00 - INFO - __main__ - Step 38898: {'lr': 0.0004271627732664687, 'samples': 7468416, 'steps': 38897, 'loss/train': 0.915793776512146}}}}
+11/07/2021 02:42:02 - INFO - __main__ - Step 38902: {'lr': 0.0004271477957410399, 'samples': 7469184, 'steps': 38901, 'loss/train': 1.4027563333511353}}}
+11/07/2021 02:42:02 - INFO - __main__ - Step 38902: {'lr': 0.0004271477957410399, 'samples': 7469184, 'steps': 38901, 'loss/train': 1.4027563333511353}}}
+11/07/2021 02:42:02 - INFO - __main__ - Step 38902: {'lr': 0.0004271477957410399, 'samples': 7469184, 'steps': 38901, 'loss/train': 1.4027563333511353}}}
+11/07/2021 02:42:08 - INFO - __main__ - Step 38913: {'lr': 0.0004271066009612804, 'samples': 7471296, 'steps': 38912, 'loss/train': 1.6177656650543213}}}
+11/07/2021 02:42:11 - INFO - __main__ - Step 38918: {'lr': 0.0004270878728691946, 'samples': 7472256, 'steps': 38917, 'loss/train': 1.196390151977539}}}}
+11/07/2021 02:42:11 - INFO - __main__ - Step 38918: {'lr': 0.0004270878728691946, 'samples': 7472256, 'steps': 38917, 'loss/train': 1.196390151977539}}}}
+11/07/2021 02:42:14 - INFO - __main__ - Step 38924: {'lr': 0.0004270653965255391, 'samples': 7473408, 'steps': 38923, 'loss/train': 1.0960659980773926}}}
+11/07/2021 02:42:17 - INFO - __main__ - Step 38930: {'lr': 0.000427042917309698, 'samples': 7474560, 'steps': 38929, 'loss/train': 1.7741930484771729}}}}
+11/07/2021 02:42:19 - INFO - __main__ - Step 38934: {'lr': 0.0004270279295703253, 'samples': 7475328, 'steps': 38933, 'loss/train': 1.5284372568130493}}}
+11/07/2021 02:42:19 - INFO - __main__ - Step 38934: {'lr': 0.0004270279295703253, 'samples': 7475328, 'steps': 38933, 'loss/train': 1.5284372568130493}}}
+11/07/2021 02:42:22 - INFO - __main__ - Step 38941: {'lr': 0.00042700169795549504, 'samples': 7476672, 'steps': 38940, 'loss/train': 1.759921669960022}}}
+11/07/2021 02:42:25 - INFO - __main__ - Step 38946: {'lr': 0.00042698295869509836, 'samples': 7477632, 'steps': 38945, 'loss/train': 1.5602725744247437}}
+11/07/2021 02:42:27 - INFO - __main__ - Step 38950: {'lr': 0.0004269679658513466, 'samples': 7478400, 'steps': 38949, 'loss/train': 1.495678186416626}7}}
+11/07/2021 02:42:27 - INFO - __main__ - Step 38950: {'lr': 0.0004269679658513466, 'samples': 7478400, 'steps': 38949, 'loss/train': 1.495678186416626}7}}
+11/07/2021 02:42:30 - INFO - __main__ - Step 38957: {'lr': 0.00042694172530489326, 'samples': 7479744, 'steps': 38956, 'loss/train': 1.171259880065918}}}
+11/07/2021 02:42:33 - INFO - __main__ - Step 38962: {'lr': 0.00042692297966557657, 'samples': 7480704, 'steps': 38961, 'loss/train': 1.3303264379501343}}
+11/07/2021 02:42:35 - INFO - __main__ - Step 38967: {'lr': 0.00042690423203329067, 'samples': 7481664, 'steps': 38966, 'loss/train': 1.5373287200927734}}
+11/07/2021 02:42:35 - INFO - __main__ - Step 38967: {'lr': 0.00042690423203329067, 'samples': 7481664, 'steps': 38966, 'loss/train': 1.5373287200927734}}
+11/07/2021 02:42:39 - INFO - __main__ - Step 38974: {'lr': 0.00042687798200030446, 'samples': 7483008, 'steps': 38973, 'loss/train': 1.1193890571594238}}
+11/07/2021 02:42:40 - INFO - __main__ - Step 38978: {'lr': 0.00042686298022805126, 'samples': 7483776, 'steps': 38977, 'loss/train': 1.4833357334136963}}
+11/07/2021 02:42:42 - INFO - __main__ - Step 38982: {'lr': 0.0004268479771807303, 'samples': 7484544, 'steps': 38981, 'loss/train': 1.8099292516708374}}}
+11/07/2021 02:42:45 - INFO - __main__ - Step 38988: {'lr': 0.0004268254702192337, 'samples': 7485696, 'steps': 38987, 'loss/train': 1.7074424028396606}}}
+11/07/2021 02:42:47 - INFO - __main__ - Step 38992: {'lr': 0.00042681046398471693, 'samples': 7486464, 'steps': 38991, 'loss/train': 1.6774481534957886}}
+11/07/2021 02:42:49 - INFO - __main__ - Step 38996: {'lr': 0.000426795456475511, 'samples': 7487232, 'steps': 38995, 'loss/train': 1.4442554712295532}6}}
+11/07/2021 02:42:49 - INFO - __main__ - Step 38996: {'lr': 0.000426795456475511, 'samples': 7487232, 'steps': 38995, 'loss/train': 1.4442554712295532}6}}
+11/07/2021 02:42:53 - INFO - __main__ - Step 39003: {'lr': 0.0004267691902675055, 'samples': 7488576, 'steps': 39002, 'loss/train': 1.7540159225463867}}}
+11/07/2021 02:42:53 - INFO - __main__ - Step 39003: {'lr': 0.0004267691902675055, 'samples': 7488576, 'steps': 39002, 'loss/train': 1.7540159225463867}}}
+11/07/2021 02:42:53 - INFO - __main__ - Step 39003: {'lr': 0.0004267691902675055, 'samples': 7488576, 'steps': 39002, 'loss/train': 1.7540159225463867}}}
+11/07/2021 02:42:59 - INFO - __main__ - Step 39015: {'lr': 0.00042672415340263507, 'samples': 7490880, 'steps': 39014, 'loss/train': 1.77121102809906}}}}
+11/07/2021 02:43:01 - INFO - __main__ - Step 39020: {'lr': 0.0004267053846578646, 'samples': 7491840, 'steps': 39019, 'loss/train': 1.799487590789795}}}}
+11/07/2021 02:43:01 - INFO - __main__ - Step 39020: {'lr': 0.0004267053846578646, 'samples': 7491840, 'steps': 39019, 'loss/train': 1.799487590789795}}}}
+11/07/2021 02:43:05 - INFO - __main__ - Step 39028: {'lr': 0.0004266753505260425, 'samples': 7493376, 'steps': 39027, 'loss/train': 0.9015293717384338}}}
+11/07/2021 02:43:07 - INFO - __main__ - Step 39032: {'lr': 0.00042666033154950485, 'samples': 7494144, 'steps': 39031, 'loss/train': 1.570765733718872}}}
+11/07/2021 02:43:09 - INFO - __main__ - Step 39036: {'lr': 0.00042664531129936044, 'samples': 7494912, 'steps': 39035, 'loss/train': 1.7049858570098877}}
+11/07/2021 02:43:11 - INFO - __main__ - Step 39040: {'lr': 0.00042663028977571774, 'samples': 7495680, 'steps': 39039, 'loss/train': 1.2940502166748047}}
+11/07/2021 02:43:13 - INFO - __main__ - Step 39045: {'lr': 0.000426611511080472, 'samples': 7496640, 'steps': 39044, 'loss/train': 1.5129510164260864}7}}
+11/07/2021 02:43:15 - INFO - __main__ - Step 39049: {'lr': 0.00042659648669185376, 'samples': 7497408, 'steps': 39048, 'loss/train': 1.8148497343063354}}
+11/07/2021 02:43:17 - INFO - __main__ - Step 39053: {'lr': 0.00042658146103008904, 'samples': 7498176, 'steps': 39052, 'loss/train': 1.286407470703125}}}
+11/07/2021 02:43:19 - INFO - __main__ - Step 39057: {'lr': 0.0004265664340952862, 'samples': 7498944, 'steps': 39056, 'loss/train': 1.225213646888733}}}}
+11/07/2021 02:43:21 - INFO - __main__ - Step 39061: {'lr': 0.00042655140588755366, 'samples': 7499712, 'steps': 39060, 'loss/train': 1.3078956604003906}}
+11/07/2021 02:43:23 - INFO - __main__ - Step 39065: {'lr': 0.0004265363764069997, 'samples': 7500480, 'steps': 39064, 'loss/train': 1.4725383520126343}}}
+11/07/2021 02:43:25 - INFO - __main__ - Step 39069: {'lr': 0.0004265213456537326, 'samples': 7501248, 'steps': 39068, 'loss/train': 1.6109968423843384}}}
+11/07/2021 02:43:27 - INFO - __main__ - Step 39073: {'lr': 0.0004265063136278608, 'samples': 7502016, 'steps': 39072, 'loss/train': 1.0011496543884277}}}
+11/07/2021 02:43:29 - INFO - __main__ - Step 39077: {'lr': 0.0004264912803294926, 'samples': 7502784, 'steps': 39076, 'loss/train': 1.2915695905685425}}}
+11/07/2021 02:43:31 - INFO - __main__ - Step 39082: {'lr': 0.0004264724869172496, 'samples': 7503744, 'steps': 39081, 'loss/train': 1.7730166912078857}}}
+11/07/2021 02:43:33 - INFO - __main__ - Step 39086: {'lr': 0.00042645745075616106, 'samples': 7504512, 'steps': 39085, 'loss/train': 0.18499447405338287}
+11/07/2021 02:43:33 - INFO - __main__ - Step 39086: {'lr': 0.00042645745075616106, 'samples': 7504512, 'steps': 39085, 'loss/train': 0.18499447405338287}
+11/07/2021 02:43:37 - INFO - __main__ - Step 39093: {'lr': 0.0004264311344132245, 'samples': 7505856, 'steps': 39092, 'loss/train': 1.8912596702575684}7}
+11/07/2021 02:43:39 - INFO - __main__ - Step 39097: {'lr': 0.00042641609475400054, 'samples': 7506624, 'steps': 39096, 'loss/train': 2.056940793991089}7}
+11/07/2021 02:43:41 - INFO - __main__ - Step 39102: {'lr': 0.00042639729339145004, 'samples': 7507584, 'steps': 39101, 'loss/train': 0.1855313628911972}}
+11/07/2021 02:43:43 - INFO - __main__ - Step 39106: {'lr': 0.00042638225087072523, 'samples': 7508352, 'steps': 39105, 'loss/train': 1.9047843217849731}}
+11/07/2021 02:43:45 - INFO - __main__ - Step 39110: {'lr': 0.0004263672070783986, 'samples': 7509120, 'steps': 39109, 'loss/train': 2.0347707271575928}}}
+11/07/2021 02:43:47 - INFO - __main__ - Step 39114: {'lr': 0.00042635216201457836, 'samples': 7509888, 'steps': 39113, 'loss/train': 1.5635451078414917}}
+11/07/2021 02:43:49 - INFO - __main__ - Step 39118: {'lr': 0.00042633711567937325, 'samples': 7510656, 'steps': 39117, 'loss/train': 1.6775025129318237}}
+11/07/2021 02:43:49 - INFO - __main__ - Step 39118: {'lr': 0.00042633711567937325, 'samples': 7510656, 'steps': 39117, 'loss/train': 1.6775025129318237}}
+11/07/2021 02:43:49 - INFO - __main__ - Step 39118: {'lr': 0.00042633711567937325, 'samples': 7510656, 'steps': 39117, 'loss/train': 1.6775025129318237}}
+11/07/2021 02:43:55 - INFO - __main__ - Step 39129: {'lr': 0.0004262957317028657, 'samples': 7512768, 'steps': 39128, 'loss/train': 1.9064688682556152}}}
+11/07/2021 02:43:57 - INFO - __main__ - Step 39133: {'lr': 0.00042628068060093294, 'samples': 7513536, 'steps': 39132, 'loss/train': 1.417256474494934}}}
+11/07/2021 02:43:59 - INFO - __main__ - Step 39137: {'lr': 0.0004262656282281305, 'samples': 7514304, 'steps': 39136, 'loss/train': 1.5228852033615112}}}
+11/07/2021 02:44:01 - INFO - __main__ - Step 39142: {'lr': 0.0004262468109751323, 'samples': 7515264, 'steps': 39141, 'loss/train': 0.9578734636306763}}}
+11/07/2021 02:44:03 - INFO - __main__ - Step 39146: {'lr': 0.0004262317557432699, 'samples': 7516032, 'steps': 39145, 'loss/train': 1.3861796855926514}}}
+11/07/2021 02:44:06 - INFO - __main__ - Step 39150: {'lr': 0.00042621669924089044, 'samples': 7516800, 'steps': 39149, 'loss/train': 1.1236180067062378}}
+11/07/2021 02:44:06 - INFO - __main__ - Step 39150: {'lr': 0.00042621669924089044, 'samples': 7516800, 'steps': 39149, 'loss/train': 1.1236180067062378}}
+11/07/2021 02:44:09 - INFO - __main__ - Step 39157: {'lr': 0.00042619034730487167, 'samples': 7518144, 'steps': 39156, 'loss/train': 1.2965528964996338}}
+11/07/2021 02:44:09 - INFO - __main__ - Step 39157: {'lr': 0.00042619034730487167, 'samples': 7518144, 'steps': 39156, 'loss/train': 1.2965528964996338}}
+11/07/2021 02:44:13 - INFO - __main__ - Step 39166: {'lr': 0.0004261564605283745, 'samples': 7519872, 'steps': 39165, 'loss/train': 1.8770747184753418}}}
+11/07/2021 02:44:15 - INFO - __main__ - Step 39170: {'lr': 0.0004261413976750388, 'samples': 7520640, 'steps': 39169, 'loss/train': 1.223093032836914}}}}
+11/07/2021 02:44:17 - INFO - __main__ - Step 39174: {'lr': 0.0004261263335518375, 'samples': 7521408, 'steps': 39173, 'loss/train': 1.765062689781189}}}}
+11/07/2021 02:44:19 - INFO - __main__ - Step 39178: {'lr': 0.0004261112681588793, 'samples': 7522176, 'steps': 39177, 'loss/train': 1.85269033908844}}}}}
+11/07/2021 02:44:19 - INFO - __main__ - Step 39178: {'lr': 0.0004261112681588793, 'samples': 7522176, 'steps': 39177, 'loss/train': 1.85269033908844}}}}}
+11/07/2021 02:44:24 - INFO - __main__ - Step 39187: {'lr': 0.0004260773663827372, 'samples': 7523904, 'steps': 39186, 'loss/train': 1.276141881942749}}}}
+11/07/2021 02:44:24 - INFO - __main__ - Step 39187: {'lr': 0.0004260773663827372, 'samples': 7523904, 'steps': 39186, 'loss/train': 1.276141881942749}}}}
+11/07/2021 02:44:27 - INFO - __main__ - Step 39194: {'lr': 0.00042605099389164957, 'samples': 7525248, 'steps': 39193, 'loss/train': 1.0232011079788208}}
+11/07/2021 02:44:29 - INFO - __main__ - Step 39199: {'lr': 0.0004260321540182057, 'samples': 7526208, 'steps': 39198, 'loss/train': 1.3887532949447632}}}
+11/07/2021 02:44:32 - INFO - __main__ - Step 39204: {'lr': 0.0004260133121618276, 'samples': 7527168, 'steps': 39203, 'loss/train': 1.5005837678909302}}}
+11/07/2021 02:44:34 - INFO - __main__ - Step 39208: {'lr': 0.0004259982372491551, 'samples': 7527936, 'steps': 39207, 'loss/train': 1.186719536781311}}}}
+11/07/2021 02:44:34 - INFO - __main__ - Step 39208: {'lr': 0.0004259982372491551, 'samples': 7527936, 'steps': 39207, 'loss/train': 1.186719536781311}}}}
+11/07/2021 02:44:37 - INFO - __main__ - Step 39215: {'lr': 0.00042597185309891305, 'samples': 7529280, 'steps': 39214, 'loss/train': 1.9070416688919067}}
+11/07/2021 02:44:37 - INFO - __main__ - Step 39215: {'lr': 0.00042597185309891305, 'samples': 7529280, 'steps': 39214, 'loss/train': 1.9070416688919067}}
+11/07/2021 02:44:41 - INFO - __main__ - Step 39222: {'lr': 0.00042594546506345124, 'samples': 7530624, 'steps': 39221, 'loss/train': 0.7826408743858337}}
+11/07/2021 02:44:43 - INFO - __main__ - Step 39227: {'lr': 0.00042592661408830937, 'samples': 7531584, 'steps': 39226, 'loss/train': 1.7915257215499878}}
+11/07/2021 02:44:46 - INFO - __main__ - Step 39232: {'lr': 0.00042590776113142216, 'samples': 7532544, 'steps': 39231, 'loss/train': 1.5731817483901978}}
+11/07/2021 02:44:46 - INFO - __main__ - Step 39232: {'lr': 0.00042590776113142216, 'samples': 7532544, 'steps': 39231, 'loss/train': 1.5731817483901978}}
+11/07/2021 02:44:49 - INFO - __main__ - Step 39237: {'lr': 0.0004258889061930018, 'samples': 7533504, 'steps': 39236, 'loss/train': 1.6044750213623047}}}
+11/07/2021 02:44:52 - INFO - __main__ - Step 39243: {'lr': 0.0004258662776515728, 'samples': 7534656, 'steps': 39242, 'loss/train': 1.8259460926055908}}}
+11/07/2021 02:44:52 - INFO - __main__ - Step 39243: {'lr': 0.0004258662776515728, 'samples': 7534656, 'steps': 39242, 'loss/train': 1.8259460926055908}}}
+11/07/2021 02:44:55 - INFO - __main__ - Step 39250: {'lr': 0.0004258398740810584, 'samples': 7536000, 'steps': 39249, 'loss/train': 1.7944103479385376}}}
+11/07/2021 02:44:57 - INFO - __main__ - Step 39255: {'lr': 0.00042582101201087786, 'samples': 7536960, 'steps': 39254, 'loss/train': 1.1267701387405396}}
+11/07/2021 02:45:00 - INFO - __main__ - Step 39260: {'lr': 0.0004258021479601414, 'samples': 7537920, 'steps': 39259, 'loss/train': 1.3875758647918701}}}
+11/07/2021 02:45:00 - INFO - __main__ - Step 39260: {'lr': 0.0004258021479601414, 'samples': 7537920, 'steps': 39259, 'loss/train': 1.3875758647918701}}}
+11/07/2021 02:45:03 - INFO - __main__ - Step 39267: {'lr': 0.0004257757349621811, 'samples': 7539264, 'steps': 39266, 'loss/train': 1.6467303037643433}}}
+11/07/2021 02:45:05 - INFO - __main__ - Step 39271: {'lr': 0.0004257606400780117, 'samples': 7540032, 'steps': 39270, 'loss/train': 1.5877642631530762}}}
+11/07/2021 02:45:07 - INFO - __main__ - Step 39275: {'lr': 0.0004257455439267218, 'samples': 7540800, 'steps': 39274, 'loss/train': 1.438101053237915}}}}
+11/07/2021 02:45:09 - INFO - __main__ - Step 39279: {'lr': 0.0004257304465084203, 'samples': 7541568, 'steps': 39278, 'loss/train': 1.7904508113861084}}}
+11/07/2021 02:45:11 - INFO - __main__ - Step 39283: {'lr': 0.00042571534782321593, 'samples': 7542336, 'steps': 39282, 'loss/train': 1.4070467948913574}}
+11/07/2021 02:45:13 - INFO - __main__ - Step 39287: {'lr': 0.0004257002478712175, 'samples': 7543104, 'steps': 39286, 'loss/train': 1.1086269617080688}}}
+11/07/2021 02:45:16 - INFO - __main__ - Step 39292: {'lr': 0.00042568137114995633, 'samples': 7544064, 'steps': 39291, 'loss/train': 1.7251018285751343}}
+11/07/2021 02:45:18 - INFO - __main__ - Step 39296: {'lr': 0.0004256662683480695, 'samples': 7544832, 'steps': 39295, 'loss/train': 1.9215407371520996}}}
+11/07/2021 02:45:20 - INFO - __main__ - Step 39300: {'lr': 0.0004256511642797426, 'samples': 7545600, 'steps': 39299, 'loss/train': 1.5300726890563965}}}
+11/07/2021 02:45:22 - INFO - __main__ - Step 39304: {'lr': 0.00042563605894508434, 'samples': 7546368, 'steps': 39303, 'loss/train': 1.3211116790771484}}
+11/07/2021 02:45:23 - INFO - __main__ - Step 39308: {'lr': 0.00042562095234420375, 'samples': 7547136, 'steps': 39307, 'loss/train': 1.361107349395752}}}
+11/07/2021 02:45:25 - INFO - __main__ - Step 39312: {'lr': 0.0004256058444772097, 'samples': 7547904, 'steps': 39311, 'loss/train': 1.536171317100525}}}}
+11/07/2021 02:45:28 - INFO - __main__ - Step 39317: {'lr': 0.00042558695786316106, 'samples': 7548864, 'steps': 39316, 'loss/train': 1.6797736883163452}}
+11/07/2021 02:45:28 - INFO - __main__ - Step 39317: {'lr': 0.00042558695786316106, 'samples': 7548864, 'steps': 39316, 'loss/train': 1.6797736883163452}}
+11/07/2021 02:45:31 - INFO - __main__ - Step 39324: {'lr': 0.000425560513280636, 'samples': 7550208, 'steps': 39323, 'loss/train': 1.1001230478286743}2}}
+11/07/2021 02:45:33 - INFO - __main__ - Step 39328: {'lr': 0.0004255454003502774, 'samples': 7550976, 'steps': 39327, 'loss/train': 1.4416260719299316}}}
+11/07/2021 02:45:35 - INFO - __main__ - Step 39333: {'lr': 0.0004255265074076358, 'samples': 7551936, 'steps': 39332, 'loss/train': 0.8778195381164551}}}
+11/07/2021 02:45:35 - INFO - __main__ - Step 39333: {'lr': 0.0004255265074076358, 'samples': 7551936, 'steps': 39332, 'loss/train': 0.8778195381164551}}}
+11/07/2021 02:45:39 - INFO - __main__ - Step 39340: {'lr': 0.0004255000539662247, 'samples': 7553280, 'steps': 39339, 'loss/train': 1.684509038925171}}}}
+11/07/2021 02:45:41 - INFO - __main__ - Step 39344: {'lr': 0.0004254849359742449, 'samples': 7554048, 'steps': 39343, 'loss/train': 1.0768413543701172}}}
+11/07/2021 02:45:41 - INFO - __main__ - Step 39344: {'lr': 0.0004254849359742449, 'samples': 7554048, 'steps': 39343, 'loss/train': 1.0768413543701172}}}
+11/07/2021 02:45:46 - INFO - __main__ - Step 39353: {'lr': 0.00042545091586681404, 'samples': 7555776, 'steps': 39352, 'loss/train': 1.6890608072280884}}
+11/07/2021 02:45:48 - INFO - __main__ - Step 39357: {'lr': 0.0004254357937635509, 'samples': 7556544, 'steps': 39356, 'loss/train': 1.8868955373764038}}}
+11/07/2021 02:45:49 - INFO - __main__ - Step 39361: {'lr': 0.00042542067039550916, 'samples': 7557312, 'steps': 39360, 'loss/train': 1.9013553857803345}}
+11/07/2021 02:45:51 - INFO - __main__ - Step 39365: {'lr': 0.00042540554576279776, 'samples': 7558080, 'steps': 39364, 'loss/train': 1.6894145011901855}}
+11/07/2021 02:45:54 - INFO - __main__ - Step 39370: {'lr': 0.00042538663819363323, 'samples': 7559040, 'steps': 39369, 'loss/train': 1.4790570735931396}}
+11/07/2021 02:45:56 - INFO - __main__ - Step 39375: {'lr': 0.0004253677286488058, 'samples': 7560000, 'steps': 39374, 'loss/train': 1.004982352256775}6}}
+11/07/2021 02:45:58 - INFO - __main__ - Step 39379: {'lr': 0.0004253525995906098, 'samples': 7560768, 'steps': 39378, 'loss/train': 1.5641216039657593}}}
+11/07/2021 02:45:58 - INFO - __main__ - Step 39379: {'lr': 0.0004253525995906098, 'samples': 7560768, 'steps': 39378, 'loss/train': 1.5641216039657593}}}
+11/07/2021 02:46:01 - INFO - __main__ - Step 39386: {'lr': 0.00042532612069690214, 'samples': 7562112, 'steps': 39385, 'loss/train': 1.331007719039917}}}
+11/07/2021 02:46:04 - INFO - __main__ - Step 39391: {'lr': 0.00042530720483138524, 'samples': 7563072, 'steps': 39390, 'loss/train': 0.7283228635787964}}
+11/07/2021 02:46:04 - INFO - __main__ - Step 39391: {'lr': 0.00042530720483138524, 'samples': 7563072, 'steps': 39390, 'loss/train': 0.7283228635787964}}
+11/07/2021 02:46:08 - INFO - __main__ - Step 39399: {'lr': 0.0004252769353391294, 'samples': 7564608, 'steps': 39398, 'loss/train': 0.9206255078315735}}}
+11/07/2021 02:46:09 - INFO - __main__ - Step 39403: {'lr': 0.0004252617986974969, 'samples': 7565376, 'steps': 39402, 'loss/train': 0.9733449816703796}}}
+11/07/2021 02:46:11 - INFO - __main__ - Step 39407: {'lr': 0.0004252466607923402, 'samples': 7566144, 'steps': 39406, 'loss/train': 1.5809663534164429}}}
+11/07/2021 02:46:14 - INFO - __main__ - Step 39412: {'lr': 0.00042522773663422977, 'samples': 7567104, 'steps': 39411, 'loss/train': 1.7798511981964111}}
+11/07/2021 02:46:16 - INFO - __main__ - Step 39416: {'lr': 0.00042521259588654264, 'samples': 7567872, 'steps': 39415, 'loss/train': 1.2348101139068604}}
+11/07/2021 02:46:16 - INFO - __main__ - Step 39416: {'lr': 0.00042521259588654264, 'samples': 7567872, 'steps': 39415, 'loss/train': 1.2348101139068604}}
+11/07/2021 02:46:19 - INFO - __main__ - Step 39423: {'lr': 0.00042518609653865444, 'samples': 7569216, 'steps': 39422, 'loss/train': 1.822353720664978}}}
+11/07/2021 02:46:22 - INFO - __main__ - Step 39428: {'lr': 0.0004251671660649013, 'samples': 7570176, 'steps': 39427, 'loss/train': 1.613086223602295}}}}
+11/07/2021 02:46:24 - INFO - __main__ - Step 39433: {'lr': 0.00042514823361795764, 'samples': 7571136, 'steps': 39432, 'loss/train': 0.7617422938346863}}
+11/07/2021 02:46:24 - INFO - __main__ - Step 39433: {'lr': 0.00042514823361795764, 'samples': 7571136, 'steps': 39432, 'loss/train': 0.7617422938346863}}
+11/07/2021 02:46:28 - INFO - __main__ - Step 39440: {'lr': 0.00042512172487768244, 'samples': 7572480, 'steps': 39439, 'loss/train': 1.3813639879226685}}
+11/07/2021 02:46:30 - INFO - __main__ - Step 39444: {'lr': 0.0004251065752901018, 'samples': 7573248, 'steps': 39443, 'loss/train': 1.537869930267334}5}}
+11/07/2021 02:46:32 - INFO - __main__ - Step 39449: {'lr': 0.00042508763653038167, 'samples': 7574208, 'steps': 39448, 'loss/train': 1.785377025604248}}}
+11/07/2021 02:46:34 - INFO - __main__ - Step 39453: {'lr': 0.00042507248410254307, 'samples': 7574976, 'steps': 39452, 'loss/train': 1.2439583539962769}}
+11/07/2021 02:46:36 - INFO - __main__ - Step 39457: {'lr': 0.00042505733041254526, 'samples': 7575744, 'steps': 39456, 'loss/train': 1.4447280168533325}}
+11/07/2021 02:46:36 - INFO - __main__ - Step 39457: {'lr': 0.00042505733041254526, 'samples': 7575744, 'steps': 39456, 'loss/train': 1.4447280168533325}}
+11/07/2021 02:46:39 - INFO - __main__ - Step 39464: {'lr': 0.00042503080841830654, 'samples': 7577088, 'steps': 39463, 'loss/train': 1.5276356935501099}}
+11/07/2021 02:46:42 - INFO - __main__ - Step 39469: {'lr': 0.0004250118617706879, 'samples': 7578048, 'steps': 39468, 'loss/train': 1.4779454469680786}}}
+11/07/2021 02:46:42 - INFO - __main__ - Step 39469: {'lr': 0.0004250118617706879, 'samples': 7578048, 'steps': 39468, 'loss/train': 1.4779454469680786}}}
+11/07/2021 02:46:46 - INFO - __main__ - Step 39477: {'lr': 0.0004249815430339894, 'samples': 7579584, 'steps': 39476, 'loss/train': 0.690558135509491}}}}
+11/07/2021 02:46:46 - INFO - __main__ - Step 39477: {'lr': 0.0004249815430339894, 'samples': 7579584, 'steps': 39476, 'loss/train': 0.690558135509491}}}}
+11/07/2021 02:46:50 - INFO - __main__ - Step 39485: {'lr': 0.0004249512192512759, 'samples': 7581120, 'steps': 39484, 'loss/train': 1.6692142486572266}}}
+11/07/2021 02:46:52 - INFO - __main__ - Step 39490: {'lr': 0.00042493226432503917, 'samples': 7582080, 'steps': 39489, 'loss/train': 1.0378392934799194}}
+11/07/2021 02:46:52 - INFO - __main__ - Step 39490: {'lr': 0.00042493226432503917, 'samples': 7582080, 'steps': 39489, 'loss/train': 1.0378392934799194}}
+11/07/2021 02:46:52 - INFO - __main__ - Step 39490: {'lr': 0.00042493226432503917, 'samples': 7582080, 'steps': 39489, 'loss/train': 1.0378392934799194}}
+11/07/2021 02:46:58 - INFO - __main__ - Step 39500: {'lr': 0.00042489434856114565, 'samples': 7584000, 'steps': 39499, 'loss/train': 1.4942436218261719}}
+11/07/2021 02:47:00 - INFO - __main__ - Step 39504: {'lr': 0.00042487918004896117, 'samples': 7584768, 'steps': 39503, 'loss/train': 1.7786004543304443}}
+11/07/2021 02:47:02 - INFO - __main__ - Step 39508: {'lr': 0.00042486401027601084, 'samples': 7585536, 'steps': 39507, 'loss/train': 1.7957890033721924}}
+11/07/2021 02:47:04 - INFO - __main__ - Step 39513: {'lr': 0.0004248450462870378, 'samples': 7586496, 'steps': 39512, 'loss/train': 1.3140740394592285}}}
+11/07/2021 02:47:06 - INFO - __main__ - Step 39518: {'lr': 0.00042482608032850275, 'samples': 7587456, 'steps': 39517, 'loss/train': 1.4334967136383057}}
+11/07/2021 02:47:09 - INFO - __main__ - Step 39522: {'lr': 0.00042481090614373364, 'samples': 7588224, 'steps': 39521, 'loss/train': 1.578730583190918}}}
+11/07/2021 02:47:11 - INFO - __main__ - Step 39526: {'lr': 0.00042479573069869095, 'samples': 7588992, 'steps': 39525, 'loss/train': 1.9888464212417603}}
+11/07/2021 02:47:12 - INFO - __main__ - Step 39530: {'lr': 0.00042478055399348415, 'samples': 7589760, 'steps': 39529, 'loss/train': 1.7055436372756958}}
+11/07/2021 02:47:14 - INFO - __main__ - Step 39534: {'lr': 0.0004247653760282225, 'samples': 7590528, 'steps': 39533, 'loss/train': 1.2379640340805054}}}
+11/07/2021 02:47:16 - INFO - __main__ - Step 39538: {'lr': 0.0004247501968030157, 'samples': 7591296, 'steps': 39537, 'loss/train': 1.1878610849380493}}}
+11/07/2021 02:47:16 - INFO - __main__ - Step 39538: {'lr': 0.0004247501968030157, 'samples': 7591296, 'steps': 39537, 'loss/train': 1.1878610849380493}}}
+11/07/2021 02:47:21 - INFO - __main__ - Step 39546: {'lr': 0.00042471983457320384, 'samples': 7592832, 'steps': 39545, 'loss/train': 0.9633825421333313}}
+11/07/2021 02:47:22 - INFO - __main__ - Step 39550: {'lr': 0.00042470465156881765, 'samples': 7593600, 'steps': 39549, 'loss/train': 1.7505109310150146}}
+11/07/2021 02:47:24 - INFO - __main__ - Step 39554: {'lr': 0.00042468946730492404, 'samples': 7594368, 'steps': 39553, 'loss/train': 1.6657792329788208}}
+11/07/2021 02:47:27 - INFO - __main__ - Step 39559: {'lr': 0.00042467048520404126, 'samples': 7595328, 'steps': 39558, 'loss/train': 1.1775028705596924}}
+11/07/2021 02:47:27 - INFO - __main__ - Step 39559: {'lr': 0.00042467048520404126, 'samples': 7595328, 'steps': 39558, 'loss/train': 1.1775028705596924}}
+11/07/2021 02:47:30 - INFO - __main__ - Step 39566: {'lr': 0.0004246439069572926, 'samples': 7596672, 'steps': 39565, 'loss/train': 0.4988980293273926}}}
+11/07/2021 02:47:32 - INFO - __main__ - Step 39570: {'lr': 0.0004246287176564637, 'samples': 7597440, 'steps': 39569, 'loss/train': 1.8463135957717896}}}
+11/07/2021 02:47:35 - INFO - __main__ - Step 39576: {'lr': 0.00042460593134470426, 'samples': 7598592, 'steps': 39575, 'loss/train': 1.1359695196151733}}
+11/07/2021 02:47:37 - INFO - __main__ - Step 39580: {'lr': 0.0004245907388966804, 'samples': 7599360, 'steps': 39579, 'loss/train': 1.2286467552185059}}}
+11/07/2021 02:47:39 - INFO - __main__ - Step 39584: {'lr': 0.0004245755451899703, 'samples': 7600128, 'steps': 39583, 'loss/train': 2.1289525032043457}}}
+11/07/2021 02:47:41 - INFO - __main__ - Step 39588: {'lr': 0.00042456035022468344, 'samples': 7600896, 'steps': 39587, 'loss/train': 1.5494352579116821}}
+11/07/2021 02:47:42 - INFO - __main__ - Step 39592: {'lr': 0.00042454515400092944, 'samples': 7601664, 'steps': 39591, 'loss/train': 1.5542364120483398}}
+11/07/2021 02:47:45 - INFO - __main__ - Step 39596: {'lr': 0.00042452995651881764, 'samples': 7602432, 'steps': 39595, 'loss/train': 1.5693578720092773}}
+11/07/2021 02:47:47 - INFO - __main__ - Step 39601: {'lr': 0.00042451095789677943, 'samples': 7603392, 'steps': 39600, 'loss/train': 0.8249521255493164}}
+11/07/2021 02:47:47 - INFO - __main__ - Step 39601: {'lr': 0.00042451095789677943, 'samples': 7603392, 'steps': 39600, 'loss/train': 0.8249521255493164}}
+11/07/2021 02:47:50 - INFO - __main__ - Step 39608: {'lr': 0.00042448435652343223, 'samples': 7604736, 'steps': 39607, 'loss/train': 1.5574475526809692}}
+11/07/2021 02:47:52 - INFO - __main__ - Step 39612: {'lr': 0.00042446915400898565, 'samples': 7605504, 'steps': 39611, 'loss/train': 1.1934031248092651}}
+11/07/2021 02:47:55 - INFO - __main__ - Step 39617: {'lr': 0.0004244501490971454, 'samples': 7606464, 'steps': 39616, 'loss/train': 0.39124223589897156}}
+11/07/2021 02:47:57 - INFO - __main__ - Step 39621: {'lr': 0.000424434943752781, 'samples': 7607232, 'steps': 39620, 'loss/train': 0.9253093004226685}6}}
+11/07/2021 02:47:59 - INFO - __main__ - Step 39625: {'lr': 0.0004244197371508536, 'samples': 7608000, 'steps': 39624, 'loss/train': 1.5457366704940796}}}
+11/07/2021 02:48:01 - INFO - __main__ - Step 39629: {'lr': 0.0004244045292914726, 'samples': 7608768, 'steps': 39628, 'loss/train': 1.6657663583755493}}}
+11/07/2021 02:48:02 - INFO - __main__ - Step 39633: {'lr': 0.00042438932017474783, 'samples': 7609536, 'steps': 39632, 'loss/train': 1.414711594581604}}}
+11/07/2021 02:48:04 - INFO - __main__ - Step 39637: {'lr': 0.00042437410980078894, 'samples': 7610304, 'steps': 39636, 'loss/train': 1.1887015104293823}}
+11/07/2021 02:48:07 - INFO - __main__ - Step 39642: {'lr': 0.0004243550950655217, 'samples': 7611264, 'steps': 39641, 'loss/train': 0.8495831489562988}}}
+11/07/2021 02:48:09 - INFO - __main__ - Step 39646: {'lr': 0.0004243398818631868, 'samples': 7612032, 'steps': 39645, 'loss/train': 1.6688364744186401}}}
+11/07/2021 02:48:09 - INFO - __main__ - Step 39646: {'lr': 0.0004243398818631868, 'samples': 7612032, 'steps': 39645, 'loss/train': 1.6688364744186401}}}
+11/07/2021 02:48:12 - INFO - __main__ - Step 39653: {'lr': 0.0004243132557348045, 'samples': 7613376, 'steps': 39652, 'loss/train': 0.45958590507507324}}
+11/07/2021 02:48:15 - INFO - __main__ - Step 39658: {'lr': 0.0004242942347153542, 'samples': 7614336, 'steps': 39657, 'loss/train': 1.1589655876159668}}}
+11/07/2021 02:48:15 - INFO - __main__ - Step 39658: {'lr': 0.0004242942347153542, 'samples': 7614336, 'steps': 39657, 'loss/train': 1.1589655876159668}}}
+11/07/2021 02:48:18 - INFO - __main__ - Step 39665: {'lr': 0.0004242676019897314, 'samples': 7615680, 'steps': 39664, 'loss/train': 1.6339011192321777}}}
+11/07/2021 02:48:20 - INFO - __main__ - Step 39669: {'lr': 0.0004242523815618473, 'samples': 7616448, 'steps': 39668, 'loss/train': 1.4685289859771729}}}
+11/07/2021 02:48:23 - INFO - __main__ - Step 39674: {'lr': 0.0004242333542604079, 'samples': 7617408, 'steps': 39673, 'loss/train': 1.5013810396194458}}}
+11/07/2021 02:48:23 - INFO - __main__ - Step 39674: {'lr': 0.0004242333542604079, 'samples': 7617408, 'steps': 39673, 'loss/train': 1.5013810396194458}}}
+11/07/2021 02:48:27 - INFO - __main__ - Step 39682: {'lr': 0.0004242029064958372, 'samples': 7618944, 'steps': 39681, 'loss/train': 1.0614537000656128}}}
+11/07/2021 02:48:29 - INFO - __main__ - Step 39686: {'lr': 0.00042418768072966163, 'samples': 7619712, 'steps': 39685, 'loss/train': 1.621649980545044}}}
+11/07/2021 02:48:30 - INFO - __main__ - Step 39690: {'lr': 0.00042417245370770547, 'samples': 7620480, 'steps': 39689, 'loss/train': 1.6081323623657227}}
+11/07/2021 02:48:32 - INFO - __main__ - Step 39694: {'lr': 0.0004241572254300786, 'samples': 7621248, 'steps': 39693, 'loss/train': 0.6049160957336426}}}
+11/07/2021 02:48:34 - INFO - __main__ - Step 39698: {'lr': 0.00042414199589689084, 'samples': 7622016, 'steps': 39697, 'loss/train': 1.3225457668304443}}
+11/07/2021 02:48:34 - INFO - __main__ - Step 39698: {'lr': 0.00042414199589689084, 'samples': 7622016, 'steps': 39697, 'loss/train': 1.3225457668304443}}
+11/07/2021 02:48:38 - INFO - __main__ - Step 39706: {'lr': 0.0004241115330642717, 'samples': 7623552, 'steps': 39705, 'loss/train': 1.345481514930725}3}}
+11/07/2021 02:48:40 - INFO - __main__ - Step 39710: {'lr': 0.00042409629976505994, 'samples': 7624320, 'steps': 39709, 'loss/train': 1.191588044166565}}}
+11/07/2021 02:48:43 - INFO - __main__ - Step 39715: {'lr': 0.0004240772563760432, 'samples': 7625280, 'steps': 39714, 'loss/train': 1.3761696815490723}}}
+11/07/2021 02:48:43 - INFO - __main__ - Step 39715: {'lr': 0.0004240772563760432, 'samples': 7625280, 'steps': 39714, 'loss/train': 1.3761696815490723}}}
+11/07/2021 02:48:47 - INFO - __main__ - Step 39723: {'lr': 0.0004240467828750064, 'samples': 7626816, 'steps': 39722, 'loss/train': 1.5825248956680298}}}
+11/07/2021 02:48:48 - INFO - __main__ - Step 39727: {'lr': 0.00042403154424228596, 'samples': 7627584, 'steps': 39726, 'loss/train': 0.6849703192710876}}
+11/07/2021 02:48:50 - INFO - __main__ - Step 39731: {'lr': 0.00042401630435491073, 'samples': 7628352, 'steps': 39730, 'loss/train': 1.7260664701461792}}
+11/07/2021 02:48:53 - INFO - __main__ - Step 39736: {'lr': 0.00042399725273150056, 'samples': 7629312, 'steps': 39735, 'loss/train': 1.8496798276901245}}
+11/07/2021 02:48:55 - INFO - __main__ - Step 39740: {'lr': 0.0004239820100215537, 'samples': 7630080, 'steps': 39739, 'loss/train': 1.3782191276550293}}}
+11/07/2021 02:48:57 - INFO - __main__ - Step 39744: {'lr': 0.000423966766057309, 'samples': 7630848, 'steps': 39743, 'loss/train': 1.6397227048873901}}}}
+11/07/2021 02:48:58 - INFO - __main__ - Step 39748: {'lr': 0.0004239515208388764, 'samples': 7631616, 'steps': 39747, 'loss/train': 1.706516981124878}}}}
+11/07/2021 02:49:01 - INFO - __main__ - Step 39752: {'lr': 0.00042393627436636597, 'samples': 7632384, 'steps': 39751, 'loss/train': 1.8266533613204956}}
+11/07/2021 02:49:03 - INFO - __main__ - Step 39757: {'lr': 0.0004239172145123481, 'samples': 7633344, 'steps': 39756, 'loss/train': 1.6792773008346558}}}
+11/07/2021 02:49:03 - INFO - __main__ - Step 39757: {'lr': 0.0004239172145123481, 'samples': 7633344, 'steps': 39756, 'loss/train': 1.6792773008346558}}}
+11/07/2021 02:49:06 - INFO - __main__ - Step 39764: {'lr': 0.0004238905274254661, 'samples': 7634688, 'steps': 39763, 'loss/train': 1.3256386518478394}}}
+11/07/2021 02:49:08 - INFO - __main__ - Step 39768: {'lr': 0.0004238752759377431, 'samples': 7635456, 'steps': 39767, 'loss/train': 1.544019103050232}}}}
+11/07/2021 02:49:11 - INFO - __main__ - Step 39773: {'lr': 0.0004238562098153281, 'samples': 7636416, 'steps': 39772, 'loss/train': 1.5938646793365479}}}
+11/07/2021 02:49:13 - INFO - __main__ - Step 39778: {'lr': 0.00042383714173449007, 'samples': 7637376, 'steps': 39777, 'loss/train': 1.3706766366958618}}
+11/07/2021 02:49:13 - INFO - __main__ - Step 39778: {'lr': 0.00042383714173449007, 'samples': 7637376, 'steps': 39777, 'loss/train': 1.3706766366958618}}
+11/07/2021 02:49:16 - INFO - __main__ - Step 39785: {'lr': 0.0004238104431315749, 'samples': 7638720, 'steps': 39784, 'loss/train': 1.6826781034469604}}}
+11/07/2021 02:49:19 - INFO - __main__ - Step 39789: {'lr': 0.0004237951850640555, 'samples': 7639488, 'steps': 39788, 'loss/train': 1.75411057472229}4}}}
+11/07/2021 02:49:21 - INFO - __main__ - Step 39794: {'lr': 0.0004237761107177068, 'samples': 7640448, 'steps': 39793, 'loss/train': 1.2133203744888306}}}
+11/07/2021 02:49:21 - INFO - __main__ - Step 39794: {'lr': 0.0004237761107177068, 'samples': 7640448, 'steps': 39793, 'loss/train': 1.2133203744888306}}}
+11/07/2021 02:49:24 - INFO - __main__ - Step 39801: {'lr': 0.00042374940334423194, 'samples': 7641792, 'steps': 39800, 'loss/train': 1.038809895515442}}}
+11/07/2021 02:49:26 - INFO - __main__ - Step 39805: {'lr': 0.0004237341402655692, 'samples': 7642560, 'steps': 39804, 'loss/train': 1.4463545083999634}}}
+11/07/2021 02:49:29 - INFO - __main__ - Step 39810: {'lr': 0.0004237150596559103, 'samples': 7643520, 'steps': 39809, 'loss/train': 1.6761316061019897}}}
+11/07/2021 02:49:29 - INFO - __main__ - Step 39810: {'lr': 0.0004237150596559103, 'samples': 7643520, 'steps': 39809, 'loss/train': 1.6761316061019897}}}
+11/07/2021 02:49:33 - INFO - __main__ - Step 39818: {'lr': 0.0004236845266103327, 'samples': 7645056, 'steps': 39817, 'loss/train': 1.579480528831482}}}}
+11/07/2021 02:49:35 - INFO - __main__ - Step 39822: {'lr': 0.00042366925820925915, 'samples': 7645824, 'steps': 39821, 'loss/train': 1.3526073694229126}}
+11/07/2021 02:49:37 - INFO - __main__ - Step 39826: {'lr': 0.0004236539885561427, 'samples': 7646592, 'steps': 39825, 'loss/train': 1.4713175296783447}}}
+11/07/2021 02:49:39 - INFO - __main__ - Step 39830: {'lr': 0.0004236387176510933, 'samples': 7647360, 'steps': 39829, 'loss/train': 1.5187652111053467}}}
+11/07/2021 02:49:41 - INFO - __main__ - Step 39835: {'lr': 0.0004236196272594186, 'samples': 7648320, 'steps': 39834, 'loss/train': 1.5928826332092285}}}
+11/07/2021 02:49:43 - INFO - __main__ - Step 39840: {'lr': 0.0004236005349119858, 'samples': 7649280, 'steps': 39839, 'loss/train': 1.6861557960510254}}}
+11/07/2021 02:49:45 - INFO - __main__ - Step 39844: {'lr': 0.0004235852596260382, 'samples': 7650048, 'steps': 39843, 'loss/train': 1.425424575805664}}}}
+11/07/2021 02:49:47 - INFO - __main__ - Step 39848: {'lr': 0.00042356998308865323, 'samples': 7650816, 'steps': 39847, 'loss/train': 2.0486652851104736}}
+11/07/2021 02:49:49 - INFO - __main__ - Step 39852: {'lr': 0.0004235547052999409, 'samples': 7651584, 'steps': 39851, 'loss/train': 1.3674862384796143}}}
+11/07/2021 02:49:51 - INFO - __main__ - Step 39856: {'lr': 0.0004235394262600114, 'samples': 7652352, 'steps': 39855, 'loss/train': 1.801565170288086}}}}
+11/07/2021 02:49:53 - INFO - __main__ - Step 39861: {'lr': 0.00042352032570074327, 'samples': 7653312, 'steps': 39860, 'loss/train': 1.4000568389892578}}
+11/07/2021 02:49:53 - INFO - __main__ - Step 39861: {'lr': 0.00042352032570074327, 'samples': 7653312, 'steps': 39860, 'loss/train': 1.4000568389892578}}
+11/07/2021 02:49:57 - INFO - __main__ - Step 39868: {'lr': 0.00042349358163402175, 'samples': 7654656, 'steps': 39867, 'loss/train': 2.038564920425415}}}
+11/07/2021 02:49:59 - INFO - __main__ - Step 39872: {'lr': 0.0004234782975903253, 'samples': 7655424, 'steps': 39871, 'loss/train': 1.6400891542434692}}}
+11/07/2021 02:50:01 - INFO - __main__ - Step 39877: {'lr': 0.0004234591907769681, 'samples': 7656384, 'steps': 39876, 'loss/train': 1.3981540203094482}}}
+11/07/2021 02:50:04 - INFO - __main__ - Step 39882: {'lr': 0.0004234400820096601, 'samples': 7657344, 'steps': 39881, 'loss/train': 1.6279277801513672}}}
+11/07/2021 02:50:04 - INFO - __main__ - Step 39882: {'lr': 0.0004234400820096601, 'samples': 7657344, 'steps': 39881, 'loss/train': 1.6279277801513672}}}
+11/07/2021 02:50:07 - INFO - __main__ - Step 39889: {'lr': 0.00042341332645320126, 'samples': 7658688, 'steps': 39888, 'loss/train': 1.503919243812561}}}
+11/07/2021 02:50:09 - INFO - __main__ - Step 39893: {'lr': 0.00042339803584473626, 'samples': 7659456, 'steps': 39892, 'loss/train': 1.4663480520248413}}
+11/07/2021 02:50:11 - INFO - __main__ - Step 39898: {'lr': 0.000423378920826232, 'samples': 7660416, 'steps': 39897, 'loss/train': 3.15498423576355}413}}
+11/07/2021 02:50:14 - INFO - __main__ - Step 39903: {'lr': 0.0004233598038546812, 'samples': 7661376, 'steps': 39902, 'loss/train': 1.5171977281570435}}}
+11/07/2021 02:50:14 - INFO - __main__ - Step 39903: {'lr': 0.0004233598038546812, 'samples': 7661376, 'steps': 39902, 'loss/train': 1.5171977281570435}}}
+11/07/2021 02:50:18 - INFO - __main__ - Step 39910: {'lr': 0.00042333303681380165, 'samples': 7662720, 'steps': 39909, 'loss/train': 1.294662594795227}}}
+11/07/2021 02:50:19 - INFO - __main__ - Step 39914: {'lr': 0.0004233177396436064, 'samples': 7663488, 'steps': 39913, 'loss/train': 1.651315689086914}}}}
+11/07/2021 02:50:21 - INFO - __main__ - Step 39919: {'lr': 0.00042329861642375347, 'samples': 7664448, 'steps': 39918, 'loss/train': 1.5415047407150269}}
+11/07/2021 02:50:24 - INFO - __main__ - Step 39924: {'lr': 0.00042327949125175844, 'samples': 7665408, 'steps': 39923, 'loss/train': 1.445731282234192}}}
+11/07/2021 02:50:26 - INFO - __main__ - Step 39928: {'lr': 0.000423264189708765, 'samples': 7666176, 'steps': 39927, 'loss/train': 1.2989650964736938}}}}
+11/07/2021 02:50:28 - INFO - __main__ - Step 39932: {'lr': 0.0004232488869166488, 'samples': 7666944, 'steps': 39931, 'loss/train': 1.7143346071243286}}}
+11/07/2021 02:50:28 - INFO - __main__ - Step 39932: {'lr': 0.0004232488869166488, 'samples': 7666944, 'steps': 39931, 'loss/train': 1.7143346071243286}}}
+11/07/2021 02:50:31 - INFO - __main__ - Step 39939: {'lr': 0.0004232221040250758, 'samples': 7668288, 'steps': 39938, 'loss/train': 1.211232304573059}}}}
+11/07/2021 02:50:33 - INFO - __main__ - Step 39944: {'lr': 0.0004232029710466671, 'samples': 7669248, 'steps': 39943, 'loss/train': 1.740206003189087}}}}
+11/07/2021 02:50:33 - INFO - __main__ - Step 39944: {'lr': 0.0004232029710466671, 'samples': 7669248, 'steps': 39943, 'loss/train': 1.740206003189087}}}}
+11/07/2021 02:50:38 - INFO - __main__ - Step 39952: {'lr': 0.0004231723542230885, 'samples': 7670784, 'steps': 39951, 'loss/train': 1.4010276794433594}}}
+11/07/2021 02:50:40 - INFO - __main__ - Step 39956: {'lr': 0.0004231570439385531, 'samples': 7671552, 'steps': 39955, 'loss/train': 2.2703516483306885}}}
+11/07/2021 02:50:41 - INFO - __main__ - Step 39960: {'lr': 0.0004231417324056674, 'samples': 7672320, 'steps': 39959, 'loss/train': 1.5038126707077026}}}
+11/07/2021 02:50:44 - INFO - __main__ - Step 39965: {'lr': 0.00042312259123423584, 'samples': 7673280, 'steps': 39964, 'loss/train': 1.3081835508346558}}
+11/07/2021 02:50:46 - INFO - __main__ - Step 39969: {'lr': 0.00042310727689296563, 'samples': 7674048, 'steps': 39968, 'loss/train': 0.4142704904079437}}
+11/07/2021 02:50:48 - INFO - __main__ - Step 39973: {'lr': 0.00042309196130370396, 'samples': 7674816, 'steps': 39972, 'loss/train': 1.4492918252944946}}
+11/07/2021 02:50:50 - INFO - __main__ - Step 39977: {'lr': 0.00042307664446656116, 'samples': 7675584, 'steps': 39976, 'loss/train': 1.8707165718078613}}
+11/07/2021 02:50:51 - INFO - __main__ - Step 39981: {'lr': 0.0004230613263816478, 'samples': 7676352, 'steps': 39980, 'loss/train': 1.6573978662490845}}}
+11/07/2021 02:50:53 - INFO - __main__ - Step 39985: {'lr': 0.00042304600704907416, 'samples': 7677120, 'steps': 39984, 'loss/train': 1.2177273035049438}}
+11/07/2021 02:50:53 - INFO - __main__ - Step 39985: {'lr': 0.00042304600704907416, 'samples': 7677120, 'steps': 39984, 'loss/train': 1.2177273035049438}}
+11/07/2021 02:50:57 - INFO - __main__ - Step 39993: {'lr': 0.0004230153646413881, 'samples': 7678656, 'steps': 39992, 'loss/train': 1.6313539743423462}}}
+11/07/2021 02:50:59 - INFO - __main__ - Step 39997: {'lr': 0.00042300004156649654, 'samples': 7679424, 'steps': 39996, 'loss/train': 1.631992220878601}}}
+11/07/2021 02:51:01 - INFO - __main__ - Step 40001: {'lr': 0.0004229847172443866, 'samples': 7680192, 'steps': 40000, 'loss/train': 1.474384069442749}}}}
+11/07/2021 02:51:04 - INFO - __main__ - Step 40006: {'lr': 0.00042296556008801663, 'samples': 7681152, 'steps': 40005, 'loss/train': 1.5770862102508545}}
+11/07/2021 02:51:06 - INFO - __main__ - Step 40010: {'lr': 0.0004229502329600692, 'samples': 7681920, 'steps': 40009, 'loss/train': 1.3491777181625366}}}
+11/07/2021 02:51:06 - INFO - __main__ - Step 40010: {'lr': 0.0004229502329600692, 'samples': 7681920, 'steps': 40009, 'loss/train': 1.3491777181625366}}}
+11/07/2021 02:51:09 - INFO - __main__ - Step 40017: {'lr': 0.0004229234074859726, 'samples': 7683264, 'steps': 40016, 'loss/train': 1.6694526672363281}}}
+11/07/2021 02:51:12 - INFO - __main__ - Step 40023: {'lr': 0.0004229004111836907, 'samples': 7684416, 'steps': 40022, 'loss/train': 1.340185523033142}}}}
+11/07/2021 02:51:14 - INFO - __main__ - Step 40027: {'lr': 0.00042288507875735455, 'samples': 7685184, 'steps': 40026, 'loss/train': 1.5051108598709106}}
+11/07/2021 02:51:14 - INFO - __main__ - Step 40027: {'lr': 0.00042288507875735455, 'samples': 7685184, 'steps': 40026, 'loss/train': 1.5051108598709106}}
+11/07/2021 02:51:17 - INFO - __main__ - Step 40033: {'lr': 0.00042286207778090447, 'samples': 7686336, 'steps': 40032, 'loss/train': 1.6635338068008423}}
+11/07/2021 02:51:20 - INFO - __main__ - Step 40038: {'lr': 0.0004228429081585664, 'samples': 7687296, 'steps': 40037, 'loss/train': 1.2760931253433228}}}
+11/07/2021 02:51:22 - INFO - __main__ - Step 40042: {'lr': 0.0004228275710588394, 'samples': 7688064, 'steps': 40041, 'loss/train': 1.1090223789215088}}}
+11/07/2021 02:51:23 - INFO - __main__ - Step 40046: {'lr': 0.00042281223271313734, 'samples': 7688832, 'steps': 40045, 'loss/train': 1.2158195972442627}}
+11/07/2021 02:51:26 - INFO - __main__ - Step 40051: {'lr': 0.000422793058029026, 'samples': 7689792, 'steps': 40050, 'loss/train': 1.6261519193649292}7}}
+11/07/2021 02:51:26 - INFO - __main__ - Step 40051: {'lr': 0.000422793058029026, 'samples': 7689792, 'steps': 40050, 'loss/train': 1.6261519193649292}7}}
+11/07/2021 02:51:30 - INFO - __main__ - Step 40059: {'lr': 0.0004227623744859276, 'samples': 7691328, 'steps': 40058, 'loss/train': 1.6112170219421387}}}
+11/07/2021 02:51:32 - INFO - __main__ - Step 40063: {'lr': 0.0004227470308460657, 'samples': 7692096, 'steps': 40062, 'loss/train': 1.5447250604629517}}}
+11/07/2021 02:51:33 - INFO - __main__ - Step 40067: {'lr': 0.00042273168596080934, 'samples': 7692864, 'steps': 40066, 'loss/train': 1.5752909183502197}}
+11/07/2021 02:51:35 - INFO - __main__ - Step 40071: {'lr': 0.00042271633983026935, 'samples': 7693632, 'steps': 40070, 'loss/train': 1.406765341758728}}}
+11/07/2021 02:51:38 - INFO - __main__ - Step 40076: {'lr': 0.00042269715541608265, 'samples': 7694592, 'steps': 40075, 'loss/train': 0.6684977412223816}}
+11/07/2021 02:51:40 - INFO - __main__ - Step 40080: {'lr': 0.00042268180648405884, 'samples': 7695360, 'steps': 40079, 'loss/train': 1.6849303245544434}}
+11/07/2021 02:51:42 - INFO - __main__ - Step 40084: {'lr': 0.0004226664563071109, 'samples': 7696128, 'steps': 40083, 'loss/train': 0.9506791234016418}}}
+11/07/2021 02:51:44 - INFO - __main__ - Step 40088: {'lr': 0.0004226511048853495, 'samples': 7696896, 'steps': 40087, 'loss/train': 1.7920674085617065}}}
+11/07/2021 02:51:45 - INFO - __main__ - Step 40092: {'lr': 0.0004226357522188853, 'samples': 7697664, 'steps': 40091, 'loss/train': 1.5058112144470215}}}
+11/07/2021 02:51:48 - INFO - __main__ - Step 40097: {'lr': 0.00042261655963561043, 'samples': 7698624, 'steps': 40096, 'loss/train': 1.6845612525939941}}
+11/07/2021 02:51:50 - INFO - __main__ - Step 40101: {'lr': 0.00042260120416896975, 'samples': 7699392, 'steps': 40100, 'loss/train': 1.2876131534576416}}
+11/07/2021 02:51:52 - INFO - __main__ - Step 40105: {'lr': 0.00042258584745798595, 'samples': 7700160, 'steps': 40104, 'loss/train': 1.4063727855682373}}
+11/07/2021 02:51:54 - INFO - __main__ - Step 40109: {'lr': 0.0004225704895027699, 'samples': 7700928, 'steps': 40108, 'loss/train': 1.637282133102417}3}}
+11/07/2021 02:51:55 - INFO - __main__ - Step 40113: {'lr': 0.0004225551303034322, 'samples': 7701696, 'steps': 40112, 'loss/train': 1.6477985382080078}}}
+11/07/2021 02:51:57 - INFO - __main__ - Step 40117: {'lr': 0.0004225397698600837, 'samples': 7702464, 'steps': 40116, 'loss/train': 1.5630342960357666}}}
+11/07/2021 02:52:00 - INFO - __main__ - Step 40123: {'lr': 0.00042251672686278275, 'samples': 7703616, 'steps': 40122, 'loss/train': 1.510049819946289}}}
+11/07/2021 02:52:00 - INFO - __main__ - Step 40123: {'lr': 0.00042251672686278275, 'samples': 7703616, 'steps': 40122, 'loss/train': 1.510049819946289}}}
+11/07/2021 02:52:04 - INFO - __main__ - Step 40130: {'lr': 0.0004224898398290893, 'samples': 7704960, 'steps': 40129, 'loss/train': 1.2647972106933594}}}
+11/07/2021 02:52:06 - INFO - __main__ - Step 40134: {'lr': 0.0004224744740999302, 'samples': 7705728, 'steps': 40133, 'loss/train': 1.0452232360839844}}}
+11/07/2021 02:52:08 - INFO - __main__ - Step 40138: {'lr': 0.0004224591071273416, 'samples': 7706496, 'steps': 40137, 'loss/train': 1.529614806175232}}}}
+11/07/2021 02:52:10 - INFO - __main__ - Step 40142: {'lr': 0.00042244373891143453, 'samples': 7707264, 'steps': 40141, 'loss/train': 3.466099739074707}}}
+11/07/2021 02:52:10 - INFO - __main__ - Step 40142: {'lr': 0.00042244373891143453, 'samples': 7707264, 'steps': 40141, 'loss/train': 3.466099739074707}}}
+11/07/2021 02:52:13 - INFO - __main__ - Step 40149: {'lr': 0.0004224168415421948, 'samples': 7708608, 'steps': 40148, 'loss/train': 1.2203428745269775}}}
+11/07/2021 02:52:16 - INFO - __main__ - Step 40154: {'lr': 0.00042239762680490944, 'samples': 7709568, 'steps': 40153, 'loss/train': 1.6479051113128662}}
+11/07/2021 02:52:18 - INFO - __main__ - Step 40158: {'lr': 0.00042238225361683593, 'samples': 7710336, 'steps': 40157, 'loss/train': 1.1780622005462646}}
+11/07/2021 02:52:20 - INFO - __main__ - Step 40162: {'lr': 0.0004223668791859979, 'samples': 7711104, 'steps': 40161, 'loss/train': 1.98379385471344}46}}
+11/07/2021 02:52:21 - INFO - __main__ - Step 40166: {'lr': 0.00042235150351250617, 'samples': 7711872, 'steps': 40165, 'loss/train': 1.8517236709594727}}
+11/07/2021 02:52:23 - INFO - __main__ - Step 40170: {'lr': 0.0004223361265964716, 'samples': 7712640, 'steps': 40169, 'loss/train': 1.5532838106155396}}}
+11/07/2021 02:52:26 - INFO - __main__ - Step 40175: {'lr': 0.00042231690370427135, 'samples': 7713600, 'steps': 40174, 'loss/train': 1.6584599018096924}}
+11/07/2021 02:52:28 - INFO - __main__ - Step 40179: {'lr': 0.00042230152399292065, 'samples': 7714368, 'steps': 40178, 'loss/train': 1.0819612741470337}}
+11/07/2021 02:52:30 - INFO - __main__ - Step 40183: {'lr': 0.0004222861430393875, 'samples': 7715136, 'steps': 40182, 'loss/train': 1.5716710090637207}}}
+11/07/2021 02:52:31 - INFO - __main__ - Step 40187: {'lr': 0.0004222707608437827, 'samples': 7715904, 'steps': 40186, 'loss/train': 1.881104826927185}}}}
+11/07/2021 02:52:33 - INFO - __main__ - Step 40191: {'lr': 0.00042225537740621713, 'samples': 7716672, 'steps': 40190, 'loss/train': 1.8040450811386108}}
+11/07/2021 02:52:36 - INFO - __main__ - Step 40196: {'lr': 0.0004222361463629218, 'samples': 7717632, 'steps': 40195, 'loss/train': 1.5748728513717651}}}
+11/07/2021 02:52:36 - INFO - __main__ - Step 40196: {'lr': 0.0004222361463629218, 'samples': 7717632, 'steps': 40195, 'loss/train': 1.5748728513717651}}}
+11/07/2021 02:52:40 - INFO - __main__ - Step 40204: {'lr': 0.0004222053726581782, 'samples': 7719168, 'steps': 40203, 'loss/train': 1.7543646097183228}}}
+11/07/2021 02:52:42 - INFO - __main__ - Step 40208: {'lr': 0.00042218998394351684, 'samples': 7719936, 'steps': 40207, 'loss/train': 1.4205678701400757}}
+11/07/2021 02:52:44 - INFO - __main__ - Step 40212: {'lr': 0.00042217459398747703, 'samples': 7720704, 'steps': 40211, 'loss/train': 1.9883413314819336}}
+11/07/2021 02:52:46 - INFO - __main__ - Step 40216: {'lr': 0.00042215920279016993, 'samples': 7721472, 'steps': 40215, 'loss/train': 1.5851691961288452}}
+11/07/2021 02:52:46 - INFO - __main__ - Step 40216: {'lr': 0.00042215920279016993, 'samples': 7721472, 'steps': 40215, 'loss/train': 1.5851691961288452}}
+11/07/2021 02:52:50 - INFO - __main__ - Step 40224: {'lr': 0.0004221284166721971, 'samples': 7723008, 'steps': 40223, 'loss/train': 1.2773767709732056}}}
+11/07/2021 02:52:52 - INFO - __main__ - Step 40228: {'lr': 0.00042211302175175334, 'samples': 7723776, 'steps': 40227, 'loss/train': 1.2917256355285645}}
+11/07/2021 02:52:54 - INFO - __main__ - Step 40232: {'lr': 0.0004220976255904861, 'samples': 7724544, 'steps': 40231, 'loss/train': 1.606628656387329}5}}
+11/07/2021 02:52:56 - INFO - __main__ - Step 40236: {'lr': 0.00042208222818850634, 'samples': 7725312, 'steps': 40235, 'loss/train': 1.2168179750442505}}
+11/07/2021 02:52:56 - INFO - __main__ - Step 40236: {'lr': 0.00042208222818850634, 'samples': 7725312, 'steps': 40235, 'loss/train': 1.2168179750442505}}
+11/07/2021 02:52:56 - INFO - __main__ - Step 40236: {'lr': 0.00042208222818850634, 'samples': 7725312, 'steps': 40235, 'loss/train': 1.2168179750442505}}
+11/07/2021 02:53:02 - INFO - __main__ - Step 40248: {'lr': 0.0004220360285394017, 'samples': 7727616, 'steps': 40247, 'loss/train': 1.0947076082229614}}}
+11/07/2021 02:53:04 - INFO - __main__ - Step 40253: {'lr': 0.00042201677539097294, 'samples': 7728576, 'steps': 40252, 'loss/train': 1.3090541362762451}}
+11/07/2021 02:53:04 - INFO - __main__ - Step 40253: {'lr': 0.00042201677539097294, 'samples': 7728576, 'steps': 40252, 'loss/train': 1.3090541362762451}}
+11/07/2021 02:53:08 - INFO - __main__ - Step 40261: {'lr': 0.00042198596632315576, 'samples': 7730112, 'steps': 40260, 'loss/train': 5.88883113861084}1}}
+11/07/2021 02:53:10 - INFO - __main__ - Step 40265: {'lr': 0.0004219705599293303, 'samples': 7730880, 'steps': 40264, 'loss/train': 1.0776889324188232}}}
+11/07/2021 02:53:12 - INFO - __main__ - Step 40269: {'lr': 0.00042195515229570833, 'samples': 7731648, 'steps': 40268, 'loss/train': 1.5870234966278076}}
+11/07/2021 02:53:14 - INFO - __main__ - Step 40274: {'lr': 0.0004219358910103862, 'samples': 7732608, 'steps': 40273, 'loss/train': 1.3778915405273438}}}
+11/07/2021 02:53:14 - INFO - __main__ - Step 40274: {'lr': 0.0004219358910103862, 'samples': 7732608, 'steps': 40273, 'loss/train': 1.3778915405273438}}}
+11/07/2021 02:53:19 - INFO - __main__ - Step 40282: {'lr': 0.000421905068925435, 'samples': 7734144, 'steps': 40281, 'loss/train': 1.269433856010437}8}}}
+11/07/2021 02:53:20 - INFO - __main__ - Step 40286: {'lr': 0.00042188965602391726, 'samples': 7734912, 'steps': 40285, 'loss/train': 1.637909173965454}}}
+11/07/2021 02:53:22 - INFO - __main__ - Step 40290: {'lr': 0.0004218742418831863, 'samples': 7735680, 'steps': 40289, 'loss/train': 1.6381466388702393}}}
+11/07/2021 02:53:22 - INFO - __main__ - Step 40290: {'lr': 0.0004218742418831863, 'samples': 7735680, 'steps': 40289, 'loss/train': 1.6381466388702393}}}
+11/07/2021 02:53:26 - INFO - __main__ - Step 40298: {'lr': 0.00042184340988452924, 'samples': 7737216, 'steps': 40297, 'loss/train': 1.3267289400100708}}
+11/07/2021 02:53:28 - INFO - __main__ - Step 40302: {'lr': 0.00042182799202682543, 'samples': 7737984, 'steps': 40301, 'loss/train': 1.7396727800369263}}
+11/07/2021 02:53:30 - INFO - __main__ - Step 40306: {'lr': 0.00042181257293035293, 'samples': 7738752, 'steps': 40305, 'loss/train': 0.8169730305671692}}
+11/07/2021 02:53:33 - INFO - __main__ - Step 40311: {'lr': 0.00042179329731791324, 'samples': 7739712, 'steps': 40310, 'loss/train': 1.418582558631897}}}
+11/07/2021 02:53:33 - INFO - __main__ - Step 40311: {'lr': 0.00042179329731791324, 'samples': 7739712, 'steps': 40310, 'loss/train': 1.418582558631897}}}
+11/07/2021 02:53:36 - INFO - __main__ - Step 40318: {'lr': 0.00042176630820943515, 'samples': 7741056, 'steps': 40317, 'loss/train': 1.3726780414581299}}
+11/07/2021 02:53:38 - INFO - __main__ - Step 40323: {'lr': 0.00042174702795291574, 'samples': 7742016, 'steps': 40322, 'loss/train': 1.3882884979248047}}
+11/07/2021 02:53:41 - INFO - __main__ - Step 40328: {'lr': 0.00042172774576173226, 'samples': 7742976, 'steps': 40327, 'loss/train': 2.0860137939453125}}
+11/07/2021 02:53:43 - INFO - __main__ - Step 40332: {'lr': 0.0004217123186159735, 'samples': 7743744, 'steps': 40331, 'loss/train': 1.5076559782028198}}}
+11/07/2021 02:53:45 - INFO - __main__ - Step 40336: {'lr': 0.00042169689023227987, 'samples': 7744512, 'steps': 40335, 'loss/train': 1.7182577848434448}}
+11/07/2021 02:53:46 - INFO - __main__ - Step 40340: {'lr': 0.0004216814606107627, 'samples': 7745280, 'steps': 40339, 'loss/train': 1.6288928985595703}}}
+11/07/2021 02:53:48 - INFO - __main__ - Step 40344: {'lr': 0.00042166602975153333, 'samples': 7746048, 'steps': 40343, 'loss/train': 1.4574334621429443}}
+11/07/2021 02:53:48 - INFO - __main__ - Step 40344: {'lr': 0.00042166602975153333, 'samples': 7746048, 'steps': 40343, 'loss/train': 1.4574334621429443}}
+11/07/2021 02:53:52 - INFO - __main__ - Step 40352: {'lr': 0.0004216351643203828, 'samples': 7747584, 'steps': 40351, 'loss/train': 1.381427526473999}}}}
+11/07/2021 02:53:55 - INFO - __main__ - Step 40356: {'lr': 0.00042161972974868415, 'samples': 7748352, 'steps': 40355, 'loss/train': 1.5978648662567139}}
+11/07/2021 02:53:56 - INFO - __main__ - Step 40360: {'lr': 0.0004216042939397182, 'samples': 7749120, 'steps': 40359, 'loss/train': 1.4361519813537598}}}
+11/07/2021 02:53:59 - INFO - __main__ - Step 40365: {'lr': 0.0004215849974387733, 'samples': 7750080, 'steps': 40364, 'loss/train': 1.1762034893035889}}}
+11/07/2021 02:54:01 - INFO - __main__ - Step 40369: {'lr': 0.00042156955884636307, 'samples': 7750848, 'steps': 40368, 'loss/train': 1.3229519128799438}}
+11/07/2021 02:54:03 - INFO - __main__ - Step 40373: {'lr': 0.00042155411901704723, 'samples': 7751616, 'steps': 40372, 'loss/train': 1.645806074142456}}}
+11/07/2021 02:54:05 - INFO - __main__ - Step 40377: {'lr': 0.00042153867795093714, 'samples': 7752384, 'steps': 40376, 'loss/train': 1.8111679553985596}}
+11/07/2021 02:54:06 - INFO - __main__ - Step 40381: {'lr': 0.0004215232356481442, 'samples': 7753152, 'steps': 40380, 'loss/train': 1.472200632095337}6}}
+11/07/2021 02:54:09 - INFO - __main__ - Step 40386: {'lr': 0.00042150393103073736, 'samples': 7754112, 'steps': 40385, 'loss/train': 1.0497719049453735}}
+11/07/2021 02:54:09 - INFO - __main__ - Step 40386: {'lr': 0.00042150393103073736, 'samples': 7754112, 'steps': 40385, 'loss/train': 1.0497719049453735}}
+11/07/2021 02:54:12 - INFO - __main__ - Step 40393: {'lr': 0.00042147690132078136, 'samples': 7755456, 'steps': 40392, 'loss/train': 1.670060396194458}}}
+11/07/2021 02:54:12 - INFO - __main__ - Step 40393: {'lr': 0.00042147690132078136, 'samples': 7755456, 'steps': 40392, 'loss/train': 1.670060396194458}}}
+11/07/2021 02:54:16 - INFO - __main__ - Step 40401: {'lr': 0.00042144600558783284, 'samples': 7756992, 'steps': 40400, 'loss/train': 1.6899981498718262}}
+11/07/2021 02:54:16 - INFO - __main__ - Step 40401: {'lr': 0.00042144600558783284, 'samples': 7756992, 'steps': 40400, 'loss/train': 1.6899981498718262}}
+11/07/2021 02:54:20 - INFO - __main__ - Step 40409: {'lr': 0.0004214151049108252, 'samples': 7758528, 'steps': 40408, 'loss/train': 1.743821144104004}2}}
+11/07/2021 02:54:22 - INFO - __main__ - Step 40413: {'lr': 0.00042139965271857774, 'samples': 7759296, 'steps': 40412, 'loss/train': 1.7358777523040771}}
+11/07/2021 02:54:24 - INFO - __main__ - Step 40418: {'lr': 0.0004213803357406055, 'samples': 7760256, 'steps': 40417, 'loss/train': 1.7742410898208618}}}
+11/07/2021 02:54:27 - INFO - __main__ - Step 40422: {'lr': 0.0004213648807682332, 'samples': 7761024, 'steps': 40421, 'loss/train': 1.5297152996063232}}}
+11/07/2021 02:54:29 - INFO - __main__ - Step 40426: {'lr': 0.00042134942456043104, 'samples': 7761792, 'steps': 40425, 'loss/train': 1.590003490447998}}}
+11/07/2021 02:54:30 - INFO - __main__ - Step 40430: {'lr': 0.0004213339671173103, 'samples': 7762560, 'steps': 40429, 'loss/train': 1.6742734909057617}}}
+11/07/2021 02:54:32 - INFO - __main__ - Step 40434: {'lr': 0.00042131850843898255, 'samples': 7763328, 'steps': 40433, 'loss/train': 1.5195480585098267}}
+11/07/2021 02:54:32 - INFO - __main__ - Step 40434: {'lr': 0.00042131850843898255, 'samples': 7763328, 'steps': 40433, 'loss/train': 1.5195480585098267}}
+11/07/2021 02:54:32 - INFO - __main__ - Step 40434: {'lr': 0.00042131850843898255, 'samples': 7763328, 'steps': 40433, 'loss/train': 1.5195480585098267}}
+11/07/2021 02:54:38 - INFO - __main__ - Step 40445: {'lr': 0.0004212759907054546, 'samples': 7765440, 'steps': 40444, 'loss/train': 1.7988765239715576}}}
+11/07/2021 02:54:41 - INFO - __main__ - Step 40450: {'lr': 0.0004212566613758299, 'samples': 7766400, 'steps': 40449, 'loss/train': 1.6221541166305542}}}
+11/07/2021 02:54:43 - INFO - __main__ - Step 40455: {'lr': 0.0004212373301170649, 'samples': 7767360, 'steps': 40454, 'loss/train': 1.7538222074508667}}}
+11/07/2021 02:54:43 - INFO - __main__ - Step 40455: {'lr': 0.0004212373301170649, 'samples': 7767360, 'steps': 40454, 'loss/train': 1.7538222074508667}}}
+11/07/2021 02:54:47 - INFO - __main__ - Step 40462: {'lr': 0.000421210263114253, 'samples': 7768704, 'steps': 40461, 'loss/train': 1.7173820734024048}}}}
+11/07/2021 02:54:48 - INFO - __main__ - Step 40466: {'lr': 0.00042119479455828153, 'samples': 7769472, 'steps': 40465, 'loss/train': 1.2135385274887085}}
+11/07/2021 02:54:51 - INFO - __main__ - Step 40471: {'lr': 0.0004211754571277313, 'samples': 7770432, 'steps': 40470, 'loss/train': 1.7979527711868286}}}
+11/07/2021 02:54:53 - INFO - __main__ - Step 40475: {'lr': 0.0004211599857949583, 'samples': 7771200, 'steps': 40474, 'loss/train': 1.609128713607788}}}}
+11/07/2021 02:54:53 - INFO - __main__ - Step 40475: {'lr': 0.0004211599857949583, 'samples': 7771200, 'steps': 40474, 'loss/train': 1.609128713607788}}}}
+11/07/2021 02:54:56 - INFO - __main__ - Step 40482: {'lr': 0.00042113290799347376, 'samples': 7772544, 'steps': 40481, 'loss/train': 1.779977560043335}}}
+11/07/2021 02:54:59 - INFO - __main__ - Step 40487: {'lr': 0.00042111356439336877, 'samples': 7773504, 'steps': 40486, 'loss/train': 1.8205519914627075}}
+11/07/2021 02:55:01 - INFO - __main__ - Step 40492: {'lr': 0.0004210942188657356, 'samples': 7774464, 'steps': 40491, 'loss/train': 1.0204192399978638}}}
+11/07/2021 02:55:01 - INFO - __main__ - Step 40492: {'lr': 0.0004210942188657356, 'samples': 7774464, 'steps': 40491, 'loss/train': 1.0204192399978638}}}
+11/07/2021 02:55:04 - INFO - __main__ - Step 40499: {'lr': 0.00042106713188921647, 'samples': 7775808, 'steps': 40498, 'loss/train': 1.7913703918457031}}
+11/07/2021 02:55:07 - INFO - __main__ - Step 40503: {'lr': 0.00042105165192111684, 'samples': 7776576, 'steps': 40502, 'loss/train': 1.5947679281234741}}
+11/07/2021 02:55:09 - INFO - __main__ - Step 40507: {'lr': 0.00042103617071984544, 'samples': 7777344, 'steps': 40506, 'loss/train': 1.195376992225647}}}
+11/07/2021 02:55:11 - INFO - __main__ - Step 40511: {'lr': 0.000421020688285514, 'samples': 7778112, 'steps': 40510, 'loss/train': 1.4846168756484985}}}}
+11/07/2021 02:55:13 - INFO - __main__ - Step 40515: {'lr': 0.0004210052046182339, 'samples': 7778880, 'steps': 40514, 'loss/train': 1.8797236680984497}}}
+11/07/2021 02:55:15 - INFO - __main__ - Step 40519: {'lr': 0.00042098971971811695, 'samples': 7779648, 'steps': 40518, 'loss/train': 1.330376148223877}}}
+11/07/2021 02:55:17 - INFO - __main__ - Step 40523: {'lr': 0.0004209742335852747, 'samples': 7780416, 'steps': 40522, 'loss/train': 1.586439609527588}}}}
+11/07/2021 02:55:19 - INFO - __main__ - Step 40528: {'lr': 0.0004209548741858721, 'samples': 7781376, 'steps': 40527, 'loss/train': 1.5555566549301147}}}
+11/07/2021 02:55:21 - INFO - __main__ - Step 40532: {'lr': 0.0004209393852798062, 'samples': 7782144, 'steps': 40531, 'loss/train': 1.7007616758346558}}}
+11/07/2021 02:55:21 - INFO - __main__ - Step 40532: {'lr': 0.0004209393852798062, 'samples': 7782144, 'steps': 40531, 'loss/train': 1.7007616758346558}}}
+11/07/2021 02:55:25 - INFO - __main__ - Step 40539: {'lr': 0.00042091227672888624, 'samples': 7783488, 'steps': 40538, 'loss/train': 1.7245628833770752}}
+11/07/2021 02:55:27 - INFO - __main__ - Step 40544: {'lr': 0.0004208929111678811, 'samples': 7784448, 'steps': 40543, 'loss/train': 1.6190506219863892}}}
+11/07/2021 02:55:29 - INFO - __main__ - Step 40548: {'lr': 0.00042087741733303575, 'samples': 7785216, 'steps': 40547, 'loss/train': 1.1815096139907837}}
+11/07/2021 02:55:29 - INFO - __main__ - Step 40548: {'lr': 0.00042087741733303575, 'samples': 7785216, 'steps': 40547, 'loss/train': 1.1815096139907837}}
+11/07/2021 02:55:32 - INFO - __main__ - Step 40555: {'lr': 0.0004208503001578266, 'samples': 7786560, 'steps': 40554, 'loss/train': 1.30928373336792}37}}
+11/07/2021 02:55:35 - INFO - __main__ - Step 40560: {'lr': 0.00042083092843745275, 'samples': 7787520, 'steps': 40559, 'loss/train': 1.7562403678894043}}
+11/07/2021 02:55:37 - INFO - __main__ - Step 40565: {'lr': 0.0004208115547927345, 'samples': 7788480, 'steps': 40564, 'loss/train': 1.2707369327545166}}}
+11/07/2021 02:55:37 - INFO - __main__ - Step 40565: {'lr': 0.0004208115547927345, 'samples': 7788480, 'steps': 40564, 'loss/train': 1.2707369327545166}}}
+11/07/2021 02:55:41 - INFO - __main__ - Step 40572: {'lr': 0.0004207844284576455, 'samples': 7789824, 'steps': 40571, 'loss/train': 1.7188644409179688}}}
+11/07/2021 02:55:43 - INFO - __main__ - Step 40576: {'lr': 0.0004207689260017369, 'samples': 7790592, 'steps': 40575, 'loss/train': 1.788718581199646}}}}
+11/07/2021 02:55:45 - INFO - __main__ - Step 40581: {'lr': 0.0004207495462005828, 'samples': 7791552, 'steps': 40580, 'loss/train': 1.9620747566223145}}}
+11/07/2021 02:55:45 - INFO - __main__ - Step 40581: {'lr': 0.0004207495462005828, 'samples': 7791552, 'steps': 40580, 'loss/train': 1.9620747566223145}}}
+11/07/2021 02:55:49 - INFO - __main__ - Step 40588: {'lr': 0.0004207224112476573, 'samples': 7792896, 'steps': 40587, 'loss/train': 1.7950011491775513}}}
+11/07/2021 02:55:51 - INFO - __main__ - Step 40592: {'lr': 0.00042070690386788545, 'samples': 7793664, 'steps': 40591, 'loss/train': 1.5835875272750854}}
+11/07/2021 02:55:53 - INFO - __main__ - Step 40596: {'lr': 0.00042069139525742727, 'samples': 7794432, 'steps': 40595, 'loss/train': 1.6492644548416138}}
+11/07/2021 02:55:55 - INFO - __main__ - Step 40601: {'lr': 0.00042067200776387215, 'samples': 7795392, 'steps': 40600, 'loss/train': 1.5179119110107422}}
+11/07/2021 02:55:55 - INFO - __main__ - Step 40601: {'lr': 0.00042067200776387215, 'samples': 7795392, 'steps': 40600, 'loss/train': 1.5179119110107422}}
+11/07/2021 02:56:00 - INFO - __main__ - Step 40609: {'lr': 0.0004206409837753618, 'samples': 7796928, 'steps': 40608, 'loss/train': 1.832965612411499}2}}
+11/07/2021 02:56:01 - INFO - __main__ - Step 40613: {'lr': 0.0004206254699357341, 'samples': 7797696, 'steps': 40612, 'loss/train': 1.1263415813446045}}}
+11/07/2021 02:56:03 - INFO - __main__ - Step 40617: {'lr': 0.0004206099548660071, 'samples': 7798464, 'steps': 40616, 'loss/train': 1.47562575340271}5}}}
+11/07/2021 02:56:06 - INFO - __main__ - Step 40622: {'lr': 0.00042059055929919163, 'samples': 7799424, 'steps': 40621, 'loss/train': 1.4647282361984253}}
+11/07/2021 02:56:08 - INFO - __main__ - Step 40626: {'lr': 0.0004205750414621503, 'samples': 7800192, 'steps': 40625, 'loss/train': 1.3805701732635498}}}
+11/07/2021 02:56:08 - INFO - __main__ - Step 40626: {'lr': 0.0004205750414621503, 'samples': 7800192, 'steps': 40625, 'loss/train': 1.3805701732635498}}}
+11/07/2021 02:56:11 - INFO - __main__ - Step 40633: {'lr': 0.00042054788228834374, 'samples': 7801536, 'steps': 40632, 'loss/train': 1.3163074254989624}}
+11/07/2021 02:56:14 - INFO - __main__ - Step 40639: {'lr': 0.00042052459999948323, 'samples': 7802688, 'steps': 40638, 'loss/train': 1.222219467163086}}}
+11/07/2021 02:56:14 - INFO - __main__ - Step 40639: {'lr': 0.00042052459999948323, 'samples': 7802688, 'steps': 40638, 'loss/train': 1.222219467163086}}}
+11/07/2021 02:56:18 - INFO - __main__ - Step 40646: {'lr': 0.00042049743383314577, 'samples': 7804032, 'steps': 40645, 'loss/train': 1.396903395652771}}}
+11/07/2021 02:56:19 - INFO - __main__ - Step 40650: {'lr': 0.00042048190861936866, 'samples': 7804800, 'steps': 40649, 'loss/train': 1.5080392360687256}}
+11/07/2021 02:56:21 - INFO - __main__ - Step 40654: {'lr': 0.00042046638217652717, 'samples': 7805568, 'steps': 40653, 'loss/train': 1.3786760568618774}}
+11/07/2021 02:56:24 - INFO - __main__ - Step 40660: {'lr': 0.00042044309020801434, 'samples': 7806720, 'steps': 40659, 'loss/train': 1.272469162940979}}}
+11/07/2021 02:56:24 - INFO - __main__ - Step 40660: {'lr': 0.00042044309020801434, 'samples': 7806720, 'steps': 40659, 'loss/train': 1.272469162940979}}}
+11/07/2021 02:56:28 - INFO - __main__ - Step 40667: {'lr': 0.0004204159127504202, 'samples': 7808064, 'steps': 40666, 'loss/train': 1.802840232849121}}}}
+11/07/2021 02:56:29 - INFO - __main__ - Step 40671: {'lr': 0.0004204003810853045, 'samples': 7808832, 'steps': 40670, 'loss/train': 1.3344838619232178}}}
+11/07/2021 02:56:31 - INFO - __main__ - Step 40675: {'lr': 0.0004203848481917122, 'samples': 7809600, 'steps': 40674, 'loss/train': 1.5235605239868164}}}
+11/07/2021 02:56:34 - INFO - __main__ - Step 40680: {'lr': 0.0004203654303473474, 'samples': 7810560, 'steps': 40679, 'loss/train': 1.413865327835083}}}}
+11/07/2021 02:56:36 - INFO - __main__ - Step 40684: {'lr': 0.00042034989469009245, 'samples': 7811328, 'steps': 40683, 'loss/train': 1.418968915939331}}}
+11/07/2021 02:56:38 - INFO - __main__ - Step 40688: {'lr': 0.00042033435780472494, 'samples': 7812096, 'steps': 40687, 'loss/train': 1.5045456886291504}}
+11/07/2021 02:56:39 - INFO - __main__ - Step 40692: {'lr': 0.000420318819691357, 'samples': 7812864, 'steps': 40691, 'loss/train': 1.6695582866668701}4}}
+11/07/2021 02:56:41 - INFO - __main__ - Step 40696: {'lr': 0.00042030328035010047, 'samples': 7813632, 'steps': 40695, 'loss/train': 1.2691519260406494}}
+11/07/2021 02:56:44 - INFO - __main__ - Step 40701: {'lr': 0.0004202838544469822, 'samples': 7814592, 'steps': 40700, 'loss/train': 1.5229068994522095}}}
+11/07/2021 02:56:46 - INFO - __main__ - Step 40705: {'lr': 0.00042026831234338614, 'samples': 7815360, 'steps': 40704, 'loss/train': 1.6805357933044434}}
+11/07/2021 02:56:46 - INFO - __main__ - Step 40705: {'lr': 0.00042026831234338614, 'samples': 7815360, 'steps': 40704, 'loss/train': 1.6805357933044434}}
+11/07/2021 02:56:49 - INFO - __main__ - Step 40711: {'lr': 0.0004202449968864188, 'samples': 7816512, 'steps': 40710, 'loss/train': 2.121345043182373}4}}
+11/07/2021 02:56:52 - INFO - __main__ - Step 40716: {'lr': 0.0004202255652294114, 'samples': 7817472, 'steps': 40715, 'loss/train': 1.2422605752944946}}}
+11/07/2021 02:56:54 - INFO - __main__ - Step 40720: {'lr': 0.0004202100185231767, 'samples': 7818240, 'steps': 40719, 'loss/train': 1.5049687623977661}}}
+11/07/2021 02:56:54 - INFO - __main__ - Step 40720: {'lr': 0.0004202100185231767, 'samples': 7818240, 'steps': 40719, 'loss/train': 1.5049687623977661}}}
+11/07/2021 02:56:57 - INFO - __main__ - Step 40727: {'lr': 0.00042018280883461415, 'samples': 7819584, 'steps': 40726, 'loss/train': 1.242191195487976}}}
+11/07/2021 02:56:59 - INFO - __main__ - Step 40732: {'lr': 0.0004201633710422962, 'samples': 7820544, 'steps': 40731, 'loss/train': 1.4807544946670532}}}
+11/07/2021 02:57:02 - INFO - __main__ - Step 40737: {'lr': 0.00042014393133315366, 'samples': 7821504, 'steps': 40736, 'loss/train': 1.5821160078048706}}
+11/07/2021 02:57:02 - INFO - __main__ - Step 40737: {'lr': 0.00042014393133315366, 'samples': 7821504, 'steps': 40736, 'loss/train': 1.5821160078048706}}
+11/07/2021 02:57:06 - INFO - __main__ - Step 40745: {'lr': 0.0004201128238120766, 'samples': 7823040, 'steps': 40744, 'loss/train': 1.352439045906067}6}}
+11/07/2021 02:57:08 - INFO - __main__ - Step 40749: {'lr': 0.0004200972682118769, 'samples': 7823808, 'steps': 40748, 'loss/train': 1.8409411907196045}}}
+11/07/2021 02:57:09 - INFO - __main__ - Step 40753: {'lr': 0.000420081711385386, 'samples': 7824576, 'steps': 40752, 'loss/train': 1.7906991243362427}}}}
+11/07/2021 02:57:11 - INFO - __main__ - Step 40757: {'lr': 0.00042006615333271585, 'samples': 7825344, 'steps': 40756, 'loss/train': 1.609025478363037}}}
+11/07/2021 02:57:11 - INFO - __main__ - Step 40757: {'lr': 0.00042006615333271585, 'samples': 7825344, 'steps': 40756, 'loss/train': 1.609025478363037}}}
+11/07/2021 02:57:11 - INFO - __main__ - Step 40757: {'lr': 0.00042006615333271585, 'samples': 7825344, 'steps': 40756, 'loss/train': 1.609025478363037}}}
+11/07/2021 02:57:17 - INFO - __main__ - Step 40769: {'lr': 0.0004200194718187527, 'samples': 7827648, 'steps': 40768, 'loss/train': 1.1773542165756226}}}
+11/07/2021 02:57:19 - INFO - __main__ - Step 40773: {'lr': 0.00042000390886248783, 'samples': 7828416, 'steps': 40772, 'loss/train': 5.857418537139893}}}
+11/07/2021 02:57:21 - INFO - __main__ - Step 40778: {'lr': 0.0004199844534436443, 'samples': 7829376, 'steps': 40777, 'loss/train': 2.341153621673584}}}}
+11/07/2021 02:57:21 - INFO - __main__ - Step 40778: {'lr': 0.0004199844534436443, 'samples': 7829376, 'steps': 40777, 'loss/train': 2.341153621673584}}}}
+11/07/2021 02:57:25 - INFO - __main__ - Step 40786: {'lr': 0.0004199533207907827, 'samples': 7830912, 'steps': 40785, 'loss/train': 1.3264210224151611}}}
+11/07/2021 02:57:25 - INFO - __main__ - Step 40786: {'lr': 0.0004199533207907827, 'samples': 7830912, 'steps': 40785, 'loss/train': 1.3264210224151611}}}
+11/07/2021 02:57:29 - INFO - __main__ - Step 40793: {'lr': 0.000419926075699135, 'samples': 7832256, 'steps': 40792, 'loss/train': 1.2800946235656738}}}}
+11/07/2021 02:57:32 - INFO - __main__ - Step 40799: {'lr': 0.0004199027197773375, 'samples': 7833408, 'steps': 40798, 'loss/train': 2.1304287910461426}}}
+11/07/2021 02:57:32 - INFO - __main__ - Step 40799: {'lr': 0.0004199027197773375, 'samples': 7833408, 'steps': 40798, 'loss/train': 2.1304287910461426}}}
+11/07/2021 02:57:36 - INFO - __main__ - Step 40806: {'lr': 0.0004198754677186565, 'samples': 7834752, 'steps': 40805, 'loss/train': 1.5161305665969849}}}
+11/07/2021 02:57:37 - INFO - __main__ - Step 40810: {'lr': 0.0004198598934297055, 'samples': 7835520, 'steps': 40809, 'loss/train': 1.3566529750823975}}}
+11/07/2021 02:57:37 - INFO - __main__ - Step 40810: {'lr': 0.0004198598934297055, 'samples': 7835520, 'steps': 40809, 'loss/train': 1.3566529750823975}}}
+11/07/2021 02:57:42 - INFO - __main__ - Step 40818: {'lr': 0.00041982874117817593, 'samples': 7837056, 'steps': 40817, 'loss/train': 1.5131193399429321}}
+11/07/2021 02:57:43 - INFO - __main__ - Step 40822: {'lr': 0.000419813163215822, 'samples': 7837824, 'steps': 40821, 'loss/train': 1.3809610605239868}1}}
+11/07/2021 02:57:45 - INFO - __main__ - Step 40826: {'lr': 0.00041979758402922496, 'samples': 7838592, 'steps': 40825, 'loss/train': 1.2652628421783447}}
+11/07/2021 02:57:48 - INFO - __main__ - Step 40831: {'lr': 0.000419778108324558, 'samples': 7839552, 'steps': 40830, 'loss/train': 1.4193148612976074}7}}
+11/07/2021 02:57:48 - INFO - __main__ - Step 40831: {'lr': 0.000419778108324558, 'samples': 7839552, 'steps': 40830, 'loss/train': 1.4193148612976074}7}}
+11/07/2021 02:57:52 - INFO - __main__ - Step 40838: {'lr': 0.0004197508391250988, 'samples': 7840896, 'steps': 40837, 'loss/train': 1.9184430837631226}}}
+11/07/2021 02:57:53 - INFO - __main__ - Step 40842: {'lr': 0.0004197352550426528, 'samples': 7841664, 'steps': 40841, 'loss/train': 1.584807276725769}}}}
+11/07/2021 02:57:55 - INFO - __main__ - Step 40846: {'lr': 0.00041971966973652545, 'samples': 7842432, 'steps': 40845, 'loss/train': 1.2680137157440186}}
+11/07/2021 02:57:58 - INFO - __main__ - Step 40851: {'lr': 0.00041970018638323546, 'samples': 7843392, 'steps': 40850, 'loss/train': 1.5288792848587036}}
+11/07/2021 02:58:00 - INFO - __main__ - Step 40855: {'lr': 0.0004196845983242358, 'samples': 7844160, 'steps': 40854, 'loss/train': 1.6631810665130615}}}
+11/07/2021 02:58:00 - INFO - __main__ - Step 40855: {'lr': 0.0004196845983242358, 'samples': 7844160, 'steps': 40854, 'loss/train': 1.6631810665130615}}}
+11/07/2021 02:58:03 - INFO - __main__ - Step 40862: {'lr': 0.0004196573162774494, 'samples': 7845504, 'steps': 40861, 'loss/train': 0.9696474671363831}}}
+11/07/2021 02:58:06 - INFO - __main__ - Step 40868: {'lr': 0.00041963392868454163, 'samples': 7846656, 'steps': 40867, 'loss/train': 1.4458591938018799}}
+11/07/2021 02:58:08 - INFO - __main__ - Step 40872: {'lr': 0.0004196183354272244, 'samples': 7847424, 'steps': 40871, 'loss/train': 1.2333451509475708}}}
+11/07/2021 02:58:08 - INFO - __main__ - Step 40872: {'lr': 0.0004196183354272244, 'samples': 7847424, 'steps': 40871, 'loss/train': 1.2333451509475708}}}
+11/07/2021 02:58:11 - INFO - __main__ - Step 40879: {'lr': 0.00041959104428453175, 'samples': 7848768, 'steps': 40878, 'loss/train': 1.2749711275100708}}
+11/07/2021 02:58:13 - INFO - __main__ - Step 40883: {'lr': 0.0004195754476646793, 'samples': 7849536, 'steps': 40882, 'loss/train': 1.359736442565918}8}}
+11/07/2021 02:58:16 - INFO - __main__ - Step 40888: {'lr': 0.0004195559501706951, 'samples': 7850496, 'steps': 40887, 'loss/train': 1.023625373840332}8}}
+11/07/2021 02:58:18 - INFO - __main__ - Step 40892: {'lr': 0.00041954035080030985, 'samples': 7851264, 'steps': 40891, 'loss/train': 1.0924385786056519}}
+11/07/2021 02:58:20 - INFO - __main__ - Step 40896: {'lr': 0.00041952475020764834, 'samples': 7852032, 'steps': 40895, 'loss/train': 1.1508278846740723}}
+11/07/2021 02:58:21 - INFO - __main__ - Step 40900: {'lr': 0.0004195091483928231, 'samples': 7852800, 'steps': 40899, 'loss/train': 1.6984916925430298}}}
+11/07/2021 02:58:23 - INFO - __main__ - Step 40904: {'lr': 0.00041949354535594655, 'samples': 7853568, 'steps': 40903, 'loss/train': 1.4739363193511963}}
+11/07/2021 02:58:26 - INFO - __main__ - Step 40909: {'lr': 0.0004194740398415125, 'samples': 7854528, 'steps': 40908, 'loss/train': 1.4221503734588623}}}
+11/07/2021 02:58:26 - INFO - __main__ - Step 40909: {'lr': 0.0004194740398415125, 'samples': 7854528, 'steps': 40908, 'loss/train': 1.4221503734588623}}}
+11/07/2021 02:58:29 - INFO - __main__ - Step 40916: {'lr': 0.0004194467289141339, 'samples': 7855872, 'steps': 40915, 'loss/train': 0.865330696105957}}}}
+11/07/2021 02:58:31 - INFO - __main__ - Step 40920: {'lr': 0.000419431120990177, 'samples': 7856640, 'steps': 40919, 'loss/train': 1.536737084388733}}}}}
+11/07/2021 02:58:34 - INFO - __main__ - Step 40925: {'lr': 0.0004194116093675256, 'samples': 7857600, 'steps': 40924, 'loss/train': 1.5521842241287231}}}
+11/07/2021 02:58:36 - INFO - __main__ - Step 40930: {'lr': 0.00041939209583651774, 'samples': 7858560, 'steps': 40929, 'loss/train': 1.7363842725753784}}
+11/07/2021 02:58:38 - INFO - __main__ - Step 40934: {'lr': 0.0004193764836378425, 'samples': 7859328, 'steps': 40933, 'loss/train': 1.413246989250183}4}}
+11/07/2021 02:58:38 - INFO - __main__ - Step 40934: {'lr': 0.0004193764836378425, 'samples': 7859328, 'steps': 40933, 'loss/train': 1.413246989250183}4}}
+11/07/2021 02:58:41 - INFO - __main__ - Step 40941: {'lr': 0.000419349159351969, 'samples': 7860672, 'steps': 40940, 'loss/train': 1.786657691001892}}4}}
+11/07/2021 02:58:43 - INFO - __main__ - Step 40945: {'lr': 0.00041933354379555376, 'samples': 7861440, 'steps': 40944, 'loss/train': 1.540553331375122}}}
+11/07/2021 02:58:46 - INFO - __main__ - Step 40950: {'lr': 0.00041931402263331856, 'samples': 7862400, 'steps': 40949, 'loss/train': 1.102845549583435}}}
+11/07/2021 02:58:48 - INFO - __main__ - Step 40955: {'lr': 0.00041929449956382625, 'samples': 7863360, 'steps': 40954, 'loss/train': 1.2445733547210693}}
+11/07/2021 02:58:50 - INFO - __main__ - Step 40959: {'lr': 0.00041927887973515493, 'samples': 7864128, 'steps': 40958, 'loss/train': 1.483497977256775}}}
+11/07/2021 02:58:52 - INFO - __main__ - Step 40963: {'lr': 0.00041926325868609247, 'samples': 7864896, 'steps': 40962, 'loss/train': 1.5598963499069214}}
+11/07/2021 02:58:54 - INFO - __main__ - Step 40967: {'lr': 0.0004192476364167514, 'samples': 7865664, 'steps': 40966, 'loss/train': 1.754093885421753}4}}
+11/07/2021 02:58:56 - INFO - __main__ - Step 40971: {'lr': 0.00041923201292724436, 'samples': 7866432, 'steps': 40970, 'loss/train': 1.8128414154052734}}
+11/07/2021 02:58:56 - INFO - __main__ - Step 40971: {'lr': 0.00041923201292724436, 'samples': 7866432, 'steps': 40970, 'loss/train': 1.8128414154052734}}
+11/07/2021 02:59:00 - INFO - __main__ - Step 40979: {'lr': 0.00041920076228818293, 'samples': 7867968, 'steps': 40978, 'loss/train': 1.7132076025009155}}
+11/07/2021 02:59:02 - INFO - __main__ - Step 40983: {'lr': 0.0004191851351388538, 'samples': 7868736, 'steps': 40982, 'loss/train': 1.521274209022522}5}}
+11/07/2021 02:59:04 - INFO - __main__ - Step 40987: {'lr': 0.00041916950676980933, 'samples': 7869504, 'steps': 40986, 'loss/train': 1.4859052896499634}}
+11/07/2021 02:59:06 - INFO - __main__ - Step 40992: {'lr': 0.00041914996959345057, 'samples': 7870464, 'steps': 40991, 'loss/train': 1.3491690158843994}}
+11/07/2021 02:59:06 - INFO - __main__ - Step 40992: {'lr': 0.00041914996959345057, 'samples': 7870464, 'steps': 40991, 'loss/train': 1.3491690158843994}}
+11/07/2021 02:59:06 - INFO - __main__ - Step 40992: {'lr': 0.00041914996959345057, 'samples': 7870464, 'steps': 40991, 'loss/train': 1.3491690158843994}}
+11/07/2021 02:59:11 - INFO - __main__ - Step 41002: {'lr': 0.0004191108895247258, 'samples': 7872384, 'steps': 41001, 'loss/train': 1.3515865802764893}}}
+11/07/2021 02:59:14 - INFO - __main__ - Step 41007: {'lr': 0.0004190913466327999, 'samples': 7873344, 'steps': 41006, 'loss/train': 1.8696014881134033}}}
+11/07/2021 02:59:16 - INFO - __main__ - Step 41012: {'lr': 0.00041907180183612525, 'samples': 7874304, 'steps': 41011, 'loss/train': 1.446285605430603}}}
+11/07/2021 02:59:18 - INFO - __main__ - Step 41016: {'lr': 0.0004190561646275144, 'samples': 7875072, 'steps': 41015, 'loss/train': 1.9799628257751465}}}
+11/07/2021 02:59:18 - INFO - __main__ - Step 41016: {'lr': 0.0004190561646275144, 'samples': 7875072, 'steps': 41015, 'loss/train': 1.9799628257751465}}}
+11/07/2021 02:59:21 - INFO - __main__ - Step 41023: {'lr': 0.00041902879657981036, 'samples': 7876416, 'steps': 41022, 'loss/train': 1.0762028694152832}}
+11/07/2021 02:59:24 - INFO - __main__ - Step 41028: {'lr': 0.00041900924568941925, 'samples': 7877376, 'steps': 41027, 'loss/train': 0.515064537525177}}}
+11/07/2021 02:59:26 - INFO - __main__ - Step 41033: {'lr': 0.0004189896928952041, 'samples': 7878336, 'steps': 41032, 'loss/train': 1.352460265159607}}}}
+11/07/2021 02:59:26 - INFO - __main__ - Step 41033: {'lr': 0.0004189896928952041, 'samples': 7878336, 'steps': 41032, 'loss/train': 1.352460265159607}}}}
+11/07/2021 02:59:29 - INFO - __main__ - Step 41040: {'lr': 0.0004189623157852981, 'samples': 7879680, 'steps': 41039, 'loss/train': 1.8899928331375122}}}
+11/07/2021 02:59:31 - INFO - __main__ - Step 41044: {'lr': 0.000418946670047556, 'samples': 7880448, 'steps': 41043, 'loss/train': 1.392247200012207}2}}}
+11/07/2021 02:59:34 - INFO - __main__ - Step 41049: {'lr': 0.00041892711116258454, 'samples': 7881408, 'steps': 41048, 'loss/train': 1.2349627017974854}}
+11/07/2021 02:59:34 - INFO - __main__ - Step 41049: {'lr': 0.00041892711116258454, 'samples': 7881408, 'steps': 41048, 'loss/train': 1.2349627017974854}}
+11/07/2021 02:59:37 - INFO - __main__ - Step 41056: {'lr': 0.00041889972552680387, 'samples': 7882752, 'steps': 41055, 'loss/train': 1.6331814527511597}}
+11/07/2021 02:59:39 - INFO - __main__ - Step 41060: {'lr': 0.0004188840749177538, 'samples': 7883520, 'steps': 41059, 'loss/train': 1.6948528289794922}}}
+11/07/2021 02:59:42 - INFO - __main__ - Step 41065: {'lr': 0.00041886450994428197, 'samples': 7884480, 'steps': 41064, 'loss/train': 1.3526166677474976}}
+11/07/2021 02:59:44 - INFO - __main__ - Step 41070: {'lr': 0.0004188449430686166, 'samples': 7885440, 'steps': 41069, 'loss/train': 1.4126471281051636}}}
+11/07/2021 02:59:46 - INFO - __main__ - Step 41074: {'lr': 0.000418829288198653, 'samples': 7886208, 'steps': 41073, 'loss/train': 1.5374236106872559}}}}
+11/07/2021 02:59:46 - INFO - __main__ - Step 41074: {'lr': 0.000418829288198653, 'samples': 7886208, 'steps': 41073, 'loss/train': 1.5374236106872559}}}}
+11/07/2021 02:59:49 - INFO - __main__ - Step 41081: {'lr': 0.0004188018892475176, 'samples': 7887552, 'steps': 41080, 'loss/train': 1.715844988822937}}}}
+11/07/2021 02:59:51 - INFO - __main__ - Step 41085: {'lr': 0.0004187862310306633, 'samples': 7888320, 'steps': 41084, 'loss/train': 1.9033116102218628}}}
+11/07/2021 02:59:54 - INFO - __main__ - Step 41090: {'lr': 0.0004187666565484279, 'samples': 7889280, 'steps': 41089, 'loss/train': 1.3745850324630737}}}
+11/07/2021 02:59:54 - INFO - __main__ - Step 41090: {'lr': 0.0004187666565484279, 'samples': 7889280, 'steps': 41089, 'loss/train': 1.3745850324630737}}}
+11/07/2021 02:59:58 - INFO - __main__ - Step 41098: {'lr': 0.00041873533342267336, 'samples': 7890816, 'steps': 41097, 'loss/train': 1.4721550941467285}}
+11/07/2021 02:59:59 - INFO - __main__ - Step 41102: {'lr': 0.00041871967003503073, 'samples': 7891584, 'steps': 41101, 'loss/train': 1.177298903465271}}}
+11/07/2021 03:00:02 - INFO - __main__ - Step 41106: {'lr': 0.0004187040054310284, 'samples': 7892352, 'steps': 41105, 'loss/train': 1.490696907043457}}}}
+11/07/2021 03:00:04 - INFO - __main__ - Step 41111: {'lr': 0.0004186844229656917, 'samples': 7893312, 'steps': 41110, 'loss/train': 1.5238968133926392}}}
+11/07/2021 03:00:06 - INFO - __main__ - Step 41115: {'lr': 0.00041866875562529305, 'samples': 7894080, 'steps': 41114, 'loss/train': 1.6523754596710205}}
+11/07/2021 03:00:06 - INFO - __main__ - Step 41115: {'lr': 0.00041866875562529305, 'samples': 7894080, 'steps': 41114, 'loss/train': 1.6523754596710205}}
+11/07/2021 03:00:09 - INFO - __main__ - Step 41122: {'lr': 0.00041864133485368106, 'samples': 7895424, 'steps': 41121, 'loss/train': 1.0865099430084229}}
+11/07/2021 03:00:12 - INFO - __main__ - Step 41127: {'lr': 0.00041862174630859315, 'samples': 7896384, 'steps': 41126, 'loss/train': 1.4096827507019043}}
+11/07/2021 03:00:12 - INFO - __main__ - Step 41127: {'lr': 0.00041862174630859315, 'samples': 7896384, 'steps': 41126, 'loss/train': 1.4096827507019043}}
+11/07/2021 03:00:16 - INFO - __main__ - Step 41135: {'lr': 0.0004185904006856697, 'samples': 7897920, 'steps': 41134, 'loss/train': 1.6345583200454712}}}
+11/07/2021 03:00:18 - INFO - __main__ - Step 41139: {'lr': 0.0004185747260510099, 'samples': 7898688, 'steps': 41138, 'loss/train': 1.5812559127807617}}}
+11/07/2021 03:00:20 - INFO - __main__ - Step 41143: {'lr': 0.00041855905020103543, 'samples': 7899456, 'steps': 41142, 'loss/train': 1.4493659734725952}}
+11/07/2021 03:00:22 - INFO - __main__ - Step 41147: {'lr': 0.00041854337313585913, 'samples': 7900224, 'steps': 41146, 'loss/train': 1.5544965267181396}}
+11/07/2021 03:00:24 - INFO - __main__ - Step 41152: {'lr': 0.0004185237750956836, 'samples': 7901184, 'steps': 41151, 'loss/train': 1.4736276865005493}}}
+11/07/2021 03:00:24 - INFO - __main__ - Step 41152: {'lr': 0.0004185237750956836, 'samples': 7901184, 'steps': 41151, 'loss/train': 1.4736276865005493}}}
+11/07/2021 03:00:28 - INFO - __main__ - Step 41159: {'lr': 0.0004184963346502504, 'samples': 7902528, 'steps': 41158, 'loss/train': 1.931903600692749}}}}
+11/07/2021 03:00:30 - INFO - __main__ - Step 41163: {'lr': 0.00041848065272539765, 'samples': 7903296, 'steps': 41162, 'loss/train': 1.4716529846191406}}
+11/07/2021 03:00:32 - INFO - __main__ - Step 41167: {'lr': 0.0004184649695859083, 'samples': 7904064, 'steps': 41166, 'loss/train': 1.6647261381149292}}}
+11/07/2021 03:00:34 - INFO - __main__ - Step 41172: {'lr': 0.00041844536395363636, 'samples': 7905024, 'steps': 41171, 'loss/train': 1.4426734447479248}}
+11/07/2021 03:00:36 - INFO - __main__ - Step 41176: {'lr': 0.00041842967808162834, 'samples': 7905792, 'steps': 41175, 'loss/train': 1.224771499633789}}}
+11/07/2021 03:00:39 - INFO - __main__ - Step 41180: {'lr': 0.0004184139909953513, 'samples': 7906560, 'steps': 41179, 'loss/train': 1.5802867412567139}}}
+11/07/2021 03:00:40 - INFO - __main__ - Step 41184: {'lr': 0.00041839830269491823, 'samples': 7907328, 'steps': 41183, 'loss/train': 1.391185998916626}}}
+11/07/2021 03:00:42 - INFO - __main__ - Step 41188: {'lr': 0.0004183826131804424, 'samples': 7908096, 'steps': 41187, 'loss/train': 1.4859697818756104}}}
+11/07/2021 03:00:44 - INFO - __main__ - Step 41193: {'lr': 0.00041836299958027226, 'samples': 7909056, 'steps': 41192, 'loss/train': 1.2868040800094604}}
+11/07/2021 03:00:44 - INFO - __main__ - Step 41193: {'lr': 0.00041836299958027226, 'samples': 7909056, 'steps': 41192, 'loss/train': 1.2868040800094604}}
+11/07/2021 03:00:48 - INFO - __main__ - Step 41200: {'lr': 0.0004183355373538892, 'samples': 7910400, 'steps': 41199, 'loss/train': 0.5584649443626404}}}
+11/07/2021 03:00:50 - INFO - __main__ - Step 41204: {'lr': 0.0004183198429843732, 'samples': 7911168, 'steps': 41203, 'loss/train': 1.5909727811813354}}}
+11/07/2021 03:00:52 - INFO - __main__ - Step 41209: {'lr': 0.00041830022331603925, 'samples': 7912128, 'steps': 41208, 'loss/train': 1.482258915901184}}}
+11/07/2021 03:00:52 - INFO - __main__ - Step 41209: {'lr': 0.00041830022331603925, 'samples': 7912128, 'steps': 41208, 'loss/train': 1.482258915901184}}}
+11/07/2021 03:00:52 - INFO - __main__ - Step 41209: {'lr': 0.00041830022331603925, 'samples': 7912128, 'steps': 41208, 'loss/train': 1.482258915901184}}}
+11/07/2021 03:00:58 - INFO - __main__ - Step 41219: {'lr': 0.0004182609782920812, 'samples': 7914048, 'steps': 41218, 'loss/train': 1.9552432298660278}}}
+11/07/2021 03:01:01 - INFO - __main__ - Step 41225: {'lr': 0.0004182374276384347, 'samples': 7915200, 'steps': 41224, 'loss/train': 1.4558976888656616}}}
+11/07/2021 03:01:01 - INFO - __main__ - Step 41225: {'lr': 0.0004182374276384347, 'samples': 7915200, 'steps': 41224, 'loss/train': 1.4558976888656616}}}
+11/07/2021 03:01:04 - INFO - __main__ - Step 41232: {'lr': 0.00041820994842673787, 'samples': 7916544, 'steps': 41231, 'loss/train': 1.6607749462127686}}
+11/07/2021 03:01:06 - INFO - __main__ - Step 41236: {'lr': 0.0004181942443525734, 'samples': 7917312, 'steps': 41235, 'loss/train': 1.290693759918213}6}}
+11/07/2021 03:01:06 - INFO - __main__ - Step 41236: {'lr': 0.0004181942443525734, 'samples': 7917312, 'steps': 41235, 'loss/train': 1.290693759918213}6}}
+11/07/2021 03:01:10 - INFO - __main__ - Step 41244: {'lr': 0.0004181628325666424, 'samples': 7918848, 'steps': 41243, 'loss/train': 1.7734460830688477}}}
+11/07/2021 03:01:12 - INFO - __main__ - Step 41248: {'lr': 0.00041814712485510245, 'samples': 7919616, 'steps': 41247, 'loss/train': 0.9829598665237427}}
+11/07/2021 03:01:15 - INFO - __main__ - Step 41253: {'lr': 0.0004181274885109895, 'samples': 7920576, 'steps': 41252, 'loss/train': 0.991035521030426}7}}
+11/07/2021 03:01:17 - INFO - __main__ - Step 41257: {'lr': 0.0004181117780720868, 'samples': 7921344, 'steps': 41256, 'loss/train': 1.1258245706558228}}}
+11/07/2021 03:01:19 - INFO - __main__ - Step 41261: {'lr': 0.0004180960664212069, 'samples': 7922112, 'steps': 41260, 'loss/train': 1.564186453819275}}}}
+11/07/2021 03:01:20 - INFO - __main__ - Step 41265: {'lr': 0.0004180803535584632, 'samples': 7922880, 'steps': 41264, 'loss/train': 1.7812724113464355}}}
+11/07/2021 03:01:22 - INFO - __main__ - Step 41269: {'lr': 0.00041806463948396876, 'samples': 7923648, 'steps': 41268, 'loss/train': 1.508406639099121}}}
+11/07/2021 03:01:22 - INFO - __main__ - Step 41269: {'lr': 0.00041806463948396876, 'samples': 7923648, 'steps': 41268, 'loss/train': 1.508406639099121}}}
+11/07/2021 03:01:26 - INFO - __main__ - Step 41277: {'lr': 0.0004180332077001814, 'samples': 7925184, 'steps': 41276, 'loss/train': 1.587908148765564}}}}
+11/07/2021 03:01:28 - INFO - __main__ - Step 41281: {'lr': 0.00041801748999111487, 'samples': 7925952, 'steps': 41280, 'loss/train': 2.370021343231201}}}
+11/07/2021 03:01:30 - INFO - __main__ - Step 41285: {'lr': 0.000418001771070751, 'samples': 7926720, 'steps': 41284, 'loss/train': 1.1700141429901123}}}}
+11/07/2021 03:01:32 - INFO - __main__ - Step 41289: {'lr': 0.00041798605093920307, 'samples': 7927488, 'steps': 41288, 'loss/train': 1.71012544631958}}}}
+11/07/2021 03:01:32 - INFO - __main__ - Step 41289: {'lr': 0.00041798605093920307, 'samples': 7927488, 'steps': 41288, 'loss/train': 1.71012544631958}}}}
+11/07/2021 03:01:37 - INFO - __main__ - Step 41298: {'lr': 0.0004179506762154153, 'samples': 7929216, 'steps': 41297, 'loss/train': 1.2087020874023438}}}
+11/07/2021 03:01:39 - INFO - __main__ - Step 41302: {'lr': 0.0004179349521483018, 'samples': 7929984, 'steps': 41301, 'loss/train': 1.1674959659576416}}}
+11/07/2021 03:01:40 - INFO - __main__ - Step 41306: {'lr': 0.0004179192268704859, 'samples': 7930752, 'steps': 41305, 'loss/train': 1.4723738431930542}}}
+11/07/2021 03:01:42 - INFO - __main__ - Step 41310: {'lr': 0.000417903500382081, 'samples': 7931520, 'steps': 41309, 'loss/train': 1.3963290452957153}}}}
+11/07/2021 03:01:45 - INFO - __main__ - Step 41315: {'lr': 0.00041788384056935693, 'samples': 7932480, 'steps': 41314, 'loss/train': 1.4484103918075562}}
+11/07/2021 03:01:45 - INFO - __main__ - Step 41315: {'lr': 0.00041788384056935693, 'samples': 7932480, 'steps': 41314, 'loss/train': 1.4484103918075562}}
+11/07/2021 03:01:48 - INFO - __main__ - Step 41322: {'lr': 0.0004178563136544662, 'samples': 7933824, 'steps': 41321, 'loss/train': 1.5325267314910889}}}
+11/07/2021 03:01:50 - INFO - __main__ - Step 41326: {'lr': 0.0004178405823248392, 'samples': 7934592, 'steps': 41325, 'loss/train': 1.7020225524902344}}}
+11/07/2021 03:01:53 - INFO - __main__ - Step 41331: {'lr': 0.00041782091646122533, 'samples': 7935552, 'steps': 41330, 'loss/train': 1.3062204122543335}}
+11/07/2021 03:01:53 - INFO - __main__ - Step 41331: {'lr': 0.00041782091646122533, 'samples': 7935552, 'steps': 41330, 'loss/train': 1.3062204122543335}}
+11/07/2021 03:01:56 - INFO - __main__ - Step 41338: {'lr': 0.0004177933810762797, 'samples': 7936896, 'steps': 41337, 'loss/train': 1.3531194925308228}}}
+11/07/2021 03:01:56 - INFO - __main__ - Step 41338: {'lr': 0.0004177933810762797, 'samples': 7936896, 'steps': 41337, 'loss/train': 1.3531194925308228}}}
+11/07/2021 03:02:00 - INFO - __main__ - Step 41344: {'lr': 0.00041776977636913274, 'samples': 7938048, 'steps': 41343, 'loss/train': 1.6654342412948608}}
+11/07/2021 03:02:00 - INFO - __main__ - Step 41344: {'lr': 0.00041776977636913274, 'samples': 7938048, 'steps': 41343, 'loss/train': 1.6654342412948608}}
+11/07/2021 03:02:05 - INFO - __main__ - Step 41353: {'lr': 0.000417734364205905, 'samples': 7939776, 'steps': 41352, 'loss/train': 1.5426164865493774}8}}
+11/07/2021 03:02:06 - INFO - __main__ - Step 41357: {'lr': 0.0004177186235015744, 'samples': 7940544, 'steps': 41356, 'loss/train': 1.4589163064956665}}}
+11/07/2021 03:02:08 - INFO - __main__ - Step 41361: {'lr': 0.0004177028815881011, 'samples': 7941312, 'steps': 41360, 'loss/train': 1.4144057035446167}}}
+11/07/2021 03:02:11 - INFO - __main__ - Step 41366: {'lr': 0.00041768320249607527, 'samples': 7942272, 'steps': 41365, 'loss/train': 0.5804887413978577}}
+11/07/2021 03:02:13 - INFO - __main__ - Step 41370: {'lr': 0.00041766745786244564, 'samples': 7943040, 'steps': 41369, 'loss/train': 1.856892704963684}}}
+11/07/2021 03:02:13 - INFO - __main__ - Step 41370: {'lr': 0.00041766745786244564, 'samples': 7943040, 'steps': 41369, 'loss/train': 1.856892704963684}}}
+11/07/2021 03:02:16 - INFO - __main__ - Step 41378: {'lr': 0.00041763596496897817, 'samples': 7944576, 'steps': 41377, 'loss/train': 1.489722728729248}}}
+11/07/2021 03:02:18 - INFO - __main__ - Step 41382: {'lr': 0.00041762021670936736, 'samples': 7945344, 'steps': 41381, 'loss/train': 1.8188769817352295}}
+11/07/2021 03:02:21 - INFO - __main__ - Step 41387: {'lr': 0.00041760052968550776, 'samples': 7946304, 'steps': 41386, 'loss/train': 1.1613948345184326}}
+11/07/2021 03:02:23 - INFO - __main__ - Step 41392: {'lr': 0.0004175808407736929, 'samples': 7947264, 'steps': 41391, 'loss/train': 0.9999271035194397}}}
+11/07/2021 03:02:23 - INFO - __main__ - Step 41392: {'lr': 0.0004175808407736929, 'samples': 7947264, 'steps': 41391, 'loss/train': 0.9999271035194397}}}
+11/07/2021 03:02:27 - INFO - __main__ - Step 41399: {'lr': 0.00041755327312580944, 'samples': 7948608, 'steps': 41398, 'loss/train': 1.602047324180603}}}
+11/07/2021 03:02:28 - INFO - __main__ - Step 41403: {'lr': 0.0004175375185231904, 'samples': 7949376, 'steps': 41402, 'loss/train': 1.2870851755142212}}}
+11/07/2021 03:02:30 - INFO - __main__ - Step 41407: {'lr': 0.0004175217627127344, 'samples': 7950144, 'steps': 41406, 'loss/train': 1.4150969982147217}}}
+11/07/2021 03:02:32 - INFO - __main__ - Step 41411: {'lr': 0.00041750600569455474, 'samples': 7950912, 'steps': 41410, 'loss/train': 1.4357165098190308}}
+11/07/2021 03:02:35 - INFO - __main__ - Step 41415: {'lr': 0.00041749024746876517, 'samples': 7951680, 'steps': 41414, 'loss/train': 1.9053404331207275}}
+11/07/2021 03:02:36 - INFO - __main__ - Step 41419: {'lr': 0.00041747448803547925, 'samples': 7952448, 'steps': 41418, 'loss/train': 1.7027661800384521}}
+11/07/2021 03:02:38 - INFO - __main__ - Step 41423: {'lr': 0.0004174587273948106, 'samples': 7953216, 'steps': 41422, 'loss/train': 1.418365716934204}1}}
+11/07/2021 03:02:41 - INFO - __main__ - Step 41428: {'lr': 0.00041743902489626606, 'samples': 7954176, 'steps': 41427, 'loss/train': 1.5032762289047241}}
+11/07/2021 03:02:43 - INFO - __main__ - Step 41432: {'lr': 0.0004174232615394018, 'samples': 7954944, 'steps': 41431, 'loss/train': 1.4779268503189087}}}
+11/07/2021 03:02:45 - INFO - __main__ - Step 41436: {'lr': 0.00041740749697552406, 'samples': 7955712, 'steps': 41435, 'loss/train': 1.1720250844955444}}
+11/07/2021 03:02:46 - INFO - __main__ - Step 41440: {'lr': 0.00041739173120474663, 'samples': 7956480, 'steps': 41439, 'loss/train': 1.266028642654419}}}
+11/07/2021 03:02:48 - INFO - __main__ - Step 41444: {'lr': 0.00041737596422718306, 'samples': 7957248, 'steps': 41443, 'loss/train': 1.0524725914001465}}
+11/07/2021 03:02:51 - INFO - __main__ - Step 41449: {'lr': 0.00041735625380835884, 'samples': 7958208, 'steps': 41448, 'loss/train': 1.2277780771255493}}
+11/07/2021 03:02:53 - INFO - __main__ - Step 41453: {'lr': 0.00041734048411594214, 'samples': 7958976, 'steps': 41452, 'loss/train': 1.5704346895217896}}
+11/07/2021 03:02:55 - INFO - __main__ - Step 41457: {'lr': 0.00041732471321710886, 'samples': 7959744, 'steps': 41456, 'loss/train': 1.1334835290908813}}
+11/07/2021 03:02:56 - INFO - __main__ - Step 41461: {'lr': 0.00041730894111197266, 'samples': 7960512, 'steps': 41460, 'loss/train': 1.2933282852172852}}
+11/07/2021 03:02:58 - INFO - __main__ - Step 41465: {'lr': 0.0004172931678006472, 'samples': 7961280, 'steps': 41464, 'loss/train': 1.5170831680297852}}}
+11/07/2021 03:02:58 - INFO - __main__ - Step 41465: {'lr': 0.0004172931678006472, 'samples': 7961280, 'steps': 41464, 'loss/train': 1.5170831680297852}}}
+11/07/2021 03:03:02 - INFO - __main__ - Step 41473: {'lr': 0.0004172616175598835, 'samples': 7962816, 'steps': 41472, 'loss/train': 1.6682500839233398}}}
+11/07/2021 03:03:04 - INFO - __main__ - Step 41477: {'lr': 0.0004172458406306726, 'samples': 7963584, 'steps': 41476, 'loss/train': 1.0533301830291748}}}
+11/07/2021 03:03:04 - INFO - __main__ - Step 41477: {'lr': 0.0004172458406306726, 'samples': 7963584, 'steps': 41476, 'loss/train': 1.0533301830291748}}}
+11/07/2021 03:03:09 - INFO - __main__ - Step 41485: {'lr': 0.00041721428315516176, 'samples': 7965120, 'steps': 41484, 'loss/train': 1.4794907569885254}}
+11/07/2021 03:03:09 - INFO - __main__ - Step 41485: {'lr': 0.00041721428315516176, 'samples': 7965120, 'steps': 41484, 'loss/train': 1.4794907569885254}}
+11/07/2021 03:03:13 - INFO - __main__ - Step 41492: {'lr': 0.00041718666640848937, 'samples': 7966464, 'steps': 41491, 'loss/train': 1.8231583833694458}}
+11/07/2021 03:03:15 - INFO - __main__ - Step 41496: {'lr': 0.00041717088375305367, 'samples': 7967232, 'steps': 41495, 'loss/train': 0.9370419979095459}}
+11/07/2021 03:03:16 - INFO - __main__ - Step 41500: {'lr': 0.0004171550998924241, 'samples': 7968000, 'steps': 41499, 'loss/train': 1.9808309078216553}}}
+11/07/2021 03:03:18 - INFO - __main__ - Step 41504: {'lr': 0.00041713931482671425, 'samples': 7968768, 'steps': 41503, 'loss/train': 1.7438743114471436}}
+11/07/2021 03:03:21 - INFO - __main__ - Step 41509: {'lr': 0.00041711958180010644, 'samples': 7969728, 'steps': 41508, 'loss/train': 1.4612095355987549}}
+11/07/2021 03:03:21 - INFO - __main__ - Step 41509: {'lr': 0.00041711958180010644, 'samples': 7969728, 'steps': 41508, 'loss/train': 1.4612095355987549}}
+11/07/2021 03:03:21 - INFO - __main__ - Step 41509: {'lr': 0.00041711958180010644, 'samples': 7969728, 'steps': 41508, 'loss/train': 1.4612095355987549}}
+11/07/2021 03:03:26 - INFO - __main__ - Step 41520: {'lr': 0.00041707616251535, 'samples': 7971840, 'steps': 41519, 'loss/train': 1.5904089212417603}49}}
+11/07/2021 03:03:29 - INFO - __main__ - Step 41525: {'lr': 0.00041705642346540436, 'samples': 7972800, 'steps': 41524, 'loss/train': 1.8854976892471313}}
+11/07/2021 03:03:31 - INFO - __main__ - Step 41530: {'lr': 0.0004170366825336326, 'samples': 7973760, 'steps': 41529, 'loss/train': 1.6385127305984497}}}
+11/07/2021 03:03:31 - INFO - __main__ - Step 41530: {'lr': 0.0004170366825336326, 'samples': 7973760, 'steps': 41529, 'loss/train': 1.6385127305984497}}}
+11/07/2021 03:03:35 - INFO - __main__ - Step 41537: {'lr': 0.00041700904206810755, 'samples': 7975104, 'steps': 41536, 'loss/train': 1.848340392112732}}}
+11/07/2021 03:03:37 - INFO - __main__ - Step 41541: {'lr': 0.0004169932458608025, 'samples': 7975872, 'steps': 41540, 'loss/train': 1.6828755140304565}}}
+11/07/2021 03:03:37 - INFO - __main__ - Step 41541: {'lr': 0.0004169932458608025, 'samples': 7975872, 'steps': 41540, 'loss/train': 1.6828755140304565}}}
+11/07/2021 03:03:37 - INFO - __main__ - Step 41541: {'lr': 0.0004169932458608025, 'samples': 7975872, 'steps': 41540, 'loss/train': 1.6828755140304565}}}
+11/07/2021 03:03:42 - INFO - __main__ - Step 41552: {'lr': 0.00041694980008337825, 'samples': 7977984, 'steps': 41551, 'loss/train': 1.5691694021224976}}
+11/07/2021 03:03:45 - INFO - __main__ - Step 41557: {'lr': 0.0004169300489935884, 'samples': 7978944, 'steps': 41556, 'loss/train': 1.5837068557739258}}}
+11/07/2021 03:03:47 - INFO - __main__ - Step 41561: {'lr': 0.00041691424676785593, 'samples': 7979712, 'steps': 41560, 'loss/train': 1.891399621963501}}}
+11/07/2021 03:03:47 - INFO - __main__ - Step 41561: {'lr': 0.00041691424676785593, 'samples': 7979712, 'steps': 41560, 'loss/train': 1.891399621963501}}}
+11/07/2021 03:03:50 - INFO - __main__ - Step 41568: {'lr': 0.00041688658997734675, 'samples': 7981056, 'steps': 41567, 'loss/train': 1.6336743831634521}}
+11/07/2021 03:03:52 - INFO - __main__ - Step 41572: {'lr': 0.00041687078444269316, 'samples': 7981824, 'steps': 41571, 'loss/train': 1.8877520561218262}}
+11/07/2021 03:03:55 - INFO - __main__ - Step 41577: {'lr': 0.000416851025832628, 'samples': 7982784, 'steps': 41576, 'loss/train': 0.6884801387786865}2}}
+11/07/2021 03:03:55 - INFO - __main__ - Step 41577: {'lr': 0.000416851025832628, 'samples': 7982784, 'steps': 41576, 'loss/train': 0.6884801387786865}2}}
+11/07/2021 03:03:59 - INFO - __main__ - Step 41585: {'lr': 0.0004168194081472305, 'samples': 7984320, 'steps': 41584, 'loss/train': 1.1452103853225708}}}
+11/07/2021 03:04:00 - INFO - __main__ - Step 41589: {'lr': 0.0004168035975004847, 'samples': 7985088, 'steps': 41588, 'loss/train': 0.9681318402290344}}}
+11/07/2021 03:04:02 - INFO - __main__ - Step 41593: {'lr': 0.0004167877856511929, 'samples': 7985856, 'steps': 41592, 'loss/train': 1.6857103109359741}}}
+11/07/2021 03:04:05 - INFO - __main__ - Step 41598: {'lr': 0.00041676801914867145, 'samples': 7986816, 'steps': 41597, 'loss/train': 1.030824065208435}}}
+11/07/2021 03:04:07 - INFO - __main__ - Step 41603: {'lr': 0.0004167482507675726, 'samples': 7987776, 'steps': 41602, 'loss/train': 1.5415982007980347}}}
+11/07/2021 03:04:07 - INFO - __main__ - Step 41603: {'lr': 0.0004167482507675726, 'samples': 7987776, 'steps': 41602, 'loss/train': 1.5415982007980347}}}
+11/07/2021 03:04:10 - INFO - __main__ - Step 41610: {'lr': 0.0004167205718784481, 'samples': 7989120, 'steps': 41609, 'loss/train': 1.6693180799484253}}}
+11/07/2021 03:04:12 - INFO - __main__ - Step 41614: {'lr': 0.00041670475371766, 'samples': 7989888, 'steps': 41613, 'loss/train': 1.4963102340698242}3}}}
+11/07/2021 03:04:15 - INFO - __main__ - Step 41619: {'lr': 0.00041668497932661005, 'samples': 7990848, 'steps': 41618, 'loss/train': 1.4335687160491943}}
+11/07/2021 03:04:17 - INFO - __main__ - Step 41623: {'lr': 0.0004166691584618572, 'samples': 7991616, 'steps': 41622, 'loss/train': 1.4614523649215698}}}
+11/07/2021 03:04:17 - INFO - __main__ - Step 41623: {'lr': 0.0004166691584618572, 'samples': 7991616, 'steps': 41622, 'loss/train': 1.4614523649215698}}}
+11/07/2021 03:04:20 - INFO - __main__ - Step 41631: {'lr': 0.0004166375131277349, 'samples': 7993152, 'steps': 41630, 'loss/train': 1.4986904859542847}}}
+11/07/2021 03:04:22 - INFO - __main__ - Step 41635: {'lr': 0.00041662168865859374, 'samples': 7993920, 'steps': 41634, 'loss/train': 1.5390034914016724}}
+11/07/2021 03:04:25 - INFO - __main__ - Step 41640: {'lr': 0.00041660190638294456, 'samples': 7994880, 'steps': 41639, 'loss/train': 1.7146142721176147}}
+11/07/2021 03:04:25 - INFO - __main__ - Step 41640: {'lr': 0.00041660190638294456, 'samples': 7994880, 'steps': 41639, 'loss/train': 1.7146142721176147}}
+11/07/2021 03:04:29 - INFO - __main__ - Step 41648: {'lr': 0.00041657025083844957, 'samples': 7996416, 'steps': 41647, 'loss/train': 1.5819388628005981}}
+11/07/2021 03:04:31 - INFO - __main__ - Step 41652: {'lr': 0.0004165544212648494, 'samples': 7997184, 'steps': 41651, 'loss/train': 1.6275389194488525}}}
+11/07/2021 03:04:33 - INFO - __main__ - Step 41656: {'lr': 0.00041653859049049964, 'samples': 7997952, 'steps': 41655, 'loss/train': 1.5604771375656128}}
+11/07/2021 03:04:35 - INFO - __main__ - Step 41660: {'lr': 0.00041652275851551435, 'samples': 7998720, 'steps': 41659, 'loss/train': 1.145478367805481}}}
+11/07/2021 03:04:37 - INFO - __main__ - Step 41665: {'lr': 0.0004165029668585629, 'samples': 7999680, 'steps': 41664, 'loss/train': 1.5130399465560913}}}
+11/07/2021 03:04:39 - INFO - __main__ - Step 41670: {'lr': 0.0004164831733260198, 'samples': 8000640, 'steps': 41669, 'loss/train': 1.4005441665649414}}}
+11/07/2021 03:04:39 - INFO - __main__ - Step 41670: {'lr': 0.0004164831733260198, 'samples': 8000640, 'steps': 41669, 'loss/train': 1.4005441665649414}}}
+11/07/2021 03:04:43 - INFO - __main__ - Step 41677: {'lr': 0.00041645545922989, 'samples': 8001984, 'steps': 41676, 'loss/train': 1.1119292974472046}4}}}
+11/07/2021 03:04:45 - INFO - __main__ - Step 41681: {'lr': 0.00041643962095344107, 'samples': 8002752, 'steps': 41680, 'loss/train': 1.4981598854064941}}
+11/07/2021 03:04:47 - INFO - __main__ - Step 41686: {'lr': 0.00041641982142050297, 'samples': 8003712, 'steps': 41685, 'loss/train': 1.5093369483947754}}
+11/07/2021 03:04:49 - INFO - __main__ - Step 41690: {'lr': 0.0004164039804443902, 'samples': 8004480, 'steps': 41689, 'loss/train': 1.4913170337677002}}}
+11/07/2021 03:04:49 - INFO - __main__ - Step 41690: {'lr': 0.0004164039804443902, 'samples': 8004480, 'steps': 41689, 'loss/train': 1.4913170337677002}}}
+11/07/2021 03:04:53 - INFO - __main__ - Step 41697: {'lr': 0.0004163762558495674, 'samples': 8005824, 'steps': 41696, 'loss/train': 1.8762617111206055}}}
+11/07/2021 03:04:53 - INFO - __main__ - Step 41697: {'lr': 0.0004163762558495674, 'samples': 8005824, 'steps': 41696, 'loss/train': 1.8762617111206055}}}
+11/07/2021 03:04:57 - INFO - __main__ - Step 41705: {'lr': 0.0004163445661003827, 'samples': 8007360, 'steps': 41704, 'loss/train': 2.0427615642547607}}}
+11/07/2021 03:04:59 - INFO - __main__ - Step 41709: {'lr': 0.00041632871942687814, 'samples': 8008128, 'steps': 41708, 'loss/train': 1.4548799991607666}}
+11/07/2021 03:05:01 - INFO - __main__ - Step 41714: {'lr': 0.0004163089093987449, 'samples': 8009088, 'steps': 41713, 'loss/train': 1.3990758657455444}}}
+11/07/2021 03:05:03 - INFO - __main__ - Step 41718: {'lr': 0.0004162930600273754, 'samples': 8009856, 'steps': 41717, 'loss/train': 1.3864885568618774}}}
+11/07/2021 03:05:05 - INFO - __main__ - Step 41722: {'lr': 0.00041627720945714065, 'samples': 8010624, 'steps': 41721, 'loss/train': 1.3326258659362793}}
+11/07/2021 03:05:07 - INFO - __main__ - Step 41726: {'lr': 0.00041626135768815467, 'samples': 8011392, 'steps': 41725, 'loss/train': 1.537654161453247}}}
+11/07/2021 03:05:09 - INFO - __main__ - Step 41730: {'lr': 0.0004162455047205319, 'samples': 8012160, 'steps': 41729, 'loss/train': 0.8903040885925293}}}
+11/07/2021 03:05:11 - INFO - __main__ - Step 41734: {'lr': 0.0004162296505543867, 'samples': 8012928, 'steps': 41733, 'loss/train': 1.5739892721176147}}}
+11/07/2021 03:05:11 - INFO - __main__ - Step 41734: {'lr': 0.0004162296505543867, 'samples': 8012928, 'steps': 41733, 'loss/train': 1.5739892721176147}}}
+11/07/2021 03:05:15 - INFO - __main__ - Step 41742: {'lr': 0.00041619793862698553, 'samples': 8014464, 'steps': 41741, 'loss/train': 1.555660367012024}}}
+11/07/2021 03:05:17 - INFO - __main__ - Step 41746: {'lr': 0.00041618208086595843, 'samples': 8015232, 'steps': 41745, 'loss/train': 1.339052677154541}}}
+11/07/2021 03:05:20 - INFO - __main__ - Step 41751: {'lr': 0.0004161622569799086, 'samples': 8016192, 'steps': 41750, 'loss/train': 1.49894118309021}1}}}
+11/07/2021 03:05:22 - INFO - __main__ - Step 41755: {'lr': 0.00041614639652339533, 'samples': 8016960, 'steps': 41754, 'loss/train': 0.987359344959259}}}
+11/07/2021 03:05:24 - INFO - __main__ - Step 41759: {'lr': 0.00041613053486907396, 'samples': 8017728, 'steps': 41758, 'loss/train': 1.616061806678772}}}
+11/07/2021 03:05:25 - INFO - __main__ - Step 41763: {'lr': 0.000416114672017059, 'samples': 8018496, 'steps': 41762, 'loss/train': 1.7405064105987549}}}}
+11/07/2021 03:05:27 - INFO - __main__ - Step 41767: {'lr': 0.00041609880796746463, 'samples': 8019264, 'steps': 41766, 'loss/train': 1.4200246334075928}}
+11/07/2021 03:05:30 - INFO - __main__ - Step 41772: {'lr': 0.00041607897622155006, 'samples': 8020224, 'steps': 41771, 'loss/train': 1.3142369985580444}}
+11/07/2021 03:05:32 - INFO - __main__ - Step 41776: {'lr': 0.00041606310947782046, 'samples': 8020992, 'steps': 41775, 'loss/train': 1.5007060766220093}}
+11/07/2021 03:05:32 - INFO - __main__ - Step 41776: {'lr': 0.00041606310947782046, 'samples': 8020992, 'steps': 41775, 'loss/train': 1.5007060766220093}}
+11/07/2021 03:05:35 - INFO - __main__ - Step 41782: {'lr': 0.0004160393071174975, 'samples': 8022144, 'steps': 41781, 'loss/train': 1.4717530012130737}}}
+11/07/2021 03:05:38 - INFO - __main__ - Step 41788: {'lr': 0.0004160155020638436, 'samples': 8023296, 'steps': 41787, 'loss/train': 1.6691575050354004}}}
+11/07/2021 03:05:38 - INFO - __main__ - Step 41788: {'lr': 0.0004160155020638436, 'samples': 8023296, 'steps': 41787, 'loss/train': 1.6691575050354004}}}
+11/07/2021 03:05:41 - INFO - __main__ - Step 41795: {'lr': 0.0004159877260976914, 'samples': 8024640, 'steps': 41794, 'loss/train': 1.1664894819259644}}}
+11/07/2021 03:05:43 - INFO - __main__ - Step 41800: {'lr': 0.0004159678838780874, 'samples': 8025600, 'steps': 41799, 'loss/train': 1.3497828245162964}}}
+11/07/2021 03:05:46 - INFO - __main__ - Step 41805: {'lr': 0.00041594803978891925, 'samples': 8026560, 'steps': 41804, 'loss/train': 1.3734766244888306}}
+11/07/2021 03:05:46 - INFO - __main__ - Step 41805: {'lr': 0.00041594803978891925, 'samples': 8026560, 'steps': 41804, 'loss/train': 1.3734766244888306}}
+11/07/2021 03:05:50 - INFO - __main__ - Step 41812: {'lr': 0.0004159202549236416, 'samples': 8027904, 'steps': 41811, 'loss/train': 1.2156720161437988}}}
+11/07/2021 03:05:51 - INFO - __main__ - Step 41816: {'lr': 0.000415904376212985, 'samples': 8028672, 'steps': 41815, 'loss/train': 1.4413472414016724}}}}
+11/07/2021 03:05:53 - INFO - __main__ - Step 41820: {'lr': 0.00041588849630626513, 'samples': 8029440, 'steps': 41819, 'loss/train': 1.7191028594970703}}
+11/07/2021 03:05:56 - INFO - __main__ - Step 41825: {'lr': 0.00041586864474107575, 'samples': 8030400, 'steps': 41824, 'loss/train': 1.1881881952285767}}
+11/07/2021 03:05:58 - INFO - __main__ - Step 41829: {'lr': 0.0004158527621436322, 'samples': 8031168, 'steps': 41828, 'loss/train': 1.5067369937896729}}}
+11/07/2021 03:05:58 - INFO - __main__ - Step 41829: {'lr': 0.0004158527621436322, 'samples': 8031168, 'steps': 41828, 'loss/train': 1.5067369937896729}}}
+11/07/2021 03:06:01 - INFO - __main__ - Step 41836: {'lr': 0.00041582496472104314, 'samples': 8032512, 'steps': 41835, 'loss/train': 2.1492388248443604}}
+11/07/2021 03:06:03 - INFO - __main__ - Step 41841: {'lr': 0.0004158051071776129, 'samples': 8033472, 'steps': 41840, 'loss/train': 1.3763138055801392}}}
+11/07/2021 03:06:03 - INFO - __main__ - Step 41841: {'lr': 0.0004158051071776129, 'samples': 8033472, 'steps': 41840, 'loss/train': 1.3763138055801392}}}
+11/07/2021 03:06:03 - INFO - __main__ - Step 41841: {'lr': 0.0004158051071776129, 'samples': 8033472, 'steps': 41840, 'loss/train': 1.3763138055801392}}}
+11/07/2021 03:06:09 - INFO - __main__ - Step 41852: {'lr': 0.00041576141400796984, 'samples': 8035584, 'steps': 41851, 'loss/train': 1.2623769044876099}}
+11/07/2021 03:06:11 - INFO - __main__ - Step 41857: {'lr': 0.0004157415504885893, 'samples': 8036544, 'steps': 41856, 'loss/train': 1.363741159439087}9}}
+11/07/2021 03:06:14 - INFO - __main__ - Step 41862: {'lr': 0.0004157216851021941, 'samples': 8037504, 'steps': 41861, 'loss/train': 2.5971829891204834}}}
+11/07/2021 03:06:16 - INFO - __main__ - Step 41866: {'lr': 0.0004157057914489778, 'samples': 8038272, 'steps': 41865, 'loss/train': 1.4821267127990723}}}
+11/07/2021 03:06:18 - INFO - __main__ - Step 41870: {'lr': 0.0004156898966011299, 'samples': 8039040, 'steps': 41869, 'loss/train': 1.2954154014587402}}}
+11/07/2021 03:06:18 - INFO - __main__ - Step 41870: {'lr': 0.0004156898966011299, 'samples': 8039040, 'steps': 41869, 'loss/train': 1.2954154014587402}}}
+11/07/2021 03:06:21 - INFO - __main__ - Step 41877: {'lr': 0.00041566207774315866, 'samples': 8040384, 'steps': 41876, 'loss/train': 1.8460909128189087}}
+11/07/2021 03:06:21 - INFO - __main__ - Step 41877: {'lr': 0.00041566207774315866, 'samples': 8040384, 'steps': 41876, 'loss/train': 1.8460909128189087}}
+11/07/2021 03:06:25 - INFO - __main__ - Step 41886: {'lr': 0.0004156263052657148, 'samples': 8042112, 'steps': 41885, 'loss/train': 1.515254259109497}7}}
+11/07/2021 03:06:28 - INFO - __main__ - Step 41890: {'lr': 0.0004156104044464282, 'samples': 8042880, 'steps': 41889, 'loss/train': 1.5599640607833862}}}
+11/07/2021 03:06:29 - INFO - __main__ - Step 41894: {'lr': 0.0004155945024331976, 'samples': 8043648, 'steps': 41893, 'loss/train': 1.2952686548233032}}}
+11/07/2021 03:06:31 - INFO - __main__ - Step 41898: {'lr': 0.00041557859922613795, 'samples': 8044416, 'steps': 41897, 'loss/train': 1.8280117511749268}}
+11/07/2021 03:06:34 - INFO - __main__ - Step 41903: {'lr': 0.00041555871853866553, 'samples': 8045376, 'steps': 41902, 'loss/train': 1.4974288940429688}}
+11/07/2021 03:06:36 - INFO - __main__ - Step 41907: {'lr': 0.0004155428126459092, 'samples': 8046144, 'steps': 41906, 'loss/train': 1.0993465185165405}}}
+11/07/2021 03:06:36 - INFO - __main__ - Step 41907: {'lr': 0.0004155428126459092, 'samples': 8046144, 'steps': 41906, 'loss/train': 1.0993465185165405}}}
+11/07/2021 03:06:39 - INFO - __main__ - Step 41914: {'lr': 0.0004155149744618997, 'samples': 8047488, 'steps': 41913, 'loss/train': 1.6639630794525146}}}
+11/07/2021 03:06:42 - INFO - __main__ - Step 41920: {'lr': 0.0004154911102527356, 'samples': 8048640, 'steps': 41919, 'loss/train': 1.6904728412628174}}}
+11/07/2021 03:06:44 - INFO - __main__ - Step 41924: {'lr': 0.0004154751992885808, 'samples': 8049408, 'steps': 41923, 'loss/train': 0.46176427602767944}}
+11/07/2021 03:06:44 - INFO - __main__ - Step 41924: {'lr': 0.0004154751992885808, 'samples': 8049408, 'steps': 41923, 'loss/train': 0.46176427602767944}}
+11/07/2021 03:06:47 - INFO - __main__ - Step 41931: {'lr': 0.00041544735223079693, 'samples': 8050752, 'steps': 41930, 'loss/train': 1.6106220483779907}}
+11/07/2021 03:06:49 - INFO - __main__ - Step 41935: {'lr': 0.000415431437986253, 'samples': 8051520, 'steps': 41934, 'loss/train': 1.0677088499069214}7}}
+11/07/2021 03:06:52 - INFO - __main__ - Step 41940: {'lr': 0.0004154115435034175, 'samples': 8052480, 'steps': 41939, 'loss/train': 1.5125808715820312}}}
+11/07/2021 03:06:54 - INFO - __main__ - Step 41944: {'lr': 0.0004153956265755642, 'samples': 8053248, 'steps': 41943, 'loss/train': 1.6083602905273438}}}
+11/07/2021 03:06:54 - INFO - __main__ - Step 41944: {'lr': 0.0004153956265755642, 'samples': 8053248, 'steps': 41943, 'loss/train': 1.6083602905273438}}}
+11/07/2021 03:06:57 - INFO - __main__ - Step 41951: {'lr': 0.00041536776908268847, 'samples': 8054592, 'steps': 41950, 'loss/train': 1.2215300798416138}}
+11/07/2021 03:06:57 - INFO - __main__ - Step 41951: {'lr': 0.00041536776908268847, 'samples': 8054592, 'steps': 41950, 'loss/train': 1.2215300798416138}}
+11/07/2021 03:07:01 - INFO - __main__ - Step 41958: {'lr': 0.0004153399079387167, 'samples': 8055936, 'steps': 41957, 'loss/train': 1.5228304862976074}}}
+11/07/2021 03:07:04 - INFO - __main__ - Step 41964: {'lr': 0.0004153160240526612, 'samples': 8057088, 'steps': 41963, 'loss/train': 1.6114858388900757}}}
+11/07/2021 03:07:06 - INFO - __main__ - Step 41968: {'lr': 0.00041530009997215665, 'samples': 8057856, 'steps': 41967, 'loss/train': 1.4030784368515015}}
+11/07/2021 03:07:08 - INFO - __main__ - Step 41972: {'lr': 0.0004152841746999454, 'samples': 8058624, 'steps': 41971, 'loss/train': 1.5982258319854736}}}
+11/07/2021 03:07:09 - INFO - __main__ - Step 41976: {'lr': 0.0004152682482361422, 'samples': 8059392, 'steps': 41975, 'loss/train': 1.662643313407898}}}}
+11/07/2021 03:07:09 - INFO - __main__ - Step 41976: {'lr': 0.0004152682482361422, 'samples': 8059392, 'steps': 41975, 'loss/train': 1.662643313407898}}}}
+11/07/2021 03:07:09 - INFO - __main__ - Step 41976: {'lr': 0.0004152682482361422, 'samples': 8059392, 'steps': 41975, 'loss/train': 1.662643313407898}}}}
+11/07/2021 03:07:15 - INFO - __main__ - Step 41986: {'lr': 0.00041522842686417255, 'samples': 8061312, 'steps': 41985, 'loss/train': 1.1234190464019775}}
+11/07/2021 03:07:18 - INFO - __main__ - Step 41992: {'lr': 0.0004152045304673058, 'samples': 8062464, 'steps': 41991, 'loss/train': 1.167265772819519}5}}
+11/07/2021 03:07:20 - INFO - __main__ - Step 41996: {'lr': 0.00041518859804726507, 'samples': 8063232, 'steps': 41995, 'loss/train': 1.2416760921478271}}
+11/07/2021 03:07:20 - INFO - __main__ - Step 41996: {'lr': 0.00041518859804726507, 'samples': 8063232, 'steps': 41995, 'loss/train': 1.2416760921478271}}
+11/07/2021 03:07:24 - INFO - __main__ - Step 42003: {'lr': 0.00041516071344665275, 'samples': 8064576, 'steps': 42002, 'loss/train': 1.8126933574676514}}
+11/07/2021 03:07:25 - INFO - __main__ - Step 42007: {'lr': 0.0004151447777519054, 'samples': 8065344, 'steps': 42006, 'loss/train': 1.7512965202331543}}}
+11/07/2021 03:07:27 - INFO - __main__ - Step 42011: {'lr': 0.000415128840866571, 'samples': 8066112, 'steps': 42010, 'loss/train': 5.797067642211914}3}}}
+11/07/2021 03:07:30 - INFO - __main__ - Step 42016: {'lr': 0.0004151089180858151, 'samples': 8067072, 'steps': 42015, 'loss/train': 1.1027518510818481}}}
+11/07/2021 03:07:32 - INFO - __main__ - Step 42020: {'lr': 0.00041509297852208003, 'samples': 8067840, 'steps': 42019, 'loss/train': 1.8538402318954468}}
+11/07/2021 03:07:32 - INFO - __main__ - Step 42020: {'lr': 0.00041509297852208003, 'samples': 8067840, 'steps': 42019, 'loss/train': 1.8538402318954468}}
+11/07/2021 03:07:35 - INFO - __main__ - Step 42027: {'lr': 0.0004150650814216614, 'samples': 8069184, 'steps': 42026, 'loss/train': 2.0050127506256104}}}
+11/07/2021 03:07:38 - INFO - __main__ - Step 42033: {'lr': 0.00041504116672062385, 'samples': 8070336, 'steps': 42032, 'loss/train': 1.820695400238037}}}
+11/07/2021 03:07:38 - INFO - __main__ - Step 42033: {'lr': 0.00041504116672062385, 'samples': 8070336, 'steps': 42032, 'loss/train': 1.820695400238037}}}
+11/07/2021 03:07:41 - INFO - __main__ - Step 42040: {'lr': 0.00041501326285249963, 'samples': 8071680, 'steps': 42039, 'loss/train': 1.6893484592437744}}
+11/07/2021 03:07:43 - INFO - __main__ - Step 42044: {'lr': 0.0004149973161492072, 'samples': 8072448, 'steps': 42043, 'loss/train': 1.4257150888442993}}}
+11/07/2021 03:07:46 - INFO - __main__ - Step 42050: {'lr': 0.000414973393863947, 'samples': 8073600, 'steps': 42049, 'loss/train': 1.5420819520950317}}}}
+11/07/2021 03:07:46 - INFO - __main__ - Step 42050: {'lr': 0.000414973393863947, 'samples': 8073600, 'steps': 42049, 'loss/train': 1.5420819520950317}}}}
+11/07/2021 03:07:46 - INFO - __main__ - Step 42050: {'lr': 0.000414973393863947, 'samples': 8073600, 'steps': 42049, 'loss/train': 1.5420819520950317}}}}
+11/07/2021 03:07:51 - INFO - __main__ - Step 42060: {'lr': 0.0004149335174419478, 'samples': 8075520, 'steps': 42059, 'loss/train': 1.5596524477005005}}}
+11/07/2021 03:07:54 - INFO - __main__ - Step 42065: {'lr': 0.0004149135764439672, 'samples': 8076480, 'steps': 42064, 'loss/train': 1.273585557937622}}}}
+11/07/2021 03:07:56 - INFO - __main__ - Step 42070: {'lr': 0.00041489363358829885, 'samples': 8077440, 'steps': 42069, 'loss/train': 1.3521915674209595}}
+11/07/2021 03:07:58 - INFO - __main__ - Step 42074: {'lr': 0.0004148776779663799, 'samples': 8078208, 'steps': 42073, 'loss/train': 1.590319275856018}5}}
+11/07/2021 03:07:58 - INFO - __main__ - Step 42074: {'lr': 0.0004148776779663799, 'samples': 8078208, 'steps': 42073, 'loss/train': 1.590319275856018}5}}
+11/07/2021 03:08:01 - INFO - __main__ - Step 42081: {'lr': 0.00041484975276787436, 'samples': 8079552, 'steps': 42080, 'loss/train': 1.5335677862167358}}
+11/07/2021 03:08:04 - INFO - __main__ - Step 42086: {'lr': 0.00041482980396911467, 'samples': 8080512, 'steps': 42085, 'loss/train': 0.7727944850921631}}
+11/07/2021 03:08:06 - INFO - __main__ - Step 42090: {'lr': 0.0004148138435932404, 'samples': 8081280, 'steps': 42089, 'loss/train': 1.4468871355056763}}}
+11/07/2021 03:08:08 - INFO - __main__ - Step 42094: {'lr': 0.00041479788202916483, 'samples': 8082048, 'steps': 42093, 'loss/train': 1.8482271432876587}}
+11/07/2021 03:08:10 - INFO - __main__ - Step 42098: {'lr': 0.0004147819192770033, 'samples': 8082816, 'steps': 42097, 'loss/train': 1.5658690929412842}}}
+11/07/2021 03:08:12 - INFO - __main__ - Step 42102: {'lr': 0.0004147659553368706, 'samples': 8083584, 'steps': 42101, 'loss/train': 2.541309118270874}}}}
+11/07/2021 03:08:12 - INFO - __main__ - Step 42102: {'lr': 0.0004147659553368706, 'samples': 8083584, 'steps': 42101, 'loss/train': 2.541309118270874}}}}
+11/07/2021 03:08:16 - INFO - __main__ - Step 42110: {'lr': 0.0004147340238931525, 'samples': 8085120, 'steps': 42109, 'loss/train': 1.515739917755127}}}}
+11/07/2021 03:08:18 - INFO - __main__ - Step 42114: {'lr': 0.0004147180563897972, 'samples': 8085888, 'steps': 42113, 'loss/train': 2.0268678665161133}}}
+11/07/2021 03:08:19 - INFO - __main__ - Step 42118: {'lr': 0.00041470208769893137, 'samples': 8086656, 'steps': 42117, 'loss/train': 1.7440546751022339}}
+11/07/2021 03:08:21 - INFO - __main__ - Step 42122: {'lr': 0.00041468611782067, 'samples': 8087424, 'steps': 42121, 'loss/train': 1.2551136016845703}39}}
+11/07/2021 03:08:24 - INFO - __main__ - Step 42127: {'lr': 0.0004146661538032438, 'samples': 8088384, 'steps': 42126, 'loss/train': 1.5557634830474854}}}
+11/07/2021 03:08:26 - INFO - __main__ - Step 42131: {'lr': 0.00041465018125376354, 'samples': 8089152, 'steps': 42130, 'loss/train': 1.5250442028045654}}
+11/07/2021 03:08:26 - INFO - __main__ - Step 42131: {'lr': 0.00041465018125376354, 'samples': 8089152, 'steps': 42130, 'loss/train': 1.5250442028045654}}
+11/07/2021 03:08:29 - INFO - __main__ - Step 42138: {'lr': 0.00041462222643597236, 'samples': 8090496, 'steps': 42137, 'loss/train': 1.4060335159301758}}
+11/07/2021 03:08:31 - INFO - __main__ - Step 42143: {'lr': 0.0004146022564836556, 'samples': 8091456, 'steps': 42142, 'loss/train': 1.6729769706726074}}}
+11/07/2021 03:08:34 - INFO - __main__ - Step 42148: {'lr': 0.00041458228467715786, 'samples': 8092416, 'steps': 42147, 'loss/train': 1.452275037765503}}}
+11/07/2021 03:08:34 - INFO - __main__ - Step 42148: {'lr': 0.00041458228467715786, 'samples': 8092416, 'steps': 42147, 'loss/train': 1.452275037765503}}}
+11/07/2021 03:08:37 - INFO - __main__ - Step 42155: {'lr': 0.0004145543210334656, 'samples': 8093760, 'steps': 42154, 'loss/train': 1.334218144416809}}}}
+11/07/2021 03:08:39 - INFO - __main__ - Step 42159: {'lr': 0.0004145383401772549, 'samples': 8094528, 'steps': 42158, 'loss/train': 1.6665518283843994}}}
+11/07/2021 03:08:42 - INFO - __main__ - Step 42164: {'lr': 0.00041451836243889027, 'samples': 8095488, 'steps': 42163, 'loss/train': 1.2692837715148926}}
+11/07/2021 03:08:44 - INFO - __main__ - Step 42169: {'lr': 0.00041449838284728964, 'samples': 8096448, 'steps': 42168, 'loss/train': 1.386372685432434}}}
+11/07/2021 03:08:46 - INFO - __main__ - Step 42173: {'lr': 0.0004144823978398306, 'samples': 8097216, 'steps': 42172, 'loss/train': 1.8618935346603394}}}
+11/07/2021 03:08:46 - INFO - __main__ - Step 42173: {'lr': 0.0004144823978398306, 'samples': 8097216, 'steps': 42172, 'loss/train': 1.8618935346603394}}}
+11/07/2021 03:08:49 - INFO - __main__ - Step 42180: {'lr': 0.00041445442122348727, 'samples': 8098560, 'steps': 42179, 'loss/train': 0.6647708415985107}}
+11/07/2021 03:08:52 - INFO - __main__ - Step 42186: {'lr': 0.0004144304383766737, 'samples': 8099712, 'steps': 42185, 'loss/train': 1.4202641248703003}}}
+11/07/2021 03:08:52 - INFO - __main__ - Step 42186: {'lr': 0.0004144304383766737, 'samples': 8099712, 'steps': 42185, 'loss/train': 1.4202641248703003}}}
+11/07/2021 03:08:56 - INFO - __main__ - Step 42193: {'lr': 0.0004144024550176653, 'samples': 8101056, 'steps': 42192, 'loss/train': 1.3551652431488037}}}
+11/07/2021 03:08:58 - INFO - __main__ - Step 42197: {'lr': 0.000414386462897065, 'samples': 8101824, 'steps': 42196, 'loss/train': 1.359559416770935}7}}}
+11/07/2021 03:09:00 - INFO - __main__ - Step 42201: {'lr': 0.0004143704695913447, 'samples': 8102592, 'steps': 42200, 'loss/train': 1.3718774318695068}}}
+11/07/2021 03:09:02 - INFO - __main__ - Step 42205: {'lr': 0.0004143544751006197, 'samples': 8103360, 'steps': 42204, 'loss/train': 1.5881863832473755}}}
+11/07/2021 03:09:04 - INFO - __main__ - Step 42209: {'lr': 0.00041433847942500516, 'samples': 8104128, 'steps': 42208, 'loss/train': 1.2702810764312744}}
+11/07/2021 03:09:06 - INFO - __main__ - Step 42213: {'lr': 0.0004143224825646166, 'samples': 8104896, 'steps': 42212, 'loss/train': 1.3781150579452515}}}
+11/07/2021 03:09:07 - INFO - __main__ - Step 42217: {'lr': 0.00041430648451956913, 'samples': 8105664, 'steps': 42216, 'loss/train': 1.4321280717849731}}
+11/07/2021 03:09:10 - INFO - __main__ - Step 42222: {'lr': 0.0004142864852975092, 'samples': 8106624, 'steps': 42221, 'loss/train': 1.4351541996002197}}}
+11/07/2021 03:09:10 - INFO - __main__ - Step 42222: {'lr': 0.0004142864852975092, 'samples': 8106624, 'steps': 42221, 'loss/train': 1.4351541996002197}}}
+11/07/2021 03:09:14 - INFO - __main__ - Step 42230: {'lr': 0.00041425448269300923, 'samples': 8108160, 'steps': 42229, 'loss/train': 1.63296377658844}7}}
+11/07/2021 03:09:16 - INFO - __main__ - Step 42234: {'lr': 0.00041423847961444873, 'samples': 8108928, 'steps': 42233, 'loss/train': 1.8132482767105103}}
+11/07/2021 03:09:17 - INFO - __main__ - Step 42238: {'lr': 0.0004142224753518351, 'samples': 8109696, 'steps': 42237, 'loss/train': 1.3605972528457642}}}
+11/07/2021 03:09:20 - INFO - __main__ - Step 42242: {'lr': 0.00041420646990528355, 'samples': 8110464, 'steps': 42241, 'loss/train': 1.4256129264831543}}
+11/07/2021 03:09:22 - INFO - __main__ - Step 42247: {'lr': 0.00041418646143235737, 'samples': 8111424, 'steps': 42246, 'loss/train': 2.096343517303467}}}
+11/07/2021 03:09:24 - INFO - __main__ - Step 42251: {'lr': 0.00041417045332236776, 'samples': 8112192, 'steps': 42250, 'loss/train': 1.1745171546936035}}
+11/07/2021 03:09:26 - INFO - __main__ - Step 42255: {'lr': 0.0004141544440288153, 'samples': 8112960, 'steps': 42254, 'loss/train': 2.242783546447754}5}}
+11/07/2021 03:09:28 - INFO - __main__ - Step 42259: {'lr': 0.0004141384335518155, 'samples': 8113728, 'steps': 42258, 'loss/train': 1.6466920375823975}}}
+11/07/2021 03:09:30 - INFO - __main__ - Step 42263: {'lr': 0.00041412242189148383, 'samples': 8114496, 'steps': 42262, 'loss/train': 1.5122243165969849}}
+11/07/2021 03:09:32 - INFO - __main__ - Step 42268: {'lr': 0.0004141024056521845, 'samples': 8115456, 'steps': 42267, 'loss/train': 0.7243680357933044}}}
+11/07/2021 03:09:32 - INFO - __main__ - Step 42268: {'lr': 0.0004141024056521845, 'samples': 8115456, 'steps': 42267, 'loss/train': 0.7243680357933044}}}
+11/07/2021 03:09:36 - INFO - __main__ - Step 42274: {'lr': 0.00041407838372495883, 'samples': 8116608, 'steps': 42273, 'loss/train': 1.0360863208770752}}
+11/07/2021 03:09:38 - INFO - __main__ - Step 42279: {'lr': 0.0004140583634191465, 'samples': 8117568, 'steps': 42278, 'loss/train': 1.5542657375335693}}}
+11/07/2021 03:09:40 - INFO - __main__ - Step 42284: {'lr': 0.00041403834126528007, 'samples': 8118528, 'steps': 42283, 'loss/train': 1.6267235279083252}}
+11/07/2021 03:09:40 - INFO - __main__ - Step 42284: {'lr': 0.00041403834126528007, 'samples': 8118528, 'steps': 42283, 'loss/train': 1.6267235279083252}}
+11/07/2021 03:09:44 - INFO - __main__ - Step 42291: {'lr': 0.0004140103071455654, 'samples': 8119872, 'steps': 42290, 'loss/train': 1.7726240158081055}}}
+11/07/2021 03:09:46 - INFO - __main__ - Step 42296: {'lr': 0.00041399028055728914, 'samples': 8120832, 'steps': 42295, 'loss/train': 1.5786479711532593}}
+11/07/2021 03:09:46 - INFO - __main__ - Step 42296: {'lr': 0.00041399028055728914, 'samples': 8120832, 'steps': 42295, 'loss/train': 1.5786479711532593}}
+11/07/2021 03:09:49 - INFO - __main__ - Step 42303: {'lr': 0.00041396224023031045, 'samples': 8122176, 'steps': 42302, 'loss/train': 1.121030569076538}}}
+11/07/2021 03:09:51 - INFO - __main__ - Step 42307: {'lr': 0.00041394621556094805, 'samples': 8122944, 'steps': 42306, 'loss/train': 1.5338916778564453}}
+11/07/2021 03:09:54 - INFO - __main__ - Step 42312: {'lr': 0.00041392618306214683, 'samples': 8123904, 'steps': 42311, 'loss/train': 1.2932323217391968}}
+11/07/2021 03:09:56 - INFO - __main__ - Step 42316: {'lr': 0.00041391015573356805, 'samples': 8124672, 'steps': 42315, 'loss/train': 1.5465834140777588}}
+11/07/2021 03:09:58 - INFO - __main__ - Step 42320: {'lr': 0.0004138941272233031, 'samples': 8125440, 'steps': 42319, 'loss/train': 1.346096396446228}8}}
+11/07/2021 03:10:00 - INFO - __main__ - Step 42324: {'lr': 0.00041387809753146756, 'samples': 8126208, 'steps': 42323, 'loss/train': 1.7210004329681396}}
+11/07/2021 03:10:02 - INFO - __main__ - Step 42329: {'lr': 0.0004138580587552654, 'samples': 8127168, 'steps': 42328, 'loss/train': 1.4846197366714478}}}
+11/07/2021 03:10:04 - INFO - __main__ - Step 42333: {'lr': 0.0004138420264053184, 'samples': 8127936, 'steps': 42332, 'loss/train': 1.7020927667617798}}}
+11/07/2021 03:10:06 - INFO - __main__ - Step 42337: {'lr': 0.0004138259928741764, 'samples': 8128704, 'steps': 42336, 'loss/train': 1.46265709400177}8}}}
+11/07/2021 03:10:08 - INFO - __main__ - Step 42341: {'lr': 0.000413809958161955, 'samples': 8129472, 'steps': 42340, 'loss/train': 1.5473113059997559}}}}
+11/07/2021 03:10:10 - INFO - __main__ - Step 42345: {'lr': 0.00041379392226876974, 'samples': 8130240, 'steps': 42344, 'loss/train': 1.669350028038025}}}
+11/07/2021 03:10:12 - INFO - __main__ - Step 42350: {'lr': 0.0004137738757417339, 'samples': 8131200, 'steps': 42349, 'loss/train': 1.6222318410873413}}}
+11/07/2021 03:10:12 - INFO - __main__ - Step 42350: {'lr': 0.0004137738757417339, 'samples': 8131200, 'steps': 42349, 'loss/train': 1.6222318410873413}}}
+11/07/2021 03:10:16 - INFO - __main__ - Step 42357: {'lr': 0.0004137458075045871, 'samples': 8132544, 'steps': 42356, 'loss/train': 0.9286091923713684}}}
+11/07/2021 03:10:16 - INFO - __main__ - Step 42357: {'lr': 0.0004137458075045871, 'samples': 8132544, 'steps': 42356, 'loss/train': 0.9286091923713684}}}
+11/07/2021 03:10:20 - INFO - __main__ - Step 42364: {'lr': 0.00041371773565215494, 'samples': 8133888, 'steps': 42363, 'loss/train': 1.8453580141067505}}
+11/07/2021 03:10:22 - INFO - __main__ - Step 42368: {'lr': 0.00041370169297067145, 'samples': 8134656, 'steps': 42367, 'loss/train': 2.0079658031463623}}
+11/07/2021 03:10:24 - INFO - __main__ - Step 42374: {'lr': 0.0004136776267356387, 'samples': 8135808, 'steps': 42373, 'loss/train': 1.7191283702850342}}}
+11/07/2021 03:10:27 - INFO - __main__ - Step 42378: {'lr': 0.00041366158110391375, 'samples': 8136576, 'steps': 42377, 'loss/train': 1.5728462934494019}}
+11/07/2021 03:10:27 - INFO - __main__ - Step 42378: {'lr': 0.00041366158110391375, 'samples': 8136576, 'steps': 42377, 'loss/train': 1.5728462934494019}}
+11/07/2021 03:10:30 - INFO - __main__ - Step 42385: {'lr': 0.0004136334984093446, 'samples': 8137920, 'steps': 42384, 'loss/train': 0.9145182967185974}}}
+11/07/2021 03:10:32 - INFO - __main__ - Step 42389: {'lr': 0.00041361744953318923, 'samples': 8138688, 'steps': 42388, 'loss/train': 1.2505319118499756}}
+11/07/2021 03:10:35 - INFO - __main__ - Step 42395: {'lr': 0.00041359337400728746, 'samples': 8139840, 'steps': 42394, 'loss/train': 0.7346595525741577}}
+11/07/2021 03:10:35 - INFO - __main__ - Step 42395: {'lr': 0.00041359337400728746, 'samples': 8139840, 'steps': 42394, 'loss/train': 0.7346595525741577}}
+11/07/2021 03:10:38 - INFO - __main__ - Step 42402: {'lr': 0.00041356528253983714, 'samples': 8141184, 'steps': 42401, 'loss/train': 1.5337250232696533}}
+11/07/2021 03:10:40 - INFO - __main__ - Step 42406: {'lr': 0.00041354922865128316, 'samples': 8141952, 'steps': 42405, 'loss/train': 1.2541090250015259}}
+11/07/2021 03:10:42 - INFO - __main__ - Step 42410: {'lr': 0.00041353317358364496, 'samples': 8142720, 'steps': 42409, 'loss/train': 1.0971400737762451}}
+11/07/2021 03:10:44 - INFO - __main__ - Step 42415: {'lr': 0.00041351310309118653, 'samples': 8143680, 'steps': 42414, 'loss/train': 0.7985998392105103}}
+11/07/2021 03:10:47 - INFO - __main__ - Step 42420: {'lr': 0.000413493030756816, 'samples': 8144640, 'steps': 42419, 'loss/train': 1.7966359853744507}3}}
+11/07/2021 03:10:47 - INFO - __main__ - Step 42420: {'lr': 0.000413493030756816, 'samples': 8144640, 'steps': 42419, 'loss/train': 1.7966359853744507}3}}
+11/07/2021 03:10:50 - INFO - __main__ - Step 42427: {'lr': 0.00041346492639471555, 'samples': 8145984, 'steps': 42426, 'loss/train': 1.1028519868850708}}
+11/07/2021 03:10:52 - INFO - __main__ - Step 42431: {'lr': 0.00041344886513878485, 'samples': 8146752, 'steps': 42430, 'loss/train': 1.7651448249816895}}
+11/07/2021 03:10:55 - INFO - __main__ - Step 42436: {'lr': 0.0004134287869118154, 'samples': 8147712, 'steps': 42435, 'loss/train': 1.740281343460083}5}}
+11/07/2021 03:10:57 - INFO - __main__ - Step 42440: {'lr': 0.0004134127230047362, 'samples': 8148480, 'steps': 42439, 'loss/train': 1.5026410818099976}}}
+11/07/2021 03:10:59 - INFO - __main__ - Step 42444: {'lr': 0.00041339665791955695, 'samples': 8149248, 'steps': 42443, 'loss/train': 1.6956210136413574}}
+11/07/2021 03:11:00 - INFO - __main__ - Step 42448: {'lr': 0.0004133805916563935, 'samples': 8150016, 'steps': 42447, 'loss/train': 1.2641940116882324}}}
+11/07/2021 03:11:02 - INFO - __main__ - Step 42452: {'lr': 0.0004133645242153617, 'samples': 8150784, 'steps': 42451, 'loss/train': 1.6520686149597168}}}
+11/07/2021 03:11:05 - INFO - __main__ - Step 42457: {'lr': 0.00041334443825787097, 'samples': 8151744, 'steps': 42456, 'loss/train': 1.0859808921813965}}
+11/07/2021 03:11:07 - INFO - __main__ - Step 42461: {'lr': 0.0004133283681670589, 'samples': 8152512, 'steps': 42460, 'loss/train': 1.2702975273132324}}}
+11/07/2021 03:11:09 - INFO - __main__ - Step 42465: {'lr': 0.00041331229689875487, 'samples': 8153280, 'steps': 42464, 'loss/train': 1.96661376953125}}}}
+11/07/2021 03:11:10 - INFO - __main__ - Step 42469: {'lr': 0.0004132962244530749, 'samples': 8154048, 'steps': 42468, 'loss/train': 1.902879238128662}}}}
+11/07/2021 03:11:12 - INFO - __main__ - Step 42473: {'lr': 0.0004132801508301347, 'samples': 8154816, 'steps': 42472, 'loss/train': 1.3885867595672607}}}
+11/07/2021 03:11:15 - INFO - __main__ - Step 42478: {'lr': 0.000413260057146114, 'samples': 8155776, 'steps': 42477, 'loss/train': 1.9076615571975708}}}}
+11/07/2021 03:11:17 - INFO - __main__ - Step 42482: {'lr': 0.0004132439808747622, 'samples': 8156544, 'steps': 42481, 'loss/train': 1.372361421585083}}}}
+11/07/2021 03:11:19 - INFO - __main__ - Step 42486: {'lr': 0.00041322790342652695, 'samples': 8157312, 'steps': 42485, 'loss/train': 0.6607436537742615}}
+11/07/2021 03:11:19 - INFO - __main__ - Step 42486: {'lr': 0.00041322790342652695, 'samples': 8157312, 'steps': 42485, 'loss/train': 0.6607436537742615}}
+11/07/2021 03:11:22 - INFO - __main__ - Step 42493: {'lr': 0.00041319976506058785, 'samples': 8158656, 'steps': 42492, 'loss/train': 0.9843049049377441}}
+11/07/2021 03:11:24 - INFO - __main__ - Step 42498: {'lr': 0.00041317966402167923, 'samples': 8159616, 'steps': 42497, 'loss/train': 1.2073416709899902}}
+11/07/2021 03:11:27 - INFO - __main__ - Step 42503: {'lr': 0.0004131595611446146, 'samples': 8160576, 'steps': 42502, 'loss/train': 1.4976180791854858}}}
+11/07/2021 03:11:29 - INFO - __main__ - Step 42507: {'lr': 0.0004131434775196428, 'samples': 8161344, 'steps': 42506, 'loss/train': 1.2052451372146606}}}
+11/07/2021 03:11:31 - INFO - __main__ - Step 42511: {'lr': 0.00041312739271851196, 'samples': 8162112, 'steps': 42510, 'loss/train': 1.5313423871994019}}
+11/07/2021 03:11:32 - INFO - __main__ - Step 42515: {'lr': 0.00041311130674133824, 'samples': 8162880, 'steps': 42514, 'loss/train': 1.7059967517852783}}
+11/07/2021 03:11:35 - INFO - __main__ - Step 42519: {'lr': 0.0004130952195882375, 'samples': 8163648, 'steps': 42518, 'loss/train': 1.2123099565505981}}}
+11/07/2021 03:11:35 - INFO - __main__ - Step 42519: {'lr': 0.0004130952195882375, 'samples': 8163648, 'steps': 42518, 'loss/train': 1.2123099565505981}}}
+11/07/2021 03:11:39 - INFO - __main__ - Step 42527: {'lr': 0.0004130630417547189, 'samples': 8165184, 'steps': 42526, 'loss/train': 1.6828103065490723}}}
+11/07/2021 03:11:40 - INFO - __main__ - Step 42531: {'lr': 0.00041304695107453307, 'samples': 8165952, 'steps': 42530, 'loss/train': 1.6047009229660034}}
+11/07/2021 03:11:42 - INFO - __main__ - Step 42535: {'lr': 0.0004130308592188842, 'samples': 8166720, 'steps': 42534, 'loss/train': 1.5886842012405396}}}
+11/07/2021 03:11:45 - INFO - __main__ - Step 42540: {'lr': 0.0004130107427465049, 'samples': 8167680, 'steps': 42539, 'loss/train': 1.7081719636917114}}}
+11/07/2021 03:11:47 - INFO - __main__ - Step 42544: {'lr': 0.0004129946482464883, 'samples': 8168448, 'steps': 42543, 'loss/train': 0.9306034445762634}}}
+11/07/2021 03:11:49 - INFO - __main__ - Step 42548: {'lr': 0.00041297855257138577, 'samples': 8169216, 'steps': 42547, 'loss/train': 1.384551763534546}}}
+11/07/2021 03:11:51 - INFO - __main__ - Step 42552: {'lr': 0.0004129624557213133, 'samples': 8169984, 'steps': 42551, 'loss/train': 1.28696870803833}6}}}
+11/07/2021 03:11:53 - INFO - __main__ - Step 42556: {'lr': 0.0004129463576963869, 'samples': 8170752, 'steps': 42555, 'loss/train': 1.503050446510315}}}}
+11/07/2021 03:11:55 - INFO - __main__ - Step 42560: {'lr': 0.0004129302584967227, 'samples': 8171520, 'steps': 42559, 'loss/train': 1.6396253108978271}}}
+11/07/2021 03:11:57 - INFO - __main__ - Step 42565: {'lr': 0.0004129101328453442, 'samples': 8172480, 'steps': 42564, 'loss/train': 1.6780205965042114}}}
+11/07/2021 03:11:59 - INFO - __main__ - Step 42569: {'lr': 0.0004128940310029443, 'samples': 8173248, 'steps': 42568, 'loss/train': 1.1596369743347168}}}
+11/07/2021 03:11:59 - INFO - __main__ - Step 42569: {'lr': 0.0004128940310029443, 'samples': 8173248, 'steps': 42568, 'loss/train': 1.1596369743347168}}}
+11/07/2021 03:12:02 - INFO - __main__ - Step 42576: {'lr': 0.0004128658499530091, 'samples': 8174592, 'steps': 42575, 'loss/train': 1.3641626834869385}}}
+11/07/2021 03:12:05 - INFO - __main__ - Step 42581: {'lr': 0.0004128457184300454, 'samples': 8175552, 'steps': 42580, 'loss/train': 0.8959876894950867}}}
+11/07/2021 03:12:05 - INFO - __main__ - Step 42581: {'lr': 0.0004128457184300454, 'samples': 8175552, 'steps': 42580, 'loss/train': 0.8959876894950867}}}
+11/07/2021 03:12:09 - INFO - __main__ - Step 42589: {'lr': 0.00041281350417785777, 'samples': 8177088, 'steps': 42588, 'loss/train': 1.5267343521118164}}
+11/07/2021 03:12:09 - INFO - __main__ - Step 42589: {'lr': 0.00041281350417785777, 'samples': 8177088, 'steps': 42588, 'loss/train': 1.5267343521118164}}
+11/07/2021 03:12:12 - INFO - __main__ - Step 42596: {'lr': 0.0004127853128556962, 'samples': 8178432, 'steps': 42595, 'loss/train': 1.4697948694229126}}}
+11/07/2021 03:12:12 - INFO - __main__ - Step 42596: {'lr': 0.0004127853128556962, 'samples': 8178432, 'steps': 42595, 'loss/train': 1.4697948694229126}}}
+11/07/2021 03:12:16 - INFO - __main__ - Step 42603: {'lr': 0.0004127571179394557, 'samples': 8179776, 'steps': 42602, 'loss/train': 1.3474419116973877}}}
+11/07/2021 03:12:18 - INFO - __main__ - Step 42608: {'lr': 0.00041273697651345785, 'samples': 8180736, 'steps': 42607, 'loss/train': 1.7024065256118774}}
+11/07/2021 03:12:21 - INFO - __main__ - Step 42613: {'lr': 0.00041271683325429075, 'samples': 8181696, 'steps': 42612, 'loss/train': 0.977882981300354}}}
+11/07/2021 03:12:23 - INFO - __main__ - Step 42617: {'lr': 0.0004127007173272278, 'samples': 8182464, 'steps': 42616, 'loss/train': 1.5213189125061035}}}
+11/07/2021 03:12:23 - INFO - __main__ - Step 42617: {'lr': 0.0004127007173272278, 'samples': 8182464, 'steps': 42616, 'loss/train': 1.5213189125061035}}}
+11/07/2021 03:12:26 - INFO - __main__ - Step 42624: {'lr': 0.0004126725116324858, 'samples': 8183808, 'steps': 42623, 'loss/train': 1.348909854888916}}}}
+11/07/2021 03:12:29 - INFO - __main__ - Step 42629: {'lr': 0.000412652362508702, 'samples': 8184768, 'steps': 42628, 'loss/train': 0.7027224898338318}}}}
+11/07/2021 03:12:31 - INFO - __main__ - Step 42634: {'lr': 0.0004126322115527021, 'samples': 8185728, 'steps': 42633, 'loss/train': 1.517307996749878}}}}
+11/07/2021 03:12:33 - INFO - __main__ - Step 42638: {'lr': 0.0004126160894688591, 'samples': 8186496, 'steps': 42637, 'loss/train': 1.1772278547286987}}}
+11/07/2021 03:12:33 - INFO - __main__ - Step 42638: {'lr': 0.0004126160894688591, 'samples': 8186496, 'steps': 42637, 'loss/train': 1.1772278547286987}}}
+11/07/2021 03:12:36 - INFO - __main__ - Step 42645: {'lr': 0.00041258787300122026, 'samples': 8187840, 'steps': 42644, 'loss/train': 1.4660903215408325}}
+11/07/2021 03:12:39 - INFO - __main__ - Step 42650: {'lr': 0.0004125677161836543, 'samples': 8188800, 'steps': 42649, 'loss/train': 1.4704724550247192}}}
+11/07/2021 03:12:39 - INFO - __main__ - Step 42650: {'lr': 0.0004125677161836543, 'samples': 8188800, 'steps': 42649, 'loss/train': 1.4704724550247192}}}
+11/07/2021 03:12:43 - INFO - __main__ - Step 42658: {'lr': 0.00041253546146661704, 'samples': 8190336, 'steps': 42657, 'loss/train': 1.883015513420105}}}
+11/07/2021 03:12:45 - INFO - __main__ - Step 42662: {'lr': 0.00041251933235037695, 'samples': 8191104, 'steps': 42661, 'loss/train': 1.5997662544250488}}
+11/07/2021 03:12:46 - INFO - __main__ - Step 42666: {'lr': 0.0004125032020624776, 'samples': 8191872, 'steps': 42665, 'loss/train': 1.5029171705245972}}}
+11/07/2021 03:12:49 - INFO - __main__ - Step 42671: {'lr': 0.00041248303755513484, 'samples': 8192832, 'steps': 42670, 'loss/train': 1.66847562789917}}}}
+11/07/2021 03:12:51 - INFO - __main__ - Step 42675: {'lr': 0.00041246690463142733, 'samples': 8193600, 'steps': 42674, 'loss/train': 0.7003434896469116}}
+11/07/2021 03:12:53 - INFO - __main__ - Step 42679: {'lr': 0.00041245077053643866, 'samples': 8194368, 'steps': 42678, 'loss/train': 1.107468605041504}}}
+11/07/2021 03:12:53 - INFO - __main__ - Step 42679: {'lr': 0.00041245077053643866, 'samples': 8194368, 'steps': 42678, 'loss/train': 1.107468605041504}}}
+11/07/2021 03:12:56 - INFO - __main__ - Step 42686: {'lr': 0.0004124225330521626, 'samples': 8195712, 'steps': 42685, 'loss/train': 1.5804864168167114}}}
+11/07/2021 03:12:58 - INFO - __main__ - Step 42691: {'lr': 0.0004124023612249479, 'samples': 8196672, 'steps': 42690, 'loss/train': 1.4882365465164185}}}
+11/07/2021 03:13:01 - INFO - __main__ - Step 42696: {'lr': 0.0004123821875683333, 'samples': 8197632, 'steps': 42695, 'loss/train': 1.4438482522964478}}}
+11/07/2021 03:13:03 - INFO - __main__ - Step 42700: {'lr': 0.0004123660473260263, 'samples': 8198400, 'steps': 42699, 'loss/train': 0.6675590872764587}}}
+11/07/2021 03:13:03 - INFO - __main__ - Step 42700: {'lr': 0.0004123660473260263, 'samples': 8198400, 'steps': 42699, 'loss/train': 0.6675590872764587}}}
+11/07/2021 03:13:06 - INFO - __main__ - Step 42707: {'lr': 0.00041233779908541316, 'samples': 8199744, 'steps': 42706, 'loss/train': 1.5503088235855103}}
+11/07/2021 03:13:09 - INFO - __main__ - Step 42712: {'lr': 0.00041231761957624593, 'samples': 8200704, 'steps': 42711, 'loss/train': 1.6528187990188599}}
+11/07/2021 03:13:09 - INFO - __main__ - Step 42712: {'lr': 0.00041231761957624593, 'samples': 8200704, 'steps': 42711, 'loss/train': 1.6528187990188599}}
+11/07/2021 03:13:09 - INFO - __main__ - Step 42712: {'lr': 0.00041231761957624593, 'samples': 8200704, 'steps': 42711, 'loss/train': 1.6528187990188599}}
+11/07/2021 03:13:14 - INFO - __main__ - Step 42723: {'lr': 0.0004122732182202703, 'samples': 8202816, 'steps': 42722, 'loss/train': 1.799514651298523}9}}
+11/07/2021 03:13:17 - INFO - __main__ - Step 42728: {'lr': 0.0004122530328608781, 'samples': 8203776, 'steps': 42727, 'loss/train': 1.6887344121932983}}}
+11/07/2021 03:13:19 - INFO - __main__ - Step 42732: {'lr': 0.0004122368832573967, 'samples': 8204544, 'steps': 42731, 'loss/train': 1.4255421161651611}}}
+11/07/2021 03:13:19 - INFO - __main__ - Step 42732: {'lr': 0.0004122368832573967, 'samples': 8204544, 'steps': 42731, 'loss/train': 1.4255421161651611}}}
+11/07/2021 03:13:22 - INFO - __main__ - Step 42739: {'lr': 0.00041220861863696886, 'samples': 8205888, 'steps': 42738, 'loss/train': 1.396811604499817}}}
+11/07/2021 03:13:24 - INFO - __main__ - Step 42743: {'lr': 0.00041219246581730435, 'samples': 8206656, 'steps': 42742, 'loss/train': 1.721859097480774}}}
+11/07/2021 03:13:27 - INFO - __main__ - Step 42748: {'lr': 0.00041217227314840535, 'samples': 8207616, 'steps': 42747, 'loss/train': 2.701878547668457}}}
+11/07/2021 03:13:29 - INFO - __main__ - Step 42752: {'lr': 0.00041215611769797344, 'samples': 8208384, 'steps': 42751, 'loss/train': 1.8799508810043335}}
+11/07/2021 03:13:29 - INFO - __main__ - Step 42752: {'lr': 0.00041215611769797344, 'samples': 8208384, 'steps': 42751, 'loss/train': 1.8799508810043335}}
+11/07/2021 03:13:32 - INFO - __main__ - Step 42759: {'lr': 0.00041212784284678345, 'samples': 8209728, 'steps': 42758, 'loss/train': 1.4945995807647705}}
+11/07/2021 03:13:35 - INFO - __main__ - Step 42764: {'lr': 0.00041210764433289936, 'samples': 8210688, 'steps': 42763, 'loss/train': 1.4414068460464478}}
+11/07/2021 03:13:35 - INFO - __main__ - Step 42764: {'lr': 0.00041210764433289936, 'samples': 8210688, 'steps': 42763, 'loss/train': 1.4414068460464478}}
+11/07/2021 03:13:39 - INFO - __main__ - Step 42772: {'lr': 0.0004120753229125329, 'samples': 8212224, 'steps': 42771, 'loss/train': 1.3817518949508667}}}
+11/07/2021 03:13:41 - INFO - __main__ - Step 42776: {'lr': 0.00041205916044960406, 'samples': 8212992, 'steps': 42775, 'loss/train': 3.485616683959961}}}
+11/07/2021 03:13:43 - INFO - __main__ - Step 42780: {'lr': 0.00041204299681833344, 'samples': 8213760, 'steps': 42779, 'loss/train': 1.4981358051300049}}
+11/07/2021 03:13:45 - INFO - __main__ - Step 42785: {'lr': 0.00041202279063644234, 'samples': 8214720, 'steps': 42784, 'loss/train': 1.2365634441375732}}
+11/07/2021 03:13:45 - INFO - __main__ - Step 42785: {'lr': 0.00041202279063644234, 'samples': 8214720, 'steps': 42784, 'loss/train': 1.2365634441375732}}
+11/07/2021 03:13:49 - INFO - __main__ - Step 42792: {'lr': 0.00041199449891563694, 'samples': 8216064, 'steps': 42791, 'loss/train': 1.2733299732208252}}
+11/07/2021 03:13:51 - INFO - __main__ - Step 42796: {'lr': 0.00041197833061216494, 'samples': 8216832, 'steps': 42795, 'loss/train': 1.3337584733963013}}
+11/07/2021 03:13:53 - INFO - __main__ - Step 42801: {'lr': 0.00041195811859067756, 'samples': 8217792, 'steps': 42800, 'loss/train': 1.5047647953033447}}
+11/07/2021 03:13:55 - INFO - __main__ - Step 42805: {'lr': 0.0004119419476599118, 'samples': 8218560, 'steps': 42804, 'loss/train': 1.4537402391433716}}}
+11/07/2021 03:13:57 - INFO - __main__ - Step 42809: {'lr': 0.00041192577556164924, 'samples': 8219328, 'steps': 42808, 'loss/train': 3.0425539016723633}}
+11/07/2021 03:13:59 - INFO - __main__ - Step 42813: {'lr': 0.0004119096022960067, 'samples': 8220096, 'steps': 42812, 'loss/train': 1.6381014585494995}}}
+11/07/2021 03:14:01 - INFO - __main__ - Step 42817: {'lr': 0.00041189342786310067, 'samples': 8220864, 'steps': 42816, 'loss/train': 1.1310538053512573}}
+11/07/2021 03:14:04 - INFO - __main__ - Step 42822: {'lr': 0.0004118732081806814, 'samples': 8221824, 'steps': 42821, 'loss/train': 1.7592384815216064}}}
+11/07/2021 03:14:06 - INFO - __main__ - Step 42826: {'lr': 0.0004118570311218589, 'samples': 8222592, 'steps': 42825, 'loss/train': 1.5050877332687378}}}
+11/07/2021 03:14:07 - INFO - __main__ - Step 42830: {'lr': 0.0004118408528961519, 'samples': 8223360, 'steps': 42829, 'loss/train': 1.5232681035995483}}}
+11/07/2021 03:14:09 - INFO - __main__ - Step 42834: {'lr': 0.0004118246735036769, 'samples': 8224128, 'steps': 42833, 'loss/train': 1.2316757440567017}}}
+11/07/2021 03:14:09 - INFO - __main__ - Step 42834: {'lr': 0.0004118246735036769, 'samples': 8224128, 'steps': 42833, 'loss/train': 1.2316757440567017}}}
+11/07/2021 03:14:11 - INFO - __main__ - Step 42839: {'lr': 0.0004118044476224937, 'samples': 8225088, 'steps': 42838, 'loss/train': 1.2652711868286133}}}
+11/07/2021 03:14:14 - INFO - __main__ - Step 42845: {'lr': 0.00041178017415917655, 'samples': 8226240, 'steps': 42844, 'loss/train': 1.3483153581619263}}
+11/07/2021 03:14:17 - INFO - __main__ - Step 42849: {'lr': 0.0004117639903923611, 'samples': 8227008, 'steps': 42848, 'loss/train': 0.9353717565536499}}}
+11/07/2021 03:14:19 - INFO - __main__ - Step 42854: {'lr': 0.0004117437590438674, 'samples': 8227968, 'steps': 42853, 'loss/train': 1.7855308055877686}}}
+11/07/2021 03:14:19 - INFO - __main__ - Step 42854: {'lr': 0.0004117437590438674, 'samples': 8227968, 'steps': 42853, 'loss/train': 1.7855308055877686}}}
+11/07/2021 03:14:23 - INFO - __main__ - Step 42860: {'lr': 0.00041171947902068006, 'samples': 8229120, 'steps': 42859, 'loss/train': 1.9934972524642944}}
+11/07/2021 03:14:25 - INFO - __main__ - Step 42865: {'lr': 0.000411699243664129, 'samples': 8230080, 'steps': 42864, 'loss/train': 0.8765882253646851}4}}
+11/07/2021 03:14:27 - INFO - __main__ - Step 42869: {'lr': 0.0004116830540674118, 'samples': 8230848, 'steps': 42868, 'loss/train': 1.5690141916275024}}}
+11/07/2021 03:14:29 - INFO - __main__ - Step 42873: {'lr': 0.0004116668633050644, 'samples': 8231616, 'steps': 42872, 'loss/train': 1.3518669605255127}}}
+11/07/2021 03:14:31 - INFO - __main__ - Step 42878: {'lr': 0.00041164662321314054, 'samples': 8232576, 'steps': 42877, 'loss/train': 1.2000056505203247}}
+11/07/2021 03:14:33 - INFO - __main__ - Step 42882: {'lr': 0.00041163042982855194, 'samples': 8233344, 'steps': 42881, 'loss/train': 1.416580080986023}}}
+11/07/2021 03:14:33 - INFO - __main__ - Step 42882: {'lr': 0.00041163042982855194, 'samples': 8233344, 'steps': 42881, 'loss/train': 1.416580080986023}}}
+11/07/2021 03:14:37 - INFO - __main__ - Step 42889: {'lr': 0.00041160208860170725, 'samples': 8234688, 'steps': 42888, 'loss/train': 1.395034670829773}}}
+11/07/2021 03:14:39 - INFO - __main__ - Step 42893: {'lr': 0.0004115858920129598, 'samples': 8235456, 'steps': 42892, 'loss/train': 1.9112871885299683}}}
+11/07/2021 03:14:42 - INFO - __main__ - Step 42899: {'lr': 0.00041156159494563183, 'samples': 8236608, 'steps': 42898, 'loss/train': 1.627911925315857}}}
+11/07/2021 03:14:42 - INFO - __main__ - Step 42899: {'lr': 0.00041156159494563183, 'samples': 8236608, 'steps': 42898, 'loss/train': 1.627911925315857}}}
+11/07/2021 03:14:45 - INFO - __main__ - Step 42906: {'lr': 0.00041153324505483933, 'samples': 8237952, 'steps': 42905, 'loss/train': 1.5426833629608154}}
+11/07/2021 03:14:47 - INFO - __main__ - Step 42910: {'lr': 0.0004115170435159469, 'samples': 8238720, 'steps': 42909, 'loss/train': 1.8392415046691895}}}
+11/07/2021 03:14:49 - INFO - __main__ - Step 42915: {'lr': 0.0004114967899548606, 'samples': 8239680, 'steps': 42914, 'loss/train': 1.2665598392486572}}}
+11/07/2021 03:14:51 - INFO - __main__ - Step 42919: {'lr': 0.00041148058579615733, 'samples': 8240448, 'steps': 42918, 'loss/train': 1.258515477180481}}}
+11/07/2021 03:14:53 - INFO - __main__ - Step 42923: {'lr': 0.00041146438047328347, 'samples': 8241216, 'steps': 42922, 'loss/train': 1.325085163116455}}}
+11/07/2021 03:14:55 - INFO - __main__ - Step 42927: {'lr': 0.000411448173986356, 'samples': 8241984, 'steps': 42926, 'loss/train': 1.5102177858352661}}}}
+11/07/2021 03:14:57 - INFO - __main__ - Step 42931: {'lr': 0.0004114319663354915, 'samples': 8242752, 'steps': 42930, 'loss/train': 1.8404631614685059}}}
+11/07/2021 03:14:59 - INFO - __main__ - Step 42936: {'lr': 0.00041141170513530267, 'samples': 8243712, 'steps': 42935, 'loss/train': 1.4220731258392334}}
+11/07/2021 03:14:59 - INFO - __main__ - Step 42936: {'lr': 0.00041141170513530267, 'samples': 8243712, 'steps': 42935, 'loss/train': 1.4220731258392334}}
+11/07/2021 03:15:02 - INFO - __main__ - Step 42942: {'lr': 0.0004113873892950186, 'samples': 8244864, 'steps': 42941, 'loss/train': 1.0686310529708862}}}
+11/07/2021 03:15:05 - INFO - __main__ - Step 42946: {'lr': 0.0004113711772804315, 'samples': 8245632, 'steps': 42945, 'loss/train': 1.1424510478973389}}}
+11/07/2021 03:15:07 - INFO - __main__ - Step 42951: {'lr': 0.0004113509106262058, 'samples': 8246592, 'steps': 42950, 'loss/train': 1.343586802482605}}}}
+11/07/2021 03:15:09 - INFO - __main__ - Step 42956: {'lr': 0.00041133064215442415, 'samples': 8247552, 'steps': 42955, 'loss/train': 2.494164228439331}}}
+11/07/2021 03:15:11 - INFO - __main__ - Step 42960: {'lr': 0.0004113144260685122, 'samples': 8248320, 'steps': 42959, 'loss/train': 1.2599166631698608}}}
+11/07/2021 03:15:11 - INFO - __main__ - Step 42960: {'lr': 0.0004113144260685122, 'samples': 8248320, 'steps': 42959, 'loss/train': 1.2599166631698608}}}
+11/07/2021 03:15:15 - INFO - __main__ - Step 42967: {'lr': 0.00041128604511983356, 'samples': 8249664, 'steps': 42966, 'loss/train': 2.0043632984161377}}
+11/07/2021 03:15:17 - INFO - __main__ - Step 42972: {'lr': 0.00041126577083340797, 'samples': 8250624, 'steps': 42971, 'loss/train': 1.1354724168777466}}
+11/07/2021 03:15:19 - INFO - __main__ - Step 42977: {'lr': 0.00041124549473038564, 'samples': 8251584, 'steps': 42976, 'loss/train': 1.7653063535690308}}
+11/07/2021 03:15:19 - INFO - __main__ - Step 42977: {'lr': 0.00041124549473038564, 'samples': 8251584, 'steps': 42976, 'loss/train': 1.7653063535690308}}
+11/07/2021 03:15:23 - INFO - __main__ - Step 42984: {'lr': 0.0004112171051347069, 'samples': 8252928, 'steps': 42983, 'loss/train': 1.8783169984817505}}}
+11/07/2021 03:15:25 - INFO - __main__ - Step 42988: {'lr': 0.00041120088091044183, 'samples': 8253696, 'steps': 42987, 'loss/train': 1.4893476963043213}}
+11/07/2021 03:15:27 - INFO - __main__ - Step 42993: {'lr': 0.00041118059899584503, 'samples': 8254656, 'steps': 42992, 'loss/train': 1.7796658277511597}}
+11/07/2021 03:15:29 - INFO - __main__ - Step 42997: {'lr': 0.00041116437215689785, 'samples': 8255424, 'steps': 42996, 'loss/train': 1.6728167533874512}}
+11/07/2021 03:15:31 - INFO - __main__ - Step 43001: {'lr': 0.00041114814415605977, 'samples': 8256192, 'steps': 43000, 'loss/train': 0.8801016807556152}}
+11/07/2021 03:15:33 - INFO - __main__ - Step 43005: {'lr': 0.00041113191499344784, 'samples': 8256960, 'steps': 43004, 'loss/train': 1.4178489446640015}}
+11/07/2021 03:15:35 - INFO - __main__ - Step 43009: {'lr': 0.000411115684669179, 'samples': 8257728, 'steps': 43008, 'loss/train': 1.5675806999206543}5}}
+11/07/2021 03:15:37 - INFO - __main__ - Step 43014: {'lr': 0.00041109539513044127, 'samples': 8258688, 'steps': 43013, 'loss/train': 1.3206629753112793}}
+11/07/2021 03:15:37 - INFO - __main__ - Step 43014: {'lr': 0.00041109539513044127, 'samples': 8258688, 'steps': 43013, 'loss/train': 1.3206629753112793}}
+11/07/2021 03:15:41 - INFO - __main__ - Step 43021: {'lr': 0.00041106698672760145, 'samples': 8260032, 'steps': 43020, 'loss/train': 1.1121315956115723}}
+11/07/2021 03:15:43 - INFO - __main__ - Step 43025: {'lr': 0.00041105075175787534, 'samples': 8260800, 'steps': 43024, 'loss/train': 1.5974022150039673}}
+11/07/2021 03:15:45 - INFO - __main__ - Step 43030: {'lr': 0.0004110304564129742, 'samples': 8261760, 'steps': 43029, 'loss/train': 1.4041417837142944}}}
+11/07/2021 03:15:45 - INFO - __main__ - Step 43030: {'lr': 0.0004110304564129742, 'samples': 8261760, 'steps': 43029, 'loss/train': 1.4041417837142944}}}
+11/07/2021 03:15:45 - INFO - __main__ - Step 43030: {'lr': 0.0004110304564129742, 'samples': 8261760, 'steps': 43029, 'loss/train': 1.4041417837142944}}}
+11/07/2021 03:15:51 - INFO - __main__ - Step 43041: {'lr': 0.000410985800269424, 'samples': 8263872, 'steps': 43040, 'loss/train': 1.612999439239502}4}}}
+11/07/2021 03:15:54 - INFO - __main__ - Step 43046: {'lr': 0.00041096549912070067, 'samples': 8264832, 'steps': 43045, 'loss/train': 1.7899335622787476}}
+11/07/2021 03:15:54 - INFO - __main__ - Step 43046: {'lr': 0.00041096549912070067, 'samples': 8264832, 'steps': 43045, 'loss/train': 1.7899335622787476}}
+11/07/2021 03:15:54 - INFO - __main__ - Step 43046: {'lr': 0.00041096549912070067, 'samples': 8264832, 'steps': 43045, 'loss/train': 1.7899335622787476}}
+11/07/2021 03:15:59 - INFO - __main__ - Step 43056: {'lr': 0.00041092489138384, 'samples': 8266752, 'steps': 43055, 'loss/train': 5.796188831329346}476}}
+11/07/2021 03:16:02 - INFO - __main__ - Step 43062: {'lr': 0.0004109005232611134, 'samples': 8267904, 'steps': 43061, 'loss/train': 1.4820033311843872}}}
+11/07/2021 03:16:04 - INFO - __main__ - Step 43066: {'lr': 0.00041088427639595206, 'samples': 8268672, 'steps': 43065, 'loss/train': 1.3141721487045288}}
+11/07/2021 03:16:06 - INFO - __main__ - Step 43070: {'lr': 0.00041086802837091916, 'samples': 8269440, 'steps': 43069, 'loss/train': 2.006185293197632}}}
+11/07/2021 03:16:06 - INFO - __main__ - Step 43070: {'lr': 0.00041086802837091916, 'samples': 8269440, 'steps': 43069, 'loss/train': 2.006185293197632}}}
+11/07/2021 03:16:09 - INFO - __main__ - Step 43077: {'lr': 0.000410839591536523, 'samples': 8270784, 'steps': 43076, 'loss/train': 1.5742981433868408}}}}
+11/07/2021 03:16:12 - INFO - __main__ - Step 43083: {'lr': 0.0004108152142806151, 'samples': 8271936, 'steps': 43082, 'loss/train': 1.5733226537704468}}}
+11/07/2021 03:16:14 - INFO - __main__ - Step 43087: {'lr': 0.00041079896132743506, 'samples': 8272704, 'steps': 43086, 'loss/train': 1.5374175310134888}}
+11/07/2021 03:16:16 - INFO - __main__ - Step 43091: {'lr': 0.0004107827072149984, 'samples': 8273472, 'steps': 43090, 'loss/train': 1.2737891674041748}}}
+11/07/2021 03:16:16 - INFO - __main__ - Step 43091: {'lr': 0.0004107827072149984, 'samples': 8273472, 'steps': 43090, 'loss/train': 1.2737891674041748}}}
+11/07/2021 03:16:19 - INFO - __main__ - Step 43098: {'lr': 0.00041075425972912595, 'samples': 8274816, 'steps': 43097, 'loss/train': 1.7125060558319092}}
+11/07/2021 03:16:21 - INFO - __main__ - Step 43103: {'lr': 0.00041073393792332157, 'samples': 8275776, 'steps': 43102, 'loss/train': 1.6294130086898804}}
+11/07/2021 03:16:24 - INFO - __main__ - Step 43108: {'lr': 0.00041071361430691143, 'samples': 8276736, 'steps': 43107, 'loss/train': 1.5375863313674927}}
+11/07/2021 03:16:26 - INFO - __main__ - Step 43112: {'lr': 0.00041069735411030105, 'samples': 8277504, 'steps': 43111, 'loss/train': 1.5038973093032837}}
+11/07/2021 03:16:26 - INFO - __main__ - Step 43112: {'lr': 0.00041069735411030105, 'samples': 8277504, 'steps': 43111, 'loss/train': 1.5038973093032837}}
+11/07/2021 03:16:29 - INFO - __main__ - Step 43119: {'lr': 0.000410668895978605, 'samples': 8278848, 'steps': 43118, 'loss/train': 1.167095422744751}37}}
+11/07/2021 03:16:31 - INFO - __main__ - Step 43124: {'lr': 0.0004106485665697948, 'samples': 8279808, 'steps': 43123, 'loss/train': 1.0472019910812378}}}
+11/07/2021 03:16:34 - INFO - __main__ - Step 43129: {'lr': 0.00041062823535134053, 'samples': 8280768, 'steps': 43128, 'loss/train': 1.6788736581802368}}
+11/07/2021 03:16:36 - INFO - __main__ - Step 43133: {'lr': 0.00041061196907378727, 'samples': 8281536, 'steps': 43132, 'loss/train': 0.20600904524326324}
+11/07/2021 03:16:36 - INFO - __main__ - Step 43133: {'lr': 0.00041061196907378727, 'samples': 8281536, 'steps': 43132, 'loss/train': 0.20600904524326324}
+11/07/2021 03:16:39 - INFO - __main__ - Step 43140: {'lr': 0.0004105835003019225, 'samples': 8282880, 'steps': 43139, 'loss/train': 1.4372590780258179}4}
+11/07/2021 03:16:42 - INFO - __main__ - Step 43145: {'lr': 0.00041056316329414613, 'samples': 8283840, 'steps': 43144, 'loss/train': 1.4259611368179321}}
+11/07/2021 03:16:44 - INFO - __main__ - Step 43150: {'lr': 0.00041054282447768763, 'samples': 8284800, 'steps': 43149, 'loss/train': 1.6200916767120361}}
+11/07/2021 03:16:46 - INFO - __main__ - Step 43154: {'lr': 0.00041052655212242377, 'samples': 8285568, 'steps': 43153, 'loss/train': 1.352491021156311}}}
+11/07/2021 03:16:46 - INFO - __main__ - Step 43154: {'lr': 0.00041052655212242377, 'samples': 8285568, 'steps': 43153, 'loss/train': 1.352491021156311}}}
+11/07/2021 03:16:49 - INFO - __main__ - Step 43160: {'lr': 0.000410502141419641, 'samples': 8286720, 'steps': 43159, 'loss/train': 1.2417993545532227}}}}
+11/07/2021 03:16:49 - INFO - __main__ - Step 43160: {'lr': 0.000410502141419641, 'samples': 8286720, 'steps': 43159, 'loss/train': 1.2417993545532227}}}}
+11/07/2021 03:16:54 - INFO - __main__ - Step 43169: {'lr': 0.0004104655204840048, 'samples': 8288448, 'steps': 43168, 'loss/train': 1.7086986303329468}}}
+11/07/2021 03:16:55 - INFO - __main__ - Step 43173: {'lr': 0.00041044924263264603, 'samples': 8289216, 'steps': 43172, 'loss/train': 1.5493334531784058}}
+11/07/2021 03:16:57 - INFO - __main__ - Step 43177: {'lr': 0.0004104329636245521, 'samples': 8289984, 'steps': 43176, 'loss/train': 0.77286696434021}58}}
+11/07/2021 03:17:00 - INFO - __main__ - Step 43182: {'lr': 0.00041041261323795437, 'samples': 8290944, 'steps': 43181, 'loss/train': 1.5282878875732422}}
+11/07/2021 03:17:02 - INFO - __main__ - Step 43186: {'lr': 0.00041039633162763523, 'samples': 8291712, 'steps': 43185, 'loss/train': 1.0623544454574585}}
+11/07/2021 03:17:04 - INFO - __main__ - Step 43190: {'lr': 0.0004103800488609622, 'samples': 8292480, 'steps': 43189, 'loss/train': 1.1504318714141846}}}
+11/07/2021 03:17:04 - INFO - __main__ - Step 43190: {'lr': 0.0004103800488609622, 'samples': 8292480, 'steps': 43189, 'loss/train': 1.1504318714141846}}}
+11/07/2021 03:17:07 - INFO - __main__ - Step 43197: {'lr': 0.00041035155123716127, 'samples': 8293824, 'steps': 43196, 'loss/train': 0.3642762005329132}}
+11/07/2021 03:17:10 - INFO - __main__ - Step 43203: {'lr': 0.0004103271218846254, 'samples': 8294976, 'steps': 43202, 'loss/train': 1.2290693521499634}}}
+11/07/2021 03:17:12 - INFO - __main__ - Step 43207: {'lr': 0.00041031083420475854, 'samples': 8295744, 'steps': 43206, 'loss/train': 1.379603624343872}}}
+11/07/2021 03:17:14 - INFO - __main__ - Step 43211: {'lr': 0.0004102945453691542, 'samples': 8296512, 'steps': 43210, 'loss/train': 1.2275004386901855}}}
+11/07/2021 03:17:16 - INFO - __main__ - Step 43215: {'lr': 0.00041027825537792993, 'samples': 8297280, 'steps': 43214, 'loss/train': 1.04563307762146}}}}
+11/07/2021 03:17:18 - INFO - __main__ - Step 43219: {'lr': 0.0004102619642312031, 'samples': 8298048, 'steps': 43218, 'loss/train': 1.255764365196228}}}}
+11/07/2021 03:17:18 - INFO - __main__ - Step 43219: {'lr': 0.0004102619642312031, 'samples': 8298048, 'steps': 43218, 'loss/train': 1.255764365196228}}}}
+11/07/2021 03:17:21 - INFO - __main__ - Step 43226: {'lr': 0.0004102334519443565, 'samples': 8299392, 'steps': 43225, 'loss/train': 0.4940943717956543}}}
+11/07/2021 03:17:24 - INFO - __main__ - Step 43230: {'lr': 0.00041021715762060336, 'samples': 8300160, 'steps': 43229, 'loss/train': 1.6046879291534424}}
+11/07/2021 03:17:26 - INFO - __main__ - Step 43234: {'lr': 0.0004102008621417881, 'samples': 8300928, 'steps': 43233, 'loss/train': 1.7774174213409424}}}
+11/07/2021 03:17:28 - INFO - __main__ - Step 43238: {'lr': 0.0004101845655080283, 'samples': 8301696, 'steps': 43237, 'loss/train': 1.5787715911865234}}}
+11/07/2021 03:17:29 - INFO - __main__ - Step 43242: {'lr': 0.0004101682677194414, 'samples': 8302464, 'steps': 43241, 'loss/train': 1.368617057800293}}}}
+11/07/2021 03:17:31 - INFO - __main__ - Step 43246: {'lr': 0.0004101519687761449, 'samples': 8303232, 'steps': 43245, 'loss/train': 1.2122910022735596}}}
+11/07/2021 03:17:34 - INFO - __main__ - Step 43250: {'lr': 0.00041013566867825627, 'samples': 8304000, 'steps': 43249, 'loss/train': 1.616087794303894}}}
+11/07/2021 03:17:36 - INFO - __main__ - Step 43254: {'lr': 0.0004101193674258931, 'samples': 8304768, 'steps': 43253, 'loss/train': 1.2787197828292847}}}
+11/07/2021 03:17:37 - INFO - __main__ - Step 43258: {'lr': 0.00041010306501917287, 'samples': 8305536, 'steps': 43257, 'loss/train': 1.4174599647521973}}
+11/07/2021 03:17:39 - INFO - __main__ - Step 43262: {'lr': 0.0004100867614582131, 'samples': 8306304, 'steps': 43261, 'loss/train': 1.5937113761901855}}}
+11/07/2021 03:17:42 - INFO - __main__ - Step 43267: {'lr': 0.0004100663803840431, 'samples': 8307264, 'steps': 43266, 'loss/train': 0.8777159452438354}}}
+11/07/2021 03:17:42 - INFO - __main__ - Step 43267: {'lr': 0.0004100663803840431, 'samples': 8307264, 'steps': 43266, 'loss/train': 0.8777159452438354}}}
+11/07/2021 03:17:46 - INFO - __main__ - Step 43274: {'lr': 0.0004100378438510721, 'samples': 8308608, 'steps': 43273, 'loss/train': 1.5262449979782104}}}
+11/07/2021 03:17:47 - INFO - __main__ - Step 43278: {'lr': 0.00041002153567432965, 'samples': 8309376, 'steps': 43277, 'loss/train': 1.4881389141082764}}
+11/07/2021 03:17:50 - INFO - __main__ - Step 43282: {'lr': 0.0004100052263439355, 'samples': 8310144, 'steps': 43281, 'loss/train': 1.6344153881072998}}}
+11/07/2021 03:17:52 - INFO - __main__ - Step 43286: {'lr': 0.00040998891586000716, 'samples': 8310912, 'steps': 43285, 'loss/train': 1.4235750436782837}}
+11/07/2021 03:17:54 - INFO - __main__ - Step 43290: {'lr': 0.00040997260422266223, 'samples': 8311680, 'steps': 43289, 'loss/train': 1.5309162139892578}}
+11/07/2021 03:17:55 - INFO - __main__ - Step 43294: {'lr': 0.0004099562914320183, 'samples': 8312448, 'steps': 43293, 'loss/train': 1.6182531118392944}}}
+11/07/2021 03:17:58 - INFO - __main__ - Step 43298: {'lr': 0.000409939977488193, 'samples': 8313216, 'steps': 43297, 'loss/train': 2.0168118476867676}}}}
+11/07/2021 03:18:01 - INFO - __main__ - Step 43303: {'lr': 0.0004099195834369292, 'samples': 8314176, 'steps': 43302, 'loss/train': 1.5457040071487427}}}
+11/07/2021 03:18:04 - INFO - __main__ - Step 43309: {'lr': 0.0004098951081975421, 'samples': 8315328, 'steps': 43308, 'loss/train': 1.566868782043457}}}}
+11/07/2021 03:18:06 - INFO - __main__ - Step 43313: {'lr': 0.00040987878993033417, 'samples': 8316096, 'steps': 43312, 'loss/train': 1.7013061046600342}}
+11/07/2021 03:18:07 - INFO - __main__ - Step 43317: {'lr': 0.0004098624705105036, 'samples': 8316864, 'steps': 43316, 'loss/train': 1.5735280513763428}}}
+11/07/2021 03:18:09 - INFO - __main__ - Step 43321: {'lr': 0.000409846149938168, 'samples': 8317632, 'steps': 43320, 'loss/train': 1.836496114730835}8}}}
+11/07/2021 03:18:12 - INFO - __main__ - Step 43326: {'lr': 0.0004098257476022176, 'samples': 8318592, 'steps': 43325, 'loss/train': 1.7156808376312256}}}
+11/07/2021 03:18:14 - INFO - __main__ - Step 43330: {'lr': 0.00040980942443717596, 'samples': 8319360, 'steps': 43329, 'loss/train': 1.0857611894607544}}
+11/07/2021 03:18:14 - INFO - __main__ - Step 43330: {'lr': 0.00040980942443717596, 'samples': 8319360, 'steps': 43329, 'loss/train': 1.0857611894607544}}
+11/07/2021 03:18:17 - INFO - __main__ - Step 43338: {'lr': 0.00040977677465084275, 'samples': 8320896, 'steps': 43337, 'loss/train': 1.318015217781067}}}
+11/07/2021 03:18:20 - INFO - __main__ - Step 43342: {'lr': 0.00040976044802978645, 'samples': 8321664, 'steps': 43341, 'loss/train': 1.496842622756958}}}
+11/07/2021 03:18:22 - INFO - __main__ - Step 43347: {'lr': 0.0004097400381338041, 'samples': 8322624, 'steps': 43346, 'loss/train': 1.7230134010314941}}}
+11/07/2021 03:18:24 - INFO - __main__ - Step 43352: {'lr': 0.0004097196264384118, 'samples': 8323584, 'steps': 43351, 'loss/train': 1.0327445268630981}}}
+11/07/2021 03:18:26 - INFO - __main__ - Step 43356: {'lr': 0.00040970329578667735, 'samples': 8324352, 'steps': 43355, 'loss/train': 1.532841444015503}}}
+11/07/2021 03:18:26 - INFO - __main__ - Step 43356: {'lr': 0.00040970329578667735, 'samples': 8324352, 'steps': 43355, 'loss/train': 1.532841444015503}}}
+11/07/2021 03:18:30 - INFO - __main__ - Step 43363: {'lr': 0.0004096747143757591, 'samples': 8325696, 'steps': 43362, 'loss/train': 0.833960771560669}}}}
+11/07/2021 03:18:32 - INFO - __main__ - Step 43368: {'lr': 0.00040965429692380034, 'samples': 8326656, 'steps': 43367, 'loss/train': 1.3145965337753296}}
+11/07/2021 03:18:34 - INFO - __main__ - Step 43372: {'lr': 0.00040963796166734257, 'samples': 8327424, 'steps': 43371, 'loss/train': 1.6246415376663208}}
+11/07/2021 03:18:36 - INFO - __main__ - Step 43376: {'lr': 0.00040962162525999833, 'samples': 8328192, 'steps': 43375, 'loss/train': 0.593380868434906}}}
+11/07/2021 03:18:38 - INFO - __main__ - Step 43380: {'lr': 0.00040960528770188554, 'samples': 8328960, 'steps': 43379, 'loss/train': 1.4032756090164185}}
+11/07/2021 03:18:40 - INFO - __main__ - Step 43384: {'lr': 0.00040958894899312183, 'samples': 8329728, 'steps': 43383, 'loss/train': 1.640594244003296}}}
+11/07/2021 03:18:42 - INFO - __main__ - Step 43389: {'lr': 0.00040956852398924383, 'samples': 8330688, 'steps': 43388, 'loss/train': 1.3369059562683105}}
+11/07/2021 03:18:44 - INFO - __main__ - Step 43393: {'lr': 0.0004095521826919463, 'samples': 8331456, 'steps': 43392, 'loss/train': 1.5825469493865967}}}
+11/07/2021 03:18:44 - INFO - __main__ - Step 43393: {'lr': 0.0004095521826919463, 'samples': 8331456, 'steps': 43392, 'loss/train': 1.5825469493865967}}}
+11/07/2021 03:18:47 - INFO - __main__ - Step 43400: {'lr': 0.0004095235826539141, 'samples': 8332800, 'steps': 43399, 'loss/train': 1.3647236824035645}}}
+11/07/2021 03:18:50 - INFO - __main__ - Step 43404: {'lr': 0.00040950723819366307, 'samples': 8333568, 'steps': 43403, 'loss/train': 1.461193323135376}}}
+11/07/2021 03:18:50 - INFO - __main__ - Step 43404: {'lr': 0.00040950723819366307, 'samples': 8333568, 'steps': 43403, 'loss/train': 1.461193323135376}}}
+11/07/2021 03:18:55 - INFO - __main__ - Step 43413: {'lr': 0.00040947045895379494, 'samples': 8335296, 'steps': 43412, 'loss/train': 1.4618539810180664}}
+11/07/2021 03:18:57 - INFO - __main__ - Step 43417: {'lr': 0.00040945411075665674, 'samples': 8336064, 'steps': 43416, 'loss/train': 1.0641642808914185}}
+11/07/2021 03:18:58 - INFO - __main__ - Step 43421: {'lr': 0.00040943776140995756, 'samples': 8336832, 'steps': 43420, 'loss/train': 1.336556077003479}}}
+11/07/2021 03:18:58 - INFO - __main__ - Step 43421: {'lr': 0.00040943776140995756, 'samples': 8336832, 'steps': 43420, 'loss/train': 1.336556077003479}}}
+11/07/2021 03:19:02 - INFO - __main__ - Step 43429: {'lr': 0.0004094050592683477, 'samples': 8338368, 'steps': 43428, 'loss/train': 1.762089729309082}}}}
+11/07/2021 03:19:04 - INFO - __main__ - Step 43433: {'lr': 0.00040938870647367275, 'samples': 8339136, 'steps': 43432, 'loss/train': 1.3768030405044556}}
+11/07/2021 03:19:06 - INFO - __main__ - Step 43437: {'lr': 0.00040937235252990834, 'samples': 8339904, 'steps': 43436, 'loss/train': 1.6887180805206299}}
+11/07/2021 03:19:08 - INFO - __main__ - Step 43441: {'lr': 0.00040935599743717243, 'samples': 8340672, 'steps': 43440, 'loss/train': 1.6567108631134033}}
+11/07/2021 03:19:10 - INFO - __main__ - Step 43446: {'lr': 0.0004093355519556908, 'samples': 8341632, 'steps': 43445, 'loss/train': 1.2826430797576904}}}
+11/07/2021 03:19:12 - INFO - __main__ - Step 43450: {'lr': 0.0004093191942782001, 'samples': 8342400, 'steps': 43449, 'loss/train': 1.4493123292922974}}}
+11/07/2021 03:19:14 - INFO - __main__ - Step 43454: {'lr': 0.0004093028354521209, 'samples': 8343168, 'steps': 43453, 'loss/train': 1.4804021120071411}}}
+11/07/2021 03:19:16 - INFO - __main__ - Step 43458: {'lr': 0.0004092864754775713, 'samples': 8343936, 'steps': 43457, 'loss/train': 1.1358518600463867}}}
+11/07/2021 03:19:18 - INFO - __main__ - Step 43462: {'lr': 0.00040927011435466933, 'samples': 8344704, 'steps': 43461, 'loss/train': 1.3408634662628174}}
+11/07/2021 03:19:18 - INFO - __main__ - Step 43462: {'lr': 0.00040927011435466933, 'samples': 8344704, 'steps': 43461, 'loss/train': 1.3408634662628174}}
+11/07/2021 03:19:22 - INFO - __main__ - Step 43470: {'lr': 0.00040923738866427986, 'samples': 8346240, 'steps': 43469, 'loss/train': 1.2424981594085693}}
+11/07/2021 03:19:24 - INFO - __main__ - Step 43474: {'lr': 0.0004092210240970282, 'samples': 8347008, 'steps': 43473, 'loss/train': 1.4208704233169556}}}
+11/07/2021 03:19:26 - INFO - __main__ - Step 43478: {'lr': 0.000409204658381896, 'samples': 8347776, 'steps': 43477, 'loss/train': 1.6098095178604126}}}}
+11/07/2021 03:19:28 - INFO - __main__ - Step 43483: {'lr': 0.0004091841996239535, 'samples': 8348736, 'steps': 43482, 'loss/train': 1.563791275024414}}}}
+11/07/2021 03:19:28 - INFO - __main__ - Step 43483: {'lr': 0.0004091841996239535, 'samples': 8348736, 'steps': 43482, 'loss/train': 1.563791275024414}}}}
+11/07/2021 03:19:32 - INFO - __main__ - Step 43490: {'lr': 0.0004091555543503959, 'samples': 8350080, 'steps': 43489, 'loss/train': 1.5925389528274536}}}
+11/07/2021 03:19:34 - INFO - __main__ - Step 43494: {'lr': 0.0004091391840449213, 'samples': 8350848, 'steps': 43493, 'loss/train': 1.5638720989227295}}}
+11/07/2021 03:19:36 - INFO - __main__ - Step 43499: {'lr': 0.0004091187195497146, 'samples': 8351808, 'steps': 43498, 'loss/train': 2.1405017375946045}}}
+11/07/2021 03:19:38 - INFO - __main__ - Step 43503: {'lr': 0.0004091023466630023, 'samples': 8352576, 'steps': 43502, 'loss/train': 1.8581750392913818}}}
+11/07/2021 03:19:40 - INFO - __main__ - Step 43507: {'lr': 0.00040908597262926484, 'samples': 8353344, 'steps': 43506, 'loss/train': 1.5585148334503174}}
+11/07/2021 03:19:42 - INFO - __main__ - Step 43511: {'lr': 0.0004090695974486206, 'samples': 8354112, 'steps': 43510, 'loss/train': 1.5004621744155884}}}
+11/07/2021 03:19:44 - INFO - __main__ - Step 43515: {'lr': 0.0004090532211211874, 'samples': 8354880, 'steps': 43514, 'loss/train': 1.1567301750183105}}}
+11/07/2021 03:19:46 - INFO - __main__ - Step 43520: {'lr': 0.0004090327490994038, 'samples': 8355840, 'steps': 43519, 'loss/train': 1.3841397762298584}}}
+11/07/2021 03:19:46 - INFO - __main__ - Step 43520: {'lr': 0.0004090327490994038, 'samples': 8355840, 'steps': 43519, 'loss/train': 1.3841397762298584}}}
+11/07/2021 03:19:51 - INFO - __main__ - Step 43528: {'lr': 0.0004089999901384456, 'samples': 8357376, 'steps': 43527, 'loss/train': 1.1758595705032349}}}
+11/07/2021 03:19:51 - INFO - __main__ - Step 43528: {'lr': 0.0004089999901384456, 'samples': 8357376, 'steps': 43527, 'loss/train': 1.1758595705032349}}}
+11/07/2021 03:19:54 - INFO - __main__ - Step 43535: {'lr': 0.00040897132228632035, 'samples': 8358720, 'steps': 43534, 'loss/train': 1.61453115940094}}}}
+11/07/2021 03:19:57 - INFO - __main__ - Step 43540: {'lr': 0.0004089508431001504, 'samples': 8359680, 'steps': 43539, 'loss/train': 1.860291600227356}}}}
+11/07/2021 03:19:57 - INFO - __main__ - Step 43540: {'lr': 0.0004089508431001504, 'samples': 8359680, 'steps': 43539, 'loss/train': 1.860291600227356}}}}
+11/07/2021 03:20:00 - INFO - __main__ - Step 43547: {'lr': 0.00040892216923149073, 'samples': 8361024, 'steps': 43546, 'loss/train': 1.7720543146133423}}
+11/07/2021 03:20:02 - INFO - __main__ - Step 43551: {'lr': 0.00040890578258827125, 'samples': 8361792, 'steps': 43550, 'loss/train': 1.712302327156067}}}
+11/07/2021 03:20:04 - INFO - __main__ - Step 43556: {'lr': 0.00040888529767324966, 'samples': 8362752, 'steps': 43555, 'loss/train': 1.569291114807129}}}
+11/07/2021 03:20:07 - INFO - __main__ - Step 43561: {'lr': 0.0004088648109684465, 'samples': 8363712, 'steps': 43560, 'loss/train': 1.0811123847961426}}}
+11/07/2021 03:20:07 - INFO - __main__ - Step 43561: {'lr': 0.0004088648109684465, 'samples': 8363712, 'steps': 43560, 'loss/train': 1.0811123847961426}}}
+11/07/2021 03:20:10 - INFO - __main__ - Step 43568: {'lr': 0.00040883612657532844, 'samples': 8365056, 'steps': 43567, 'loss/train': 0.7460005879402161}}
+11/07/2021 03:20:12 - INFO - __main__ - Step 43573: {'lr': 0.00040881563557599107, 'samples': 8366016, 'steps': 43572, 'loss/train': 1.221165418624878}}}
+11/07/2021 03:20:14 - INFO - __main__ - Step 43577: {'lr': 0.00040879924148843233, 'samples': 8366784, 'steps': 43576, 'loss/train': 1.5095930099487305}}
+11/07/2021 03:20:17 - INFO - __main__ - Step 43582: {'lr': 0.0004087787472690668, 'samples': 8367744, 'steps': 43581, 'loss/train': 1.1368916034698486}}}
+11/07/2021 03:20:19 - INFO - __main__ - Step 43586: {'lr': 0.00040876235060578476, 'samples': 8368512, 'steps': 43585, 'loss/train': 1.665792465209961}}}
+11/07/2021 03:20:19 - INFO - __main__ - Step 43586: {'lr': 0.00040876235060578476, 'samples': 8368512, 'steps': 43585, 'loss/train': 1.665792465209961}}}
+11/07/2021 03:20:22 - INFO - __main__ - Step 43593: {'lr': 0.0004087336536909815, 'samples': 8369856, 'steps': 43592, 'loss/train': 1.7234948873519897}}}
+11/07/2021 03:20:25 - INFO - __main__ - Step 43597: {'lr': 0.0004087172538804058, 'samples': 8370624, 'steps': 43596, 'loss/train': 1.3239374160766602}}}
+11/07/2021 03:20:27 - INFO - __main__ - Step 43601: {'lr': 0.00040870085292558147, 'samples': 8371392, 'steps': 43600, 'loss/train': 1.1627293825149536}}
+11/07/2021 03:20:29 - INFO - __main__ - Step 43605: {'lr': 0.00040868445082662655, 'samples': 8372160, 'steps': 43604, 'loss/train': 1.4655396938323975}}
+11/07/2021 03:20:30 - INFO - __main__ - Step 43609: {'lr': 0.0004086680475836594, 'samples': 8372928, 'steps': 43608, 'loss/train': 0.5646260976791382}}}
+11/07/2021 03:20:32 - INFO - __main__ - Step 43613: {'lr': 0.0004086516431967984, 'samples': 8373696, 'steps': 43612, 'loss/train': 1.6255570650100708}}}
+11/07/2021 03:20:35 - INFO - __main__ - Step 43619: {'lr': 0.0004086270344719642, 'samples': 8374848, 'steps': 43618, 'loss/train': 1.7593225240707397}}}
+11/07/2021 03:20:37 - INFO - __main__ - Step 43623: {'lr': 0.0004086106272258856, 'samples': 8375616, 'steps': 43622, 'loss/train': 0.8363951444625854}}}
+11/07/2021 03:20:37 - INFO - __main__ - Step 43623: {'lr': 0.0004086106272258856, 'samples': 8375616, 'steps': 43622, 'loss/train': 0.8363951444625854}}}
+11/07/2021 03:20:40 - INFO - __main__ - Step 43629: {'lr': 0.00040858601421277956, 'samples': 8376768, 'steps': 43628, 'loss/train': 1.0271927118301392}}
+11/07/2021 03:20:43 - INFO - __main__ - Step 43635: {'lr': 0.0004085613986272428, 'samples': 8377920, 'steps': 43634, 'loss/train': 5.793621063232422}2}}
+11/07/2021 03:20:43 - INFO - __main__ - Step 43635: {'lr': 0.0004085613986272428, 'samples': 8377920, 'steps': 43634, 'loss/train': 5.793621063232422}2}}
+11/07/2021 03:20:46 - INFO - __main__ - Step 43642: {'lr': 0.00040853267719338256, 'samples': 8379264, 'steps': 43641, 'loss/train': 1.3150479793548584}}
+11/07/2021 03:20:48 - INFO - __main__ - Step 43646: {'lr': 0.0004085162633739095, 'samples': 8380032, 'steps': 43645, 'loss/train': 1.760745882987976}4}}
+11/07/2021 03:20:51 - INFO - __main__ - Step 43651: {'lr': 0.0004084957444925198, 'samples': 8380992, 'steps': 43650, 'loss/train': 1.450783371925354}4}}
+11/07/2021 03:20:51 - INFO - __main__ - Step 43651: {'lr': 0.0004084957444925198, 'samples': 8380992, 'steps': 43650, 'loss/train': 1.450783371925354}4}}
+11/07/2021 03:20:54 - INFO - __main__ - Step 43657: {'lr': 0.0004084711194781533, 'samples': 8382144, 'steps': 43656, 'loss/train': 1.0405417680740356}}}
+11/07/2021 03:20:56 - INFO - __main__ - Step 43662: {'lr': 0.00040845059666920323, 'samples': 8383104, 'steps': 43661, 'loss/train': 1.7791005373001099}}
+11/07/2021 03:20:59 - INFO - __main__ - Step 43667: {'lr': 0.0004084300720753684, 'samples': 8384064, 'steps': 43666, 'loss/train': 1.6888883113861084}}}
+11/07/2021 03:21:01 - INFO - __main__ - Step 43671: {'lr': 0.0004084136511153388, 'samples': 8384832, 'steps': 43670, 'loss/train': 1.9210768938064575}}}
+11/07/2021 03:21:03 - INFO - __main__ - Step 43675: {'lr': 0.00040839722901324924, 'samples': 8385600, 'steps': 43674, 'loss/train': 0.7722538709640503}}
+11/07/2021 03:21:05 - INFO - __main__ - Step 43679: {'lr': 0.0004083808057692181, 'samples': 8386368, 'steps': 43678, 'loss/train': 1.5521893501281738}}}
+11/07/2021 03:21:06 - INFO - __main__ - Step 43683: {'lr': 0.00040836438138336384, 'samples': 8387136, 'steps': 43682, 'loss/train': 1.5819343328475952}}
+11/07/2021 03:21:08 - INFO - __main__ - Step 43687: {'lr': 0.0004083479558558048, 'samples': 8387904, 'steps': 43686, 'loss/train': 1.5194342136383057}}}
+11/07/2021 03:21:11 - INFO - __main__ - Step 43692: {'lr': 0.00040832742234101415, 'samples': 8388864, 'steps': 43691, 'loss/train': 1.4217921495437622}}
+11/07/2021 03:21:11 - INFO - __main__ - Step 43692: {'lr': 0.00040832742234101415, 'samples': 8388864, 'steps': 43691, 'loss/train': 1.4217921495437622}}
+11/07/2021 03:21:14 - INFO - __main__ - Step 43699: {'lr': 0.0004082986724240835, 'samples': 8390208, 'steps': 43698, 'loss/train': 1.9071747064590454}}}
+11/07/2021 03:21:16 - INFO - __main__ - Step 43703: {'lr': 0.0004082822423308897, 'samples': 8390976, 'steps': 43702, 'loss/train': 0.9039545059204102}}}
+11/07/2021 03:21:19 - INFO - __main__ - Step 43708: {'lr': 0.00040826170310972196, 'samples': 8391936, 'steps': 43707, 'loss/train': 1.3259520530700684}}
+11/07/2021 03:21:21 - INFO - __main__ - Step 43713: {'lr': 0.0004082411621057971, 'samples': 8392896, 'steps': 43712, 'loss/train': 1.6946877241134644}}}
+11/07/2021 03:21:23 - INFO - __main__ - Step 43717: {'lr': 0.0004082247280192276, 'samples': 8393664, 'steps': 43716, 'loss/train': 1.2968155145645142}}}
+11/07/2021 03:21:23 - INFO - __main__ - Step 43717: {'lr': 0.0004082247280192276, 'samples': 8393664, 'steps': 43716, 'loss/train': 1.2968155145645142}}}
+11/07/2021 03:21:26 - INFO - __main__ - Step 43724: {'lr': 0.00040819596562299793, 'samples': 8395008, 'steps': 43723, 'loss/train': 0.6590692400932312}}
+11/07/2021 03:21:26 - INFO - __main__ - Step 43724: {'lr': 0.00040819596562299793, 'samples': 8395008, 'steps': 43723, 'loss/train': 0.6590692400932312}}
+11/07/2021 03:21:30 - INFO - __main__ - Step 43731: {'lr': 0.00040816719973401586, 'samples': 8396352, 'steps': 43730, 'loss/train': 1.64004647731781}2}}
+11/07/2021 03:21:33 - INFO - __main__ - Step 43736: {'lr': 0.0004081466505323892, 'samples': 8397312, 'steps': 43735, 'loss/train': 0.5817473530769348}}}
+11/07/2021 03:21:35 - INFO - __main__ - Step 43740: {'lr': 0.0004081302098884249, 'samples': 8398080, 'steps': 43739, 'loss/train': 0.8534517288208008}}}
+11/07/2021 03:21:35 - INFO - __main__ - Step 43740: {'lr': 0.0004081302098884249, 'samples': 8398080, 'steps': 43739, 'loss/train': 0.8534517288208008}}}
+11/07/2021 03:21:38 - INFO - __main__ - Step 43747: {'lr': 0.00040810143601839377, 'samples': 8399424, 'steps': 43746, 'loss/train': 1.6005651950836182}}
+11/07/2021 03:21:41 - INFO - __main__ - Step 43752: {'lr': 0.00040808088111690677, 'samples': 8400384, 'steps': 43751, 'loss/train': 1.6774927377700806}}
+11/07/2021 03:21:43 - INFO - __main__ - Step 43757: {'lr': 0.00040806032443469967, 'samples': 8401344, 'steps': 43756, 'loss/train': 1.472224473953247}}}
+11/07/2021 03:21:45 - INFO - __main__ - Step 43761: {'lr': 0.0004080438778069711, 'samples': 8402112, 'steps': 43760, 'loss/train': 1.4132717847824097}}}
+11/07/2021 03:21:45 - INFO - __main__ - Step 43761: {'lr': 0.0004080438778069711, 'samples': 8402112, 'steps': 43760, 'loss/train': 1.4132717847824097}}}
+11/07/2021 03:21:49 - INFO - __main__ - Step 43768: {'lr': 0.0004080150934668503, 'samples': 8403456, 'steps': 43767, 'loss/train': 1.1555874347686768}}}
+11/07/2021 03:21:51 - INFO - __main__ - Step 43773: {'lr': 0.00040799453108789497, 'samples': 8404416, 'steps': 43772, 'loss/train': 1.7890753746032715}}
+11/07/2021 03:21:51 - INFO - __main__ - Step 43773: {'lr': 0.00040799453108789497, 'samples': 8404416, 'steps': 43772, 'loss/train': 1.7890753746032715}}
+11/07/2021 03:21:55 - INFO - __main__ - Step 43781: {'lr': 0.00040796162757978803, 'samples': 8405952, 'steps': 43780, 'loss/train': 2.036315679550171}}}
+11/07/2021 03:21:56 - INFO - __main__ - Step 43785: {'lr': 0.0004079451741174737, 'samples': 8406720, 'steps': 43784, 'loss/train': 1.5919462442398071}}}
+11/07/2021 03:21:59 - INFO - __main__ - Step 43789: {'lr': 0.00040792871951647657, 'samples': 8407488, 'steps': 43788, 'loss/train': 1.572245478630066}}}
+11/07/2021 03:21:59 - INFO - __main__ - Step 43789: {'lr': 0.00040792871951647657, 'samples': 8407488, 'steps': 43788, 'loss/train': 1.572245478630066}}}
+11/07/2021 03:22:02 - INFO - __main__ - Step 43795: {'lr': 0.0004079040354802109, 'samples': 8408640, 'steps': 43794, 'loss/train': 0.3329477906227112}}}
+11/07/2021 03:22:05 - INFO - __main__ - Step 43800: {'lr': 0.00040788346349337156, 'samples': 8409600, 'steps': 43799, 'loss/train': 1.3185638189315796}}
+11/07/2021 03:22:07 - INFO - __main__ - Step 43805: {'lr': 0.000407862889728036, 'samples': 8410560, 'steps': 43804, 'loss/train': 1.6155372858047485}6}}
+11/07/2021 03:22:07 - INFO - __main__ - Step 43805: {'lr': 0.000407862889728036, 'samples': 8410560, 'steps': 43804, 'loss/train': 1.6155372858047485}6}}
+11/07/2021 03:22:11 - INFO - __main__ - Step 43812: {'lr': 0.00040783408346913366, 'samples': 8411904, 'steps': 43811, 'loss/train': 1.1286613941192627}}
+11/07/2021 03:22:12 - INFO - __main__ - Step 43816: {'lr': 0.0004078176211851328, 'samples': 8412672, 'steps': 43815, 'loss/train': 1.089661717414856}7}}
+11/07/2021 03:22:15 - INFO - __main__ - Step 43821: {'lr': 0.0004077970417301665, 'samples': 8413632, 'steps': 43820, 'loss/train': 1.578310251235962}7}}
+11/07/2021 03:22:15 - INFO - __main__ - Step 43821: {'lr': 0.0004077970417301665, 'samples': 8413632, 'steps': 43820, 'loss/train': 1.578310251235962}7}}
+11/07/2021 03:22:19 - INFO - __main__ - Step 43829: {'lr': 0.00040776411090506944, 'samples': 8415168, 'steps': 43828, 'loss/train': 4.008372783660889}}}
+11/07/2021 03:22:19 - INFO - __main__ - Step 43829: {'lr': 0.00040776411090506944, 'samples': 8415168, 'steps': 43828, 'loss/train': 4.008372783660889}}}
+11/07/2021 03:22:22 - INFO - __main__ - Step 43836: {'lr': 0.00040773529270105816, 'samples': 8416512, 'steps': 43835, 'loss/train': 0.5030577182769775}}
+11/07/2021 03:22:25 - INFO - __main__ - Step 43841: {'lr': 0.0004077147061373918, 'samples': 8417472, 'steps': 43840, 'loss/train': 1.5139338970184326}}}
+11/07/2021 03:22:27 - INFO - __main__ - Step 43845: {'lr': 0.000407698235607299, 'samples': 8418240, 'steps': 43844, 'loss/train': 1.3933018445968628}}}}
+11/07/2021 03:22:29 - INFO - __main__ - Step 43849: {'lr': 0.0004076817639403038, 'samples': 8419008, 'steps': 43848, 'loss/train': 1.659220576286316}}}}
+11/07/2021 03:22:30 - INFO - __main__ - Step 43853: {'lr': 0.0004076652911365252, 'samples': 8419776, 'steps': 43852, 'loss/train': 1.7538639307022095}}}
+11/07/2021 03:22:33 - INFO - __main__ - Step 43857: {'lr': 0.00040764881719608184, 'samples': 8420544, 'steps': 43856, 'loss/train': 1.5082013607025146}}
+11/07/2021 03:22:35 - INFO - __main__ - Step 43862: {'lr': 0.0004076282231722737, 'samples': 8421504, 'steps': 43861, 'loss/train': 1.1427700519561768}}}
+11/07/2021 03:22:37 - INFO - __main__ - Step 43866: {'lr': 0.00040761174667476883, 'samples': 8422272, 'steps': 43865, 'loss/train': 1.4639588594436646}}
+11/07/2021 03:22:39 - INFO - __main__ - Step 43870: {'lr': 0.0004075952690409852, 'samples': 8423040, 'steps': 43869, 'loss/train': 1.6615227460861206}}}
+11/07/2021 03:22:39 - INFO - __main__ - Step 43870: {'lr': 0.0004075952690409852, 'samples': 8423040, 'steps': 43869, 'loss/train': 1.6615227460861206}}}
+11/07/2021 03:22:42 - INFO - __main__ - Step 43877: {'lr': 0.00040756643044805057, 'samples': 8424384, 'steps': 43876, 'loss/train': 2.9302780628204346}}
+11/07/2021 03:22:45 - INFO - __main__ - Step 43882: {'lr': 0.00040754582932315007, 'samples': 8425344, 'steps': 43881, 'loss/train': 2.1872682571411133}}
+11/07/2021 03:22:47 - INFO - __main__ - Step 43886: {'lr': 0.0004075293471454396, 'samples': 8426112, 'steps': 43885, 'loss/train': 1.765032172203064}3}}
+11/07/2021 03:22:49 - INFO - __main__ - Step 43890: {'lr': 0.00040751286383204437, 'samples': 8426880, 'steps': 43889, 'loss/train': 1.5433449745178223}}
+11/07/2021 03:22:50 - INFO - __main__ - Step 43894: {'lr': 0.00040749637938308336, 'samples': 8427648, 'steps': 43893, 'loss/train': 1.17872953414917}3}}
+11/07/2021 03:22:52 - INFO - __main__ - Step 43898: {'lr': 0.0004074798937986753, 'samples': 8428416, 'steps': 43897, 'loss/train': 1.738026738166809}3}}
+11/07/2021 03:22:52 - INFO - __main__ - Step 43898: {'lr': 0.0004074798937986753, 'samples': 8428416, 'steps': 43897, 'loss/train': 1.738026738166809}3}}
+11/07/2021 03:22:57 - INFO - __main__ - Step 43906: {'lr': 0.0004074469192239936, 'samples': 8429952, 'steps': 43905, 'loss/train': 1.4113155603408813}}}
+11/07/2021 03:22:58 - INFO - __main__ - Step 43910: {'lr': 0.0004074304302339576, 'samples': 8430720, 'steps': 43909, 'loss/train': 1.672196388244629}}}}
+11/07/2021 03:23:00 - INFO - __main__ - Step 43914: {'lr': 0.00040741394010895013, 'samples': 8431488, 'steps': 43913, 'loss/train': 1.4635186195373535}}
+11/07/2021 03:23:03 - INFO - __main__ - Step 43919: {'lr': 0.00040739332585681807, 'samples': 8432448, 'steps': 43918, 'loss/train': 1.896952509880066}}}
+11/07/2021 03:23:05 - INFO - __main__ - Step 43923: {'lr': 0.0004073768331785592, 'samples': 8433216, 'steps': 43922, 'loss/train': 1.7586002349853516}}}
+11/07/2021 03:23:05 - INFO - __main__ - Step 43923: {'lr': 0.0004073768331785592, 'samples': 8433216, 'steps': 43922, 'loss/train': 1.7586002349853516}}}
+11/07/2021 03:23:08 - INFO - __main__ - Step 43930: {'lr': 0.00040734796826158226, 'samples': 8434560, 'steps': 43929, 'loss/train': 1.6103554964065552}}
+11/07/2021 03:23:11 - INFO - __main__ - Step 43935: {'lr': 0.0004073273483367474, 'samples': 8435520, 'steps': 43934, 'loss/train': 0.11346945911645889}}
+11/07/2021 03:23:11 - INFO - __main__ - Step 43935: {'lr': 0.0004073273483367474, 'samples': 8435520, 'steps': 43934, 'loss/train': 0.11346945911645889}}
+11/07/2021 03:23:15 - INFO - __main__ - Step 43943: {'lr': 0.0004072943527708659, 'samples': 8437056, 'steps': 43942, 'loss/train': 1.10098397731781}89}}
+11/07/2021 03:23:17 - INFO - __main__ - Step 43947: {'lr': 0.00040727785328687995, 'samples': 8437824, 'steps': 43946, 'loss/train': 1.4861782789230347}}
+11/07/2021 03:23:19 - INFO - __main__ - Step 43951: {'lr': 0.0004072613526690223, 'samples': 8438592, 'steps': 43950, 'loss/train': 1.2344754934310913}}}
+11/07/2021 03:23:19 - INFO - __main__ - Step 43951: {'lr': 0.0004072613526690223, 'samples': 8438592, 'steps': 43950, 'loss/train': 1.2344754934310913}}}
+11/07/2021 03:23:23 - INFO - __main__ - Step 43959: {'lr': 0.00040722834803216834, 'samples': 8440128, 'steps': 43958, 'loss/train': 1.1566802263259888}}
+11/07/2021 03:23:24 - INFO - __main__ - Step 43963: {'lr': 0.00040721184401340977, 'samples': 8440896, 'steps': 43962, 'loss/train': 1.6888006925582886}}
+11/07/2021 03:23:27 - INFO - __main__ - Step 43967: {'lr': 0.0004071953388612555, 'samples': 8441664, 'steps': 43966, 'loss/train': 1.4906792640686035}}}
+11/07/2021 03:23:29 - INFO - __main__ - Step 43972: {'lr': 0.00040717470582740634, 'samples': 8442624, 'steps': 43971, 'loss/train': 1.7003074884414673}}
+11/07/2021 03:23:31 - INFO - __main__ - Step 43976: {'lr': 0.00040715819812554686, 'samples': 8443392, 'steps': 43975, 'loss/train': 1.956968069076538}}}
+11/07/2021 03:23:31 - INFO - __main__ - Step 43976: {'lr': 0.00040715819812554686, 'samples': 8443392, 'steps': 43975, 'loss/train': 1.956968069076538}}}
+11/07/2021 03:23:35 - INFO - __main__ - Step 43983: {'lr': 0.00040712930692106164, 'samples': 8444736, 'steps': 43982, 'loss/train': 1.5842952728271484}}
+11/07/2021 03:23:37 - INFO - __main__ - Step 43988: {'lr': 0.0004071086682223909, 'samples': 8445696, 'steps': 43987, 'loss/train': 1.1857975721359253}}}
+11/07/2021 03:23:39 - INFO - __main__ - Step 43993: {'lr': 0.00040708802775395165, 'samples': 8446656, 'steps': 43992, 'loss/train': 1.4375793933868408}}
+11/07/2021 03:23:39 - INFO - __main__ - Step 43993: {'lr': 0.00040708802775395165, 'samples': 8446656, 'steps': 43992, 'loss/train': 1.4375793933868408}}
+11/07/2021 03:23:43 - INFO - __main__ - Step 44000: {'lr': 0.0004070591281253682, 'samples': 8448000, 'steps': 43999, 'loss/train': 1.512953519821167}8}}
+11/07/2021 03:23:45 - INFO - __main__ - Step 44004: {'lr': 0.0004070426124949458, 'samples': 8448768, 'steps': 44003, 'loss/train': 1.6318305730819702}}}
+11/07/2021 03:23:47 - INFO - __main__ - Step 44009: {'lr': 0.0004070219663648098, 'samples': 8449728, 'steps': 44008, 'loss/train': 1.146945595741272}}}}
+11/07/2021 03:23:49 - INFO - __main__ - Step 44013: {'lr': 0.0004070054481871597, 'samples': 8450496, 'steps': 44012, 'loss/train': 1.3653974533081055}}}
+11/07/2021 03:23:49 - INFO - __main__ - Step 44013: {'lr': 0.0004070054481871597, 'samples': 8450496, 'steps': 44012, 'loss/train': 1.3653974533081055}}}
+11/07/2021 03:23:53 - INFO - __main__ - Step 44020: {'lr': 0.00040697653865269057, 'samples': 8451840, 'steps': 44019, 'loss/train': 0.4142761826515198}}
+11/07/2021 03:23:55 - INFO - __main__ - Step 44024: {'lr': 0.00040696001736258077, 'samples': 8452608, 'steps': 44023, 'loss/train': 1.4945148229599}98}}
+11/07/2021 03:23:57 - INFO - __main__ - Step 44029: {'lr': 0.0004069393641586728, 'samples': 8453568, 'steps': 44028, 'loss/train': 1.9058088064193726}}}
+11/07/2021 03:24:00 - INFO - __main__ - Step 44034: {'lr': 0.0004069187091869035, 'samples': 8454528, 'steps': 44033, 'loss/train': 1.5818285942077637}}}
+11/07/2021 03:24:00 - INFO - __main__ - Step 44034: {'lr': 0.0004069187091869035, 'samples': 8454528, 'steps': 44033, 'loss/train': 1.5818285942077637}}}
+11/07/2021 03:24:03 - INFO - __main__ - Step 44041: {'lr': 0.00040688978925686235, 'samples': 8455872, 'steps': 44040, 'loss/train': 1.8101271390914917}}
+11/07/2021 03:24:05 - INFO - __main__ - Step 44045: {'lr': 0.0004068732620272856, 'samples': 8456640, 'steps': 44044, 'loss/train': 1.4922720193862915}}}
+11/07/2021 03:24:07 - INFO - __main__ - Step 44050: {'lr': 0.00040685260139992343, 'samples': 8457600, 'steps': 44049, 'loss/train': 1.989881157875061}}}
+11/07/2021 03:24:10 - INFO - __main__ - Step 44055: {'lr': 0.00040683193900567727, 'samples': 8458560, 'steps': 44054, 'loss/train': 1.1132365465164185}}
+11/07/2021 03:24:12 - INFO - __main__ - Step 44059: {'lr': 0.0004068154078182802, 'samples': 8459328, 'steps': 44058, 'loss/train': 0.8346248269081116}}}
+11/07/2021 03:24:12 - INFO - __main__ - Step 44059: {'lr': 0.0004068154078182802, 'samples': 8459328, 'steps': 44058, 'loss/train': 0.8346248269081116}}}
+11/07/2021 03:24:15 - INFO - __main__ - Step 44066: {'lr': 0.00040678647552005087, 'samples': 8460672, 'steps': 44065, 'loss/train': 1.907792329788208}}}
+11/07/2021 03:24:17 - INFO - __main__ - Step 44071: {'lr': 0.00040676580747334, 'samples': 8461632, 'steps': 44070, 'loss/train': 1.042952537536621}08}}}
+11/07/2021 03:24:20 - INFO - __main__ - Step 44076: {'lr': 0.00040674513766072274, 'samples': 8462592, 'steps': 44075, 'loss/train': 0.9936408996582031}}
+11/07/2021 03:24:22 - INFO - __main__ - Step 44080: {'lr': 0.00040672860053933286, 'samples': 8463360, 'steps': 44079, 'loss/train': 1.5099854469299316}}
+11/07/2021 03:24:22 - INFO - __main__ - Step 44080: {'lr': 0.00040672860053933286, 'samples': 8463360, 'steps': 44079, 'loss/train': 1.5099854469299316}}
+11/07/2021 03:24:25 - INFO - __main__ - Step 44087: {'lr': 0.00040669965785812193, 'samples': 8464704, 'steps': 44086, 'loss/train': 1.5070987939834595}}
+11/07/2021 03:24:28 - INFO - __main__ - Step 44092: {'lr': 0.0004066789823961691, 'samples': 8465664, 'steps': 44091, 'loss/train': 1.5024408102035522}}}
+11/07/2021 03:24:30 - INFO - __main__ - Step 44096: {'lr': 0.00040666244075584736, 'samples': 8466432, 'steps': 44095, 'loss/train': 1.9180774688720703}}
+11/07/2021 03:24:30 - INFO - __main__ - Step 44096: {'lr': 0.00040666244075584736, 'samples': 8466432, 'steps': 44095, 'loss/train': 1.9180774688720703}}
+11/07/2021 03:24:33 - INFO - __main__ - Step 44102: {'lr': 0.00040663762617771163, 'samples': 8467584, 'steps': 44101, 'loss/train': 1.5183041095733643}}
+11/07/2021 03:24:36 - INFO - __main__ - Step 44108: {'lr': 0.00040661280905875, 'samples': 8468736, 'steps': 44107, 'loss/train': 1.2548373937606812}43}}
+11/07/2021 03:24:38 - INFO - __main__ - Step 44112: {'lr': 0.0004065962629014044, 'samples': 8469504, 'steps': 44111, 'loss/train': 1.4359891414642334}}}
+11/07/2021 03:24:38 - INFO - __main__ - Step 44112: {'lr': 0.0004065962629014044, 'samples': 8469504, 'steps': 44111, 'loss/train': 1.4359891414642334}}}
+11/07/2021 03:24:41 - INFO - __main__ - Step 44119: {'lr': 0.00040656730440956677, 'samples': 8470848, 'steps': 44118, 'loss/train': 1.3201446533203125}}
+11/07/2021 03:24:43 - INFO - __main__ - Step 44123: {'lr': 0.00040655075514787445, 'samples': 8471616, 'steps': 44122, 'loss/train': 1.3534348011016846}}
+11/07/2021 03:24:45 - INFO - __main__ - Step 44127: {'lr': 0.00040653420475755245, 'samples': 8472384, 'steps': 44126, 'loss/train': 1.3555549383163452}}
+11/07/2021 03:24:47 - INFO - __main__ - Step 44131: {'lr': 0.00040651765323872, 'samples': 8473152, 'steps': 44130, 'loss/train': 1.753224492073059}452}}
+11/07/2021 03:24:50 - INFO - __main__ - Step 44135: {'lr': 0.00040650110059149664, 'samples': 8473920, 'steps': 44134, 'loss/train': 1.9925587177276611}}
+11/07/2021 03:24:51 - INFO - __main__ - Step 44139: {'lr': 0.00040648454681600153, 'samples': 8474688, 'steps': 44138, 'loss/train': 1.4614596366882324}}
+11/07/2021 03:24:53 - INFO - __main__ - Step 44144: {'lr': 0.00040646385301018243, 'samples': 8475648, 'steps': 44143, 'loss/train': 1.7908116579055786}}
+11/07/2021 03:24:55 - INFO - __main__ - Step 44148: {'lr': 0.00040644729669651235, 'samples': 8476416, 'steps': 44147, 'loss/train': 1.154239535331726}}}
+11/07/2021 03:24:58 - INFO - __main__ - Step 44152: {'lr': 0.0004064307392549585, 'samples': 8477184, 'steps': 44151, 'loss/train': 1.6127792596817017}}}
+11/07/2021 03:25:00 - INFO - __main__ - Step 44156: {'lr': 0.00040641418068564024, 'samples': 8477952, 'steps': 44155, 'loss/train': 1.2231348752975464}}
+11/07/2021 03:25:01 - INFO - __main__ - Step 44160: {'lr': 0.00040639762098867684, 'samples': 8478720, 'steps': 44159, 'loss/train': 1.1427425146102905}}
+11/07/2021 03:25:03 - INFO - __main__ - Step 44164: {'lr': 0.00040638106016418785, 'samples': 8479488, 'steps': 44163, 'loss/train': 1.4833199977874756}}
+11/07/2021 03:25:06 - INFO - __main__ - Step 44169: {'lr': 0.00040636035754817545, 'samples': 8480448, 'steps': 44168, 'loss/train': 1.5258365869522095}}
+11/07/2021 03:25:08 - INFO - __main__ - Step 44173: {'lr': 0.0004063437941871903, 'samples': 8481216, 'steps': 44172, 'loss/train': 0.9237746000289917}}}
+11/07/2021 03:25:08 - INFO - __main__ - Step 44173: {'lr': 0.0004063437941871903, 'samples': 8481216, 'steps': 44172, 'loss/train': 0.9237746000289917}}}
+11/07/2021 03:25:11 - INFO - __main__ - Step 44180: {'lr': 0.000406314805593363, 'samples': 8482560, 'steps': 44179, 'loss/train': 1.4306188821792603}}}}
+11/07/2021 03:25:13 - INFO - __main__ - Step 44185: {'lr': 0.0004062940973418865, 'samples': 8483520, 'steps': 44184, 'loss/train': 1.467079758644104}}}}
+11/07/2021 03:25:16 - INFO - __main__ - Step 44190: {'lr': 0.0004062733873298172, 'samples': 8484480, 'steps': 44189, 'loss/train': 1.873066782951355}}}}
+11/07/2021 03:25:16 - INFO - __main__ - Step 44190: {'lr': 0.0004062733873298172, 'samples': 8484480, 'steps': 44189, 'loss/train': 1.873066782951355}}}}
+11/07/2021 03:25:20 - INFO - __main__ - Step 44197: {'lr': 0.0004062443903555687, 'samples': 8485824, 'steps': 44196, 'loss/train': 1.3376597166061401}}}
+11/07/2021 03:25:21 - INFO - __main__ - Step 44201: {'lr': 0.00040622781910712826, 'samples': 8486592, 'steps': 44200, 'loss/train': 1.1684272289276123}}
+11/07/2021 03:25:23 - INFO - __main__ - Step 44205: {'lr': 0.0004062112467323863, 'samples': 8487360, 'steps': 44204, 'loss/train': 1.7162210941314697}}}
+11/07/2021 03:25:23 - INFO - __main__ - Step 44205: {'lr': 0.0004062112467323863, 'samples': 8487360, 'steps': 44204, 'loss/train': 1.7162210941314697}}}
+11/07/2021 03:25:27 - INFO - __main__ - Step 44213: {'lr': 0.00040617809860447564, 'samples': 8488896, 'steps': 44212, 'loss/train': 0.8359420299530029}}
+11/07/2021 03:25:29 - INFO - __main__ - Step 44217: {'lr': 0.00040616152285154607, 'samples': 8489664, 'steps': 44216, 'loss/train': 1.7768678665161133}}
+11/07/2021 03:25:29 - INFO - __main__ - Step 44217: {'lr': 0.00040616152285154607, 'samples': 8489664, 'steps': 44216, 'loss/train': 1.7768678665161133}}
+11/07/2021 03:25:34 - INFO - __main__ - Step 44225: {'lr': 0.00040612836796833556, 'samples': 8491200, 'steps': 44224, 'loss/train': 1.9082430601119995}}
+11/07/2021 03:25:35 - INFO - __main__ - Step 44229: {'lr': 0.0004061117888382938, 'samples': 8491968, 'steps': 44228, 'loss/train': 1.5498803853988647}}}
+11/07/2021 03:25:37 - INFO - __main__ - Step 44233: {'lr': 0.00040609520858278704, 'samples': 8492736, 'steps': 44232, 'loss/train': 1.6199346780776978}}
+11/07/2021 03:25:40 - INFO - __main__ - Step 44238: {'lr': 0.00040607448168090044, 'samples': 8493696, 'steps': 44237, 'loss/train': 1.4443018436431885}}
+11/07/2021 03:25:42 - INFO - __main__ - Step 44242: {'lr': 0.00040605789889353445, 'samples': 8494464, 'steps': 44241, 'loss/train': 1.4835010766983032}}
+11/07/2021 03:25:43 - INFO - __main__ - Step 44246: {'lr': 0.00040604131498109193, 'samples': 8495232, 'steps': 44245, 'loss/train': 1.67646062374115}2}}
+11/07/2021 03:25:45 - INFO - __main__ - Step 44250: {'lr': 0.0004060247299436925, 'samples': 8496000, 'steps': 44249, 'loss/train': 2.00783371925354}}2}}
+11/07/2021 03:25:48 - INFO - __main__ - Step 44255: {'lr': 0.00040600399706515466, 'samples': 8496960, 'steps': 44254, 'loss/train': 1.435835599899292}}}
+11/07/2021 03:25:48 - INFO - __main__ - Step 44255: {'lr': 0.00040600399706515466, 'samples': 8496960, 'steps': 44254, 'loss/train': 1.435835599899292}}}
+11/07/2021 03:25:52 - INFO - __main__ - Step 44263: {'lr': 0.0004059708208043556, 'samples': 8498496, 'steps': 44262, 'loss/train': 2.3060762882232666}}}
+11/07/2021 03:25:54 - INFO - __main__ - Step 44267: {'lr': 0.00040595423098722315, 'samples': 8499264, 'steps': 44266, 'loss/train': 1.3291518688201904}}
+11/07/2021 03:25:55 - INFO - __main__ - Step 44271: {'lr': 0.00040593764004576166, 'samples': 8500032, 'steps': 44270, 'loss/train': 0.7102341651916504}}
+11/07/2021 03:25:58 - INFO - __main__ - Step 44275: {'lr': 0.00040592104798009066, 'samples': 8500800, 'steps': 44274, 'loss/train': 1.1963216066360474}}
+11/07/2021 03:25:58 - INFO - __main__ - Step 44275: {'lr': 0.00040592104798009066, 'samples': 8500800, 'steps': 44274, 'loss/train': 1.1963216066360474}}
+11/07/2021 03:26:01 - INFO - __main__ - Step 44282: {'lr': 0.00040589200916039703, 'samples': 8502144, 'steps': 44281, 'loss/train': 1.7258718013763428}}
+11/07/2021 03:26:04 - INFO - __main__ - Step 44287: {'lr': 0.00040587126503901664, 'samples': 8503104, 'steps': 44286, 'loss/train': 1.5036070346832275}}
+11/07/2021 03:26:04 - INFO - __main__ - Step 44287: {'lr': 0.00040587126503901664, 'samples': 8503104, 'steps': 44286, 'loss/train': 1.5036070346832275}}
+11/07/2021 03:26:08 - INFO - __main__ - Step 44295: {'lr': 0.0004058380707927798, 'samples': 8504640, 'steps': 44294, 'loss/train': 1.8551056385040283}}}
+11/07/2021 03:26:08 - INFO - __main__ - Step 44295: {'lr': 0.0004058380707927798, 'samples': 8504640, 'steps': 44294, 'loss/train': 1.8551056385040283}}}
+11/07/2021 03:26:11 - INFO - __main__ - Step 44302: {'lr': 0.0004058090221408326, 'samples': 8505984, 'steps': 44301, 'loss/train': 1.6845630407333374}}}
+11/07/2021 03:26:14 - INFO - __main__ - Step 44307: {'lr': 0.0004057882709975359, 'samples': 8506944, 'steps': 44306, 'loss/train': 1.6465903520584106}}}
+11/07/2021 03:26:14 - INFO - __main__ - Step 44307: {'lr': 0.0004057882709975359, 'samples': 8506944, 'steps': 44306, 'loss/train': 1.6465903520584106}}}
+11/07/2021 03:26:14 - INFO - __main__ - Step 44307: {'lr': 0.0004057882709975359, 'samples': 8506944, 'steps': 44306, 'loss/train': 1.6465903520584106}}}
+11/07/2021 03:26:20 - INFO - __main__ - Step 44318: {'lr': 0.00040574261230538267, 'samples': 8509056, 'steps': 44317, 'loss/train': 1.2443079948425293}}
+11/07/2021 03:26:22 - INFO - __main__ - Step 44323: {'lr': 0.0004057218555472456, 'samples': 8510016, 'steps': 44322, 'loss/train': 1.5574032068252563}}}
+11/07/2021 03:26:24 - INFO - __main__ - Step 44327: {'lr': 0.0004057052488777392, 'samples': 8510784, 'steps': 44326, 'loss/train': 1.6044999361038208}}}
+11/07/2021 03:26:24 - INFO - __main__ - Step 44327: {'lr': 0.0004057052488777392, 'samples': 8510784, 'steps': 44326, 'loss/train': 1.6044999361038208}}}
+11/07/2021 03:26:27 - INFO - __main__ - Step 44334: {'lr': 0.0004056761845050772, 'samples': 8512128, 'steps': 44333, 'loss/train': 0.6642376184463501}}}
+11/07/2021 03:26:30 - INFO - __main__ - Step 44339: {'lr': 0.000405655422134494, 'samples': 8513088, 'steps': 44338, 'loss/train': 2.3924691677093506}}}}
+11/07/2021 03:26:30 - INFO - __main__ - Step 44339: {'lr': 0.000405655422134494, 'samples': 8513088, 'steps': 44338, 'loss/train': 2.3924691677093506}}}}
+11/07/2021 03:26:30 - INFO - __main__ - Step 44339: {'lr': 0.000405655422134494, 'samples': 8513088, 'steps': 44338, 'loss/train': 2.3924691677093506}}}}
+11/07/2021 03:26:35 - INFO - __main__ - Step 44350: {'lr': 0.00040560973874757844, 'samples': 8515200, 'steps': 44349, 'loss/train': 1.7278624773025513}}
+11/07/2021 03:26:38 - INFO - __main__ - Step 44355: {'lr': 0.0004055889707669441, 'samples': 8516160, 'steps': 44354, 'loss/train': 1.867988109588623}3}}
+11/07/2021 03:26:40 - INFO - __main__ - Step 44360: {'lr': 0.0004055682010336601, 'samples': 8517120, 'steps': 44359, 'loss/train': 1.4113619327545166}}}
+11/07/2021 03:26:42 - INFO - __main__ - Step 44364: {'lr': 0.00040555158398528237, 'samples': 8517888, 'steps': 44363, 'loss/train': 1.5277279615402222}}
+11/07/2021 03:26:42 - INFO - __main__ - Step 44364: {'lr': 0.00040555158398528237, 'samples': 8517888, 'steps': 44363, 'loss/train': 1.5277279615402222}}
+11/07/2021 03:26:46 - INFO - __main__ - Step 44370: {'lr': 0.0004055266563100788, 'samples': 8519040, 'steps': 44369, 'loss/train': 1.9142252206802368}}}
+11/07/2021 03:26:46 - INFO - __main__ - Step 44370: {'lr': 0.0004055266563100788, 'samples': 8519040, 'steps': 44369, 'loss/train': 1.9142252206802368}}}
+11/07/2021 03:26:50 - INFO - __main__ - Step 44378: {'lr': 0.00040549341548551415, 'samples': 8520576, 'steps': 44377, 'loss/train': 1.8282917737960815}}
+11/07/2021 03:26:52 - INFO - __main__ - Step 44382: {'lr': 0.00040547679339166155, 'samples': 8521344, 'steps': 44381, 'loss/train': 1.7189534902572632}}
+11/07/2021 03:26:54 - INFO - __main__ - Step 44387: {'lr': 0.00040545601419811236, 'samples': 8522304, 'steps': 44386, 'loss/train': 1.71592378616333}2}}
+11/07/2021 03:26:54 - INFO - __main__ - Step 44387: {'lr': 0.00040545601419811236, 'samples': 8522304, 'steps': 44386, 'loss/train': 1.71592378616333}2}}
+11/07/2021 03:26:58 - INFO - __main__ - Step 44395: {'lr': 0.0004054227638461348, 'samples': 8523840, 'steps': 44394, 'loss/train': 1.1267532110214233}}}
+11/07/2021 03:26:58 - INFO - __main__ - Step 44395: {'lr': 0.0004054227638461348, 'samples': 8523840, 'steps': 44394, 'loss/train': 1.1267532110214233}}}
+11/07/2021 03:27:02 - INFO - __main__ - Step 44402: {'lr': 0.000405393666111489, 'samples': 8525184, 'steps': 44401, 'loss/train': 1.2938517332077026}}}}
+11/07/2021 03:27:04 - INFO - __main__ - Step 44407: {'lr': 0.00040537287991473627, 'samples': 8526144, 'steps': 44406, 'loss/train': 1.5492923259735107}}
+11/07/2021 03:27:04 - INFO - __main__ - Step 44407: {'lr': 0.00040537287991473627, 'samples': 8526144, 'steps': 44406, 'loss/train': 1.5492923259735107}}
+11/07/2021 03:27:08 - INFO - __main__ - Step 44415: {'lr': 0.000405339618359581, 'samples': 8527680, 'steps': 44414, 'loss/train': 0.21375149488449097}}}
+11/07/2021 03:27:10 - INFO - __main__ - Step 44419: {'lr': 0.0004053229859020962, 'samples': 8528448, 'steps': 44418, 'loss/train': 1.4786136150360107}}}
+11/07/2021 03:27:12 - INFO - __main__ - Step 44423: {'lr': 0.0004053063523248331, 'samples': 8529216, 'steps': 44422, 'loss/train': 1.6097091436386108}}}
+11/07/2021 03:27:14 - INFO - __main__ - Step 44427: {'lr': 0.00040528971762791177, 'samples': 8529984, 'steps': 44426, 'loss/train': 1.7034776210784912}}
+11/07/2021 03:27:17 - INFO - __main__ - Step 44431: {'lr': 0.000405273081811452, 'samples': 8530752, 'steps': 44430, 'loss/train': 1.1703969240188599}2}}
+11/07/2021 03:27:18 - INFO - __main__ - Step 44435: {'lr': 0.00040525644487557366, 'samples': 8531520, 'steps': 44434, 'loss/train': 1.7728455066680908}}
+11/07/2021 03:27:20 - INFO - __main__ - Step 44439: {'lr': 0.00040523980682039684, 'samples': 8532288, 'steps': 44438, 'loss/train': 1.6078511476516724}}
+11/07/2021 03:27:22 - INFO - __main__ - Step 44444: {'lr': 0.000405219007677595, 'samples': 8533248, 'steps': 44443, 'loss/train': 1.638048529624939}24}}
+11/07/2021 03:27:22 - INFO - __main__ - Step 44444: {'lr': 0.000405219007677595, 'samples': 8533248, 'steps': 44443, 'loss/train': 1.638048529624939}24}}
+11/07/2021 03:27:27 - INFO - __main__ - Step 44450: {'lr': 0.0004051940463982569, 'samples': 8534400, 'steps': 44449, 'loss/train': 1.2241114377975464}}}
+11/07/2021 03:27:29 - INFO - __main__ - Step 44454: {'lr': 0.0004051774041467789, 'samples': 8535168, 'steps': 44453, 'loss/train': 1.2485108375549316}}}
+11/07/2021 03:27:30 - INFO - __main__ - Step 44458: {'lr': 0.00040516076077657233, 'samples': 8535936, 'steps': 44457, 'loss/train': 1.619061827659607}}}
+11/07/2021 03:27:32 - INFO - __main__ - Step 44462: {'lr': 0.00040514411628775695, 'samples': 8536704, 'steps': 44461, 'loss/train': 1.083493709564209}}}
+11/07/2021 03:27:35 - INFO - __main__ - Step 44467: {'lr': 0.00040512330910387706, 'samples': 8537664, 'steps': 44466, 'loss/train': 2.71468186378479}}}}
+11/07/2021 03:27:35 - INFO - __main__ - Step 44467: {'lr': 0.00040512330910387706, 'samples': 8537664, 'steps': 44466, 'loss/train': 2.71468186378479}}}}
+11/07/2021 03:27:38 - INFO - __main__ - Step 44474: {'lr': 0.00040509417611085864, 'samples': 8539008, 'steps': 44473, 'loss/train': 1.0161057710647583}}
+11/07/2021 03:27:41 - INFO - __main__ - Step 44478: {'lr': 0.00040507752714880854, 'samples': 8539776, 'steps': 44477, 'loss/train': 1.3781660795211792}}
+11/07/2021 03:27:43 - INFO - __main__ - Step 44482: {'lr': 0.00040506087706874966, 'samples': 8540544, 'steps': 44481, 'loss/train': 1.220317006111145}}}
+11/07/2021 03:27:44 - INFO - __main__ - Step 44486: {'lr': 0.0004050442258708022, 'samples': 8541312, 'steps': 44485, 'loss/train': 0.9665480256080627}}}
+11/07/2021 03:27:46 - INFO - __main__ - Step 44490: {'lr': 0.00040502757355508626, 'samples': 8542080, 'steps': 44489, 'loss/train': 0.7407692670822144}}
+11/07/2021 03:27:49 - INFO - __main__ - Step 44495: {'lr': 0.0004050067565887621, 'samples': 8543040, 'steps': 44494, 'loss/train': 1.4558534622192383}}}
+11/07/2021 03:27:51 - INFO - __main__ - Step 44499: {'lr': 0.0004049901017585058, 'samples': 8543808, 'steps': 44498, 'loss/train': 1.58024263381958}3}}}
+11/07/2021 03:27:53 - INFO - __main__ - Step 44503: {'lr': 0.000404973445810871, 'samples': 8544576, 'steps': 44502, 'loss/train': 1.3407477140426636}}}}
+11/07/2021 03:27:53 - INFO - __main__ - Step 44503: {'lr': 0.000404973445810871, 'samples': 8544576, 'steps': 44502, 'loss/train': 1.3407477140426636}}}}
+11/07/2021 03:27:56 - INFO - __main__ - Step 44510: {'lr': 0.00040494429521417983, 'samples': 8545920, 'steps': 44509, 'loss/train': 1.0804678201675415}}
+11/07/2021 03:27:59 - INFO - __main__ - Step 44516: {'lr': 0.00040491930626561525, 'samples': 8547072, 'steps': 44515, 'loss/train': 1.423165202140808}}}
+11/07/2021 03:27:59 - INFO - __main__ - Step 44516: {'lr': 0.00040491930626561525, 'samples': 8547072, 'steps': 44515, 'loss/train': 1.423165202140808}}}
+11/07/2021 03:28:03 - INFO - __main__ - Step 44523: {'lr': 0.0004048901493162251, 'samples': 8548416, 'steps': 44522, 'loss/train': 1.0734343528747559}}}
+11/07/2021 03:28:04 - INFO - __main__ - Step 44527: {'lr': 0.0004048734866668421, 'samples': 8549184, 'steps': 44526, 'loss/train': 1.581064224243164}}}}
+11/07/2021 03:28:06 - INFO - __main__ - Step 44531: {'lr': 0.00040485682290092144, 'samples': 8549952, 'steps': 44530, 'loss/train': 1.5065734386444092}}
+11/07/2021 03:28:06 - INFO - __main__ - Step 44531: {'lr': 0.00040485682290092144, 'samples': 8549952, 'steps': 44530, 'loss/train': 1.5065734386444092}}
+11/07/2021 03:28:11 - INFO - __main__ - Step 44539: {'lr': 0.00040482349201994785, 'samples': 8551488, 'steps': 44538, 'loss/train': 1.1694883108139038}}
+11/07/2021 03:28:12 - INFO - __main__ - Step 44543: {'lr': 0.000404806824905135, 'samples': 8552256, 'steps': 44542, 'loss/train': 1.2956562042236328}8}}
+11/07/2021 03:28:14 - INFO - __main__ - Step 44547: {'lr': 0.00040479015667426523, 'samples': 8553024, 'steps': 44546, 'loss/train': 1.5965445041656494}}
+11/07/2021 03:28:17 - INFO - __main__ - Step 44552: {'lr': 0.0004047693198164058, 'samples': 8553984, 'steps': 44551, 'loss/train': 1.5908708572387695}}}
+11/07/2021 03:28:17 - INFO - __main__ - Step 44552: {'lr': 0.0004047693198164058, 'samples': 8553984, 'steps': 44551, 'loss/train': 1.5908708572387695}}}
+11/07/2021 03:28:20 - INFO - __main__ - Step 44559: {'lr': 0.00040474014528651514, 'samples': 8555328, 'steps': 44558, 'loss/train': 1.8229775428771973}}
+11/07/2021 03:28:23 - INFO - __main__ - Step 44564: {'lr': 0.00040471930424485, 'samples': 8556288, 'steps': 44563, 'loss/train': 0.8524765968322754}73}}
+11/07/2021 03:28:25 - INFO - __main__ - Step 44568: {'lr': 0.00040470263015665234, 'samples': 8557056, 'steps': 44567, 'loss/train': 1.0699820518493652}}
+11/07/2021 03:28:27 - INFO - __main__ - Step 44572: {'lr': 0.0004046859549531487, 'samples': 8557824, 'steps': 44571, 'loss/train': 1.3198877573013306}}}
+11/07/2021 03:28:27 - INFO - __main__ - Step 44572: {'lr': 0.0004046859549531487, 'samples': 8557824, 'steps': 44571, 'loss/train': 1.3198877573013306}}}
+11/07/2021 03:28:30 - INFO - __main__ - Step 44579: {'lr': 0.00040465677066367424, 'samples': 8559168, 'steps': 44578, 'loss/train': 1.6030867099761963}}
+11/07/2021 03:28:32 - INFO - __main__ - Step 44584: {'lr': 0.0004046359226520048, 'samples': 8560128, 'steps': 44583, 'loss/train': 1.42673921585083}63}}
+11/07/2021 03:28:35 - INFO - __main__ - Step 44589: {'lr': 0.0004046150728984214, 'samples': 8561088, 'steps': 44588, 'loss/train': 1.2639451026916504}}}
+11/07/2021 03:28:37 - INFO - __main__ - Step 44593: {'lr': 0.00040459839184153436, 'samples': 8561856, 'steps': 44592, 'loss/train': 1.6785650253295898}}
+11/07/2021 03:28:39 - INFO - __main__ - Step 44597: {'lr': 0.0004045817096700929, 'samples': 8562624, 'steps': 44596, 'loss/train': 1.7540621757507324}}}
+11/07/2021 03:28:40 - INFO - __main__ - Step 44601: {'lr': 0.0004045650263842174, 'samples': 8563392, 'steps': 44600, 'loss/train': 1.0853443145751953}}}
+11/07/2021 03:28:42 - INFO - __main__ - Step 44605: {'lr': 0.0004045483419840281, 'samples': 8564160, 'steps': 44604, 'loss/train': 1.49483060836792}3}}}
+11/07/2021 03:28:42 - INFO - __main__ - Step 44605: {'lr': 0.0004045483419840281, 'samples': 8564160, 'steps': 44604, 'loss/train': 1.49483060836792}3}}}
+11/07/2021 03:28:42 - INFO - __main__ - Step 44605: {'lr': 0.0004045483419840281, 'samples': 8564160, 'steps': 44604, 'loss/train': 1.49483060836792}3}}}
+11/07/2021 03:28:48 - INFO - __main__ - Step 44616: {'lr': 0.0004045024541388085, 'samples': 8566272, 'steps': 44615, 'loss/train': 1.4237236976623535}}}
+11/07/2021 03:28:51 - INFO - __main__ - Step 44621: {'lr': 0.0004044815932425379, 'samples': 8567232, 'steps': 44620, 'loss/train': 2.050100088119507}}}}
+11/07/2021 03:28:53 - INFO - __main__ - Step 44626: {'lr': 0.00040446073060609156, 'samples': 8568192, 'steps': 44625, 'loss/train': 1.1727397441864014}}
+11/07/2021 03:28:55 - INFO - __main__ - Step 44630: {'lr': 0.00040444403924416614, 'samples': 8568960, 'steps': 44629, 'loss/train': 1.1327166557312012}}
+11/07/2021 03:28:55 - INFO - __main__ - Step 44630: {'lr': 0.00040444403924416614, 'samples': 8568960, 'steps': 44629, 'loss/train': 1.1327166557312012}}
+11/07/2021 03:28:58 - INFO - __main__ - Step 44637: {'lr': 0.0004044148266816501, 'samples': 8570304, 'steps': 44636, 'loss/train': 1.6011314392089844}}}
+11/07/2021 03:29:00 - INFO - __main__ - Step 44641: {'lr': 0.00040439813225804977, 'samples': 8571072, 'steps': 44640, 'loss/train': 1.777889609336853}}}
+11/07/2021 03:29:03 - INFO - __main__ - Step 44646: {'lr': 0.00040437726266325164, 'samples': 8572032, 'steps': 44645, 'loss/train': 1.547196388244629}}}
+11/07/2021 03:29:05 - INFO - __main__ - Step 44651: {'lr': 0.00040435639132945314, 'samples': 8572992, 'steps': 44650, 'loss/train': 1.2456927299499512}}
+11/07/2021 03:29:07 - INFO - __main__ - Step 44655: {'lr': 0.0004043396930104922, 'samples': 8573760, 'steps': 44654, 'loss/train': 1.440232515335083}2}}
+11/07/2021 03:29:07 - INFO - __main__ - Step 44655: {'lr': 0.0004043396930104922, 'samples': 8573760, 'steps': 44654, 'loss/train': 1.440232515335083}2}}
+11/07/2021 03:29:10 - INFO - __main__ - Step 44662: {'lr': 0.00040431046827497415, 'samples': 8575104, 'steps': 44661, 'loss/train': 1.582525610923767}}}
+11/07/2021 03:29:13 - INFO - __main__ - Step 44667: {'lr': 0.00040428959137795475, 'samples': 8576064, 'steps': 44666, 'loss/train': 1.512468695640564}}}
+11/07/2021 03:29:15 - INFO - __main__ - Step 44672: {'lr': 0.00040426871274292257, 'samples': 8577024, 'steps': 44671, 'loss/train': 1.5917364358901978}}
+11/07/2021 03:29:15 - INFO - __main__ - Step 44672: {'lr': 0.00040426871274292257, 'samples': 8577024, 'steps': 44671, 'loss/train': 1.5917364358901978}}
+11/07/2021 03:29:18 - INFO - __main__ - Step 44679: {'lr': 0.00040423947973446404, 'samples': 8578368, 'steps': 44678, 'loss/train': 1.7626153230667114}}
+11/07/2021 03:29:21 - INFO - __main__ - Step 44683: {'lr': 0.00040422277362920614, 'samples': 8579136, 'steps': 44682, 'loss/train': 0.9555754661560059}}
+11/07/2021 03:29:23 - INFO - __main__ - Step 44688: {'lr': 0.00040420188943411385, 'samples': 8580096, 'steps': 44687, 'loss/train': 1.834280014038086}}}
+11/07/2021 03:29:25 - INFO - __main__ - Step 44692: {'lr': 0.00040418518082737087, 'samples': 8580864, 'steps': 44691, 'loss/train': 1.1153234243392944}}
+11/07/2021 03:29:27 - INFO - __main__ - Step 44696: {'lr': 0.00040416847110905243, 'samples': 8581632, 'steps': 44695, 'loss/train': 1.1403671503067017}}
+11/07/2021 03:29:29 - INFO - __main__ - Step 44700: {'lr': 0.00040415176027927915, 'samples': 8582400, 'steps': 44699, 'loss/train': 1.3662071228027344}}
+11/07/2021 03:29:29 - INFO - __main__ - Step 44700: {'lr': 0.00040415176027927915, 'samples': 8582400, 'steps': 44699, 'loss/train': 1.3662071228027344}}
+11/07/2021 03:29:33 - INFO - __main__ - Step 44706: {'lr': 0.00040412669195090466, 'samples': 8583552, 'steps': 44705, 'loss/train': 1.787896752357483}}}
+11/07/2021 03:29:35 - INFO - __main__ - Step 44711: {'lr': 0.0004041057997674464, 'samples': 8584512, 'steps': 44710, 'loss/train': 1.3378225564956665}}}
+11/07/2021 03:29:37 - INFO - __main__ - Step 44715: {'lr': 0.0004040890847707901, 'samples': 8585280, 'steps': 44714, 'loss/train': 1.6032570600509644}}}
+11/07/2021 03:29:39 - INFO - __main__ - Step 44719: {'lr': 0.0004040723686632512, 'samples': 8586048, 'steps': 44718, 'loss/train': 1.422973394393921}}}}
+11/07/2021 03:29:41 - INFO - __main__ - Step 44723: {'lr': 0.0004040556514449501, 'samples': 8586816, 'steps': 44722, 'loss/train': 1.0461225509643555}}}
+11/07/2021 03:29:43 - INFO - __main__ - Step 44727: {'lr': 0.0004040389331160075, 'samples': 8587584, 'steps': 44726, 'loss/train': 1.6357241868972778}}}
+11/07/2021 03:29:43 - INFO - __main__ - Step 44727: {'lr': 0.0004040389331160075, 'samples': 8587584, 'steps': 44726, 'loss/train': 1.6357241868972778}}}
+11/07/2021 03:29:47 - INFO - __main__ - Step 44735: {'lr': 0.0004040054931266795, 'samples': 8589120, 'steps': 44734, 'loss/train': 1.4642417430877686}}}
+11/07/2021 03:29:49 - INFO - __main__ - Step 44739: {'lr': 0.0004039887714665352, 'samples': 8589888, 'steps': 44738, 'loss/train': 1.4107799530029297}}}
+11/07/2021 03:29:51 - INFO - __main__ - Step 44743: {'lr': 0.0004039720486962316, 'samples': 8590656, 'steps': 44742, 'loss/train': 1.3014174699783325}}}
+11/07/2021 03:29:53 - INFO - __main__ - Step 44748: {'lr': 0.00040395114367237407, 'samples': 8591616, 'steps': 44747, 'loss/train': 1.1026297807693481}}
+11/07/2021 03:29:55 - INFO - __main__ - Step 44752: {'lr': 0.0004039344184046525, 'samples': 8592384, 'steps': 44751, 'loss/train': 1.4764256477355957}}}
+11/07/2021 03:29:57 - INFO - __main__ - Step 44756: {'lr': 0.00040391769202716333, 'samples': 8593152, 'steps': 44755, 'loss/train': 1.6105319261550903}}
+11/07/2021 03:29:59 - INFO - __main__ - Step 44760: {'lr': 0.0004039009645400272, 'samples': 8593920, 'steps': 44759, 'loss/train': 1.4869424104690552}}}
+11/07/2021 03:30:01 - INFO - __main__ - Step 44764: {'lr': 0.0004038842359433647, 'samples': 8594688, 'steps': 44763, 'loss/train': 1.3257486820220947}}}
+11/07/2021 03:30:03 - INFO - __main__ - Step 44769: {'lr': 0.00040386332363744884, 'samples': 8595648, 'steps': 44768, 'loss/train': 1.7680883407592773}}
+11/07/2021 03:30:05 - INFO - __main__ - Step 44773: {'lr': 0.0004038465925447929, 'samples': 8596416, 'steps': 44772, 'loss/train': 1.5884572267532349}}}
+11/07/2021 03:30:05 - INFO - __main__ - Step 44773: {'lr': 0.0004038465925447929, 'samples': 8596416, 'steps': 44772, 'loss/train': 1.5884572267532349}}}
+11/07/2021 03:30:09 - INFO - __main__ - Step 44780: {'lr': 0.00040381731046386295, 'samples': 8597760, 'steps': 44779, 'loss/train': 1.361086130142212}}}
+11/07/2021 03:30:11 - INFO - __main__ - Step 44785: {'lr': 0.0004037963926125011, 'samples': 8598720, 'steps': 44784, 'loss/train': 1.8758233785629272}}}
+11/07/2021 03:30:13 - INFO - __main__ - Step 44789: {'lr': 0.00040377965708403133, 'samples': 8599488, 'steps': 44788, 'loss/train': 1.6939905881881714}}
+11/07/2021 03:30:16 - INFO - __main__ - Step 44794: {'lr': 0.0004037587361144166, 'samples': 8600448, 'steps': 44793, 'loss/train': 1.1653132438659668}}}
+11/07/2021 03:30:18 - INFO - __main__ - Step 44798: {'lr': 0.0004037419980916499, 'samples': 8601216, 'steps': 44797, 'loss/train': 1.3725799322128296}}}
+11/07/2021 03:30:18 - INFO - __main__ - Step 44798: {'lr': 0.0004037419980916499, 'samples': 8601216, 'steps': 44797, 'loss/train': 1.3725799322128296}}}
+11/07/2021 03:30:21 - INFO - __main__ - Step 44805: {'lr': 0.0004037127038848404, 'samples': 8602560, 'steps': 44804, 'loss/train': 1.5042856931686401}}}
+11/07/2021 03:30:23 - INFO - __main__ - Step 44809: {'lr': 0.00040369596281431816, 'samples': 8603328, 'steps': 44808, 'loss/train': 1.1962133646011353}}
+11/07/2021 03:30:25 - INFO - __main__ - Step 44813: {'lr': 0.00040367922063574735, 'samples': 8604096, 'steps': 44812, 'loss/train': 1.7019158601760864}}
+11/07/2021 03:30:25 - INFO - __main__ - Step 44813: {'lr': 0.00040367922063574735, 'samples': 8604096, 'steps': 44812, 'loss/train': 1.7019158601760864}}
+11/07/2021 03:30:28 - INFO - __main__ - Step 44820: {'lr': 0.0004036499191573699, 'samples': 8605440, 'steps': 44819, 'loss/train': 2.1798417568206787}}}
+11/07/2021 03:30:31 - INFO - __main__ - Step 44825: {'lr': 0.00040362898745295117, 'samples': 8606400, 'steps': 44824, 'loss/train': 1.492126703262329}}}
+11/07/2021 03:30:33 - INFO - __main__ - Step 44830: {'lr': 0.00040360805401796124, 'samples': 8607360, 'steps': 44829, 'loss/train': 1.6936755180358887}}
+11/07/2021 03:30:35 - INFO - __main__ - Step 44834: {'lr': 0.00040359130602411644, 'samples': 8608128, 'steps': 44833, 'loss/train': 1.508933186531067}}}
+11/07/2021 03:30:37 - INFO - __main__ - Step 44838: {'lr': 0.00040357455692297765, 'samples': 8608896, 'steps': 44837, 'loss/train': 1.5283297300338745}}
+11/07/2021 03:30:39 - INFO - __main__ - Step 44842: {'lr': 0.0004035578067146657, 'samples': 8609664, 'steps': 44841, 'loss/train': 0.952649712562561}5}}
+11/07/2021 03:30:41 - INFO - __main__ - Step 44846: {'lr': 0.0004035410553993012, 'samples': 8610432, 'steps': 44845, 'loss/train': 1.8207674026489258}}}
+11/07/2021 03:30:43 - INFO - __main__ - Step 44851: {'lr': 0.00040352011469848713, 'samples': 8611392, 'steps': 44850, 'loss/train': 0.7737088203430176}}
+11/07/2021 03:30:45 - INFO - __main__ - Step 44855: {'lr': 0.0004035033608926963, 'samples': 8612160, 'steps': 44854, 'loss/train': 1.4348763227462769}}}
+11/07/2021 03:30:45 - INFO - __main__ - Step 44855: {'lr': 0.0004035033608926963, 'samples': 8612160, 'steps': 44854, 'loss/train': 1.4348763227462769}}}
+11/07/2021 03:30:49 - INFO - __main__ - Step 44862: {'lr': 0.00040347403906973445, 'samples': 8613504, 'steps': 44861, 'loss/train': 1.2716156244277954}}
+11/07/2021 03:30:51 - INFO - __main__ - Step 44867: {'lr': 0.00040345309283584726, 'samples': 8614464, 'steps': 44866, 'loss/train': 1.4803099632263184}}
+11/07/2021 03:30:53 - INFO - __main__ - Step 44872: {'lr': 0.0004034321448733701, 'samples': 8615424, 'steps': 44871, 'loss/train': 1.5915842056274414}}}
+11/07/2021 03:30:55 - INFO - __main__ - Step 44876: {'lr': 0.00040341538525896233, 'samples': 8616192, 'steps': 44875, 'loss/train': 1.4717856645584106}}
+11/07/2021 03:30:58 - INFO - __main__ - Step 44880: {'lr': 0.0004033986245385288, 'samples': 8616960, 'steps': 44879, 'loss/train': 1.655372977256775}6}}
+11/07/2021 03:30:58 - INFO - __main__ - Step 44880: {'lr': 0.0004033986245385288, 'samples': 8616960, 'steps': 44879, 'loss/train': 1.655372977256775}6}}
+11/07/2021 03:31:01 - INFO - __main__ - Step 44887: {'lr': 0.00040336929061675933, 'samples': 8618304, 'steps': 44886, 'loss/train': 1.292196273803711}}}
+11/07/2021 03:31:03 - INFO - __main__ - Step 44892: {'lr': 0.0004033483357422825, 'samples': 8619264, 'steps': 44891, 'loss/train': 1.8648028373718262}}}
+11/07/2021 03:31:06 - INFO - __main__ - Step 44897: {'lr': 0.0004033273791403959, 'samples': 8620224, 'steps': 44896, 'loss/train': 1.4491678476333618}}}
+11/07/2021 03:31:06 - INFO - __main__ - Step 44897: {'lr': 0.0004033273791403959, 'samples': 8620224, 'steps': 44896, 'loss/train': 1.4491678476333618}}}
+11/07/2021 03:31:09 - INFO - __main__ - Step 44904: {'lr': 0.0004032980369961555, 'samples': 8621568, 'steps': 44903, 'loss/train': 1.1294523477554321}}}
+11/07/2021 03:31:11 - INFO - __main__ - Step 44908: {'lr': 0.00040328126853692606, 'samples': 8622336, 'steps': 44907, 'loss/train': 1.154900312423706}}}
+11/07/2021 03:31:13 - INFO - __main__ - Step 44913: {'lr': 0.0004032603064089144, 'samples': 8623296, 'steps': 44912, 'loss/train': 0.12013912200927734}}
+11/07/2021 03:31:15 - INFO - __main__ - Step 44917: {'lr': 0.0004032435354634726, 'samples': 8624064, 'steps': 44916, 'loss/train': 1.2690373659133911}}}
+11/07/2021 03:31:17 - INFO - __main__ - Step 44921: {'lr': 0.00040322676341324415, 'samples': 8624832, 'steps': 44920, 'loss/train': 1.3669313192367554}}
+11/07/2021 03:31:19 - INFO - __main__ - Step 44925: {'lr': 0.00040320999025834973, 'samples': 8625600, 'steps': 44924, 'loss/train': 1.509555459022522}}}
+11/07/2021 03:31:21 - INFO - __main__ - Step 44929: {'lr': 0.0004031932159989105, 'samples': 8626368, 'steps': 44928, 'loss/train': 1.417038917541504}}}}
+11/07/2021 03:31:23 - INFO - __main__ - Step 44934: {'lr': 0.0004031722466215293, 'samples': 8627328, 'steps': 44933, 'loss/train': 1.464234709739685}}}}
+11/07/2021 03:31:26 - INFO - __main__ - Step 44938: {'lr': 0.0004031554698773061, 'samples': 8628096, 'steps': 44937, 'loss/train': 1.67475426197052}}}}}
+11/07/2021 03:31:26 - INFO - __main__ - Step 44938: {'lr': 0.0004031554698773061, 'samples': 8628096, 'steps': 44937, 'loss/train': 1.67475426197052}}}}}
+11/07/2021 03:31:29 - INFO - __main__ - Step 44945: {'lr': 0.00040312610791812286, 'samples': 8629440, 'steps': 44944, 'loss/train': 1.2826176881790161}}
+11/07/2021 03:31:31 - INFO - __main__ - Step 44949: {'lr': 0.00040310932813777316, 'samples': 8630208, 'steps': 44948, 'loss/train': 1.1987284421920776}}
+11/07/2021 03:31:34 - INFO - __main__ - Step 44954: {'lr': 0.0004030883518601044, 'samples': 8631168, 'steps': 44953, 'loss/train': 1.1118228435516357}}}
+11/07/2021 03:31:36 - INFO - __main__ - Step 44959: {'lr': 0.00040306737385795437, 'samples': 8632128, 'steps': 44958, 'loss/train': 1.431859016418457}}}
+11/07/2021 03:31:38 - INFO - __main__ - Step 44963: {'lr': 0.0004030505902147668, 'samples': 8632896, 'steps': 44962, 'loss/train': 1.8923532962799072}}}
+11/07/2021 03:31:38 - INFO - __main__ - Step 44963: {'lr': 0.0004030505902147668, 'samples': 8632896, 'steps': 44962, 'loss/train': 1.8923532962799072}}}
+11/07/2021 03:31:41 - INFO - __main__ - Step 44970: {'lr': 0.00040302121618421505, 'samples': 8634240, 'steps': 44969, 'loss/train': 1.7225620746612549}}
+11/07/2021 03:31:43 - INFO - __main__ - Step 44974: {'lr': 0.0004030044295069803, 'samples': 8635008, 'steps': 44973, 'loss/train': 1.1578707695007324}}}
+11/07/2021 03:31:46 - INFO - __main__ - Step 44979: {'lr': 0.00040298344460926866, 'samples': 8635968, 'steps': 44978, 'loss/train': 1.4797956943511963}}
+11/07/2021 03:31:48 - INFO - __main__ - Step 44984: {'lr': 0.0004029624579882576, 'samples': 8636928, 'steps': 44983, 'loss/train': 2.202698230743408}3}}
+11/07/2021 03:31:48 - INFO - __main__ - Step 44984: {'lr': 0.0004029624579882576, 'samples': 8636928, 'steps': 44983, 'loss/train': 2.202698230743408}3}}
+11/07/2021 03:31:51 - INFO - __main__ - Step 44991: {'lr': 0.000402933073824149, 'samples': 8638272, 'steps': 44990, 'loss/train': 0.9720051288604736}3}}
+11/07/2021 03:31:53 - INFO - __main__ - Step 44995: {'lr': 0.00040291628135718404, 'samples': 8639040, 'steps': 44994, 'loss/train': 1.681424617767334}}}
+11/07/2021 03:31:56 - INFO - __main__ - Step 45000: {'lr': 0.00040289528922320334, 'samples': 8640000, 'steps': 44999, 'loss/train': 0.798037052154541}}}
+11/07/2021 03:31:56 - INFO - __main__ - Step 45000: {'lr': 0.00040289528922320334, 'samples': 8640000, 'steps': 44999, 'loss/train': 0.798037052154541}}}
+11/07/2021 03:31:56 - INFO - __main__ - Step 45000: {'lr': 0.00040289528922320334, 'samples': 8640000, 'steps': 44999, 'loss/train': 0.798037052154541}}}
+11/07/2021 03:31:56 - INFO - __main__ - Step 45000: {'lr': 0.00040289528922320334, 'samples': 8640000, 'steps': 44999, 'loss/train': 0.798037052154541}}}
+11/07/2021 03:31:56 - INFO - __main__ - Step 45000: {'lr': 0.00040289528922320334, 'samples': 8640000, 'steps': 44999, 'loss/train': 0.798037052154541}}}
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+11/07/2021 03:31:56 - INFO - __main__ - Step 45000: {'lr': 0.00040289528922320334, 'samples': 8640000, 'steps': 44999, 'loss/train': 0.798037052154541}}}
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible
+	- Explicitly set the environment variable TOKENIZERS_PARALLELISM=(true | false)
+huggingface/tokenizers: The current process just got forked, after parallelism has already been used. Disabling parallelism to avoid deadlocks...
+To disable this warning, you can either:
+	- Avoid using `tokenizers` before the fork if possible