final model

log/debug_0.log

@@ -50602,3 +50602,10 @@ Use FP16 precision: False
 02/26/2022 18:19:44 - INFO - codeparrot_training - Step 49998: {'lr': 2.1418412321505543e-12, 'samples': 25599488, 'steps': 49998, 'loss/train': 2.184359073638916}
 02/26/2022 18:19:49 - INFO - codeparrot_training - Step 49999: {'lr': 5.354603149765325e-13, 'samples': 25600000, 'steps': 49999, 'loss/train': 2.408355236053467}
 02/26/2022 18:19:49 - INFO - codeparrot_training - Evaluating and saving model checkpoint
+02/26/2022 18:20:07 - WARNING - huggingface_hub.repository - Several commits (50) will be pushed upstream.
+02/26/2022 18:20:07 - WARNING - huggingface_hub.repository - The progress bars may be unreliable.
+02/26/2022 18:20:52 - WARNING - huggingface_hub.repository - To https://huggingface.co/ncoop57/multi-code-clippy
+   508ef45..5aaf99c  floral-grass-11 -> floral-grass-11
+
+02/26/2022 18:20:53 - INFO - codeparrot_training - Evaluating and saving model after training
+02/26/2022 18:41:48 - INFO - codeparrot_training - Step 1600000: {'loss/eval': 1.6735893487930298, 'perplexity': 5.331269264221191}