py-pytorch-gradual-warmup-lr (spack): Gradually warm-up (increasing) learning rate for pytorch's optimizer. 
Keywords: deep-learning|large-scale-learning|learning-rate-decay|multigpu|multinode|pytorch|pytorch-extension