Use only one of the optimizers as warm-up 
What is your question?
Hi! I am trying to train a GAN and I would like to train only the Discriminator for the first x steps, how can that be done?
I've seen the code for step optimizers at arbitrary intervals but it is not clear to me how it works (it says update generator every 2 steps and discriminator every 4, but then do they cumulate the gradients until they update or what happens in the odd steps? Why are they cumulating gradients then?) so I ended up using the frequency in the dictionary returned in the configure_optimizers functions which gives the behaviour I wanted of train x times optimizer A, train Y times optimizer B. Now I am looking to do for the first S steps only train optimizer A, then train x times A, train Y times B.
What's your environment?

OS: Win
Packaging: conda
Version: 0.7.6rc2