question: When doing `fit()`, `self.training` in `forward()` keeps turning into False?
context: Hi all, I tried to train a model with pl. And I just ran the trainer.fit() as below:
  trainer.fit(model, train_dataloaders=model.train_dataloader(),
                  val_dataloaders=model.val_dataloader())
  And I found that model.training == False, when it gets into forward()...
  Is there any solution or does anybody know the potential reason for this?
  Or does anyone know where can I find the source code for training_step() so that I can check and debug forward() in fit()?
  Thank you very much.
answer: does it print self.training = False for all the training steps? maybe you might have checked it during the initial steps where val sanity check happens.