When doing `fit()`, `self.training` in `forward()` keeps turning into False?
Hi all, I tried to train a model with pl. And I just ran the trainer.fit() as below:
trainer.fit(model, train_dataloaders=model.train_dataloader(),
                val_dataloaders=model.val_dataloader())
And I found that model.training == False, when it gets into forward()...
Is there any solution or does anybody know the potential reason for this?
Or does anyone know where can I find the source code for training_step() so that I can check and debug forward() in fit()?
Thank you very much.
does it print self.training = False for all the training steps? maybe you might have checked it during the initial steps where val sanity check happens.