Loss Module with inner Network
I have a loss module which is part of my lightning module with its own inner pretrained vgg network.
The problem comes when I am trying to use the checkpoint (that is saved automatically) to resume training or to test my model.
Then I get an error  unexpected key(s) in state_dict pytorch lightning which points to the keys of the network which is part of the loss function.
Is there a way to load my model properly?
Dear @vasl12,
You have multiple options:

pass strict=False
drop the key before saving the weights. Use on_save_checkpoint hook to access the checkpoint and drop the associated key.
re-create the missing module in your model

Best,
T.C