About the Weight Initialization in PL
Hi,
I am tring to use BERT for a project. The pretrained BERT model is part of my model. I am wondering how will PL initialize the model weights. Will it overwrite the pretrained BERT weights?
Thanks.
lightning doesn’t do any magic like this under the hood. you control all the weights and what gets initiated