question: About the Weight Initialization in PL
context: Hi,
  I am tring to use BERT for a project. The pretrained BERT model is part of my model. I am wondering how will PL initialize the model weights. Will it overwrite the pretrained BERT weights?
  Thanks.
answer: lightning doesn’t do any magic like this under the hood. you control all the weights and what gets initiated