pre trained weights so sort of here's here's what this concretely would look like if you initialize those pre trained weights you'd look something like this if you initialize with random initialization you of course destroyed all the features and it looks something like this and then this thing which we call the mean var in it I mean it looks exactly like random initialization except that it's scaling is different because you sort of rescaled so how does this do if we initialize what this and train instead turns out that it actually