that the fine tuning is always done at the end so even though the linear probe even though the linear probe can be attached anywhere in between and it's often useful to do that as we saw because the in between layers are the best they say they tried fine-tuning also in from in between but it always worked out best whenever you fine-tune whenever you fine-tune you take actually the last layer so that kind of gives you an idea that the model is then it's sort of what seems to be important is this coming up with the higher level representation and