the way or something like this usually the last layer has the best representation for classification but here the special thing is that the intermediate layers in the middle have the best representation you can see that representation quality in terms of linear probing falls off as they sort of it falls off as they go into higher layers and this is consistent across the datasets as you can see and the the idea here is or the way they interpret it is that if you have an image right here Dada Dada Dada and they you've blocked part of it