is a connection like it is in text models and text models there's a connection of the perplexity of your language model and the quality that of the representation you get for downstream tasks in this model it seems to be the exact same thing there is a connection between reaching lower validation laws and reaching a higher performance on classification so that's one interesting thing the general trend - up to the upper right corner the other interesting and even arguably even more interesting thing is that if you look at