Before revision:  These observations hold across both full and few-shot transfer and indicate that scaling laws hinting improvement of generalization and transfer with increasing model and data size are incomplete and should also take into account the degree of how distinct the source and target data distributions are , to correctly predict  effect of model size and data size variation during pre-training on transfer.
After revision:  These observations hold across both full and few-shot transfer and indicate that scaling laws hinting improvement of generalization and transfer with increasing model and data size are incomplete and should also take into account the degree of how distinct the source and target data distributions are , to correctly predict the effect of model size and data size variation during pre-training on transfer.