is something like sixty layers then this is like 48 layers and this is 32 layers we don't really so these are on the olive on the scale of GPT to either a little bigger or a little smaller it's not like a GPT three scale where you need a ginormous supercomputer though they do do a lot of computation but it this still sort of fits within hardware of a standard size and not like exascale what's interesting right here is that you can see the larger models they reach a lower validation loss so here is the validation loss larger model if you