and the fact you can do this on some pre trained model that's that's seen tons and tons of data that easily is really amazing and there's even bigger models out there right so Nvidia made this bottle called megatron with eight billion parameters they ran a hundreds of GPUs for over a week spent vast quantities of cash well I mean they own the stuffs but so not really but they they put a ton of energy into training this I've heard people a lot of people complaining about how much greenhouse gas comes from training model like