of these transforming networks yes they're easier to train they're more efficient all that yada yada yada but more importantly transfer learning actually works with them right you can take a pre trained model fine-tune it for your task without a specific data set and another really critical point which I didn't get a chance to go into is that these things are originally trained on large quantities of unsupervised text you can just take all of the world's text data and use this as training data the way it works very very