in M Squared is is not actually necessarily much more expensive whereas in an RNN like an L STM you can't do anything with token 11 until you're completely done processing token 10 all right so this is a key advantage of transformers they're much more computationally efficient also you don't need to use any of these sigmoid or tan h activation functions which are built into the LS TM model these things of scale your activations to 0 1 why are these things problematic so these were bread-and-butter in the old days of of