off both of them it's worth playing around with these with these things I told you about why I think SWA is great there's this system called attitude my old team at Amazon released where you don't even need to take a learning rate it dynamically calculates the ideal learning rate scheduled at every point during training for you it's kind of magical so it's worth playing around with different optimizers but don't mess with the with the activation functions okay let's pop out right there's a bunch of a bunch of Theory bunch of math and and