and one way over on the other side so it's very easy for the trainer to get confused if your activations don't stay near this middle part all right and that's problematic compare that to rel U which is the standard these days and really you yes it does have this this very very large dead space but if you're not in the dead space then there's nothing stopping it from getting getting bigger and bigger and scaling off to infinity and one of the reasons why when the intuitions behind why this works better as Geoffrey Hinton puts it is