tokens: Note that the third part requires that be differentiable , which is the case if we use a differentiable activation function like the Exponential Linear Unit ( ELU ) Clevert2016 with , instead of the more common ReLU activation function .