Hidden units' activations are selectable in the configuration