This could be shortened by using `numpy.switch` and `T.switch`, for instance:
```Python
if symbolic:
    activations[idx] = T.switch(clamp, initial, activations[idx])
else:
    activations[idx] = numpy.switch(clamp, initial, activations[idx])
```
As an additional note, if `clamp` is not `float32`, some computations may not be transferred to GPU. I'm not sure where we should add that information.