If subclasses of Linear need to use _linear_part and copy input in done in the _linear_part, and say you want to activate what you get from the _linear_part, you end up activating the copied input! So say I would do tanh(_linear_part()), then the copied input would also be tanh'd...which is undesirable IMHO.