Ensure synaptic weights stay above 0.
Lower learn rate for excitatory synapses.