May need to control which layers learn first, then second.  Either by using different learning rates for the different layers.  OR by changing the neural io function of the higher layers from sigmoid to non-monotonic.  Note: the lower layer starts-out with the non-monotonic neural io function.  Question, will the shifted non-monotonic function be of use?