Fixed interaction w/ mean removal and prior learn

Made sure that the prior learning is only conducted of the the
*non-auxilliary* terms.