Go back to more aggressive mean for stepsize adaptation