Learning slow but steady