Learning slowly but surely