Minor improvement of value function definition in reinforcement learning