Value-function reinforcement learning in Markov games
Asynchronous Stochastic Approximation and Q-Learning