an analysis of temporal - difference learning with function approximation 1 .
Asynchronous Stochastic Approximation and Q-Learning