The MIT Press. These results were not convincing to everyone. Richard S. Sutton. The MIT Press. Some of the most interesting recent work has concerned theoretical results on when function approximation will and will not result in a convergent algorithm.
Results exist concerning gradient descent methods and averaging methods.
Reinforcement learning with function approximation. Geoffrey J. Gordon. Stable function approximation in dynamic programming. John N. Tsitsiklis and Benjamin Van Roy. Feature-based methods for large scale dynamic programming.