Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition
Convergence Results for Single-Step On-Policy Reinforcement-Learning Algorithms