Hierarchical Reinforcement Learning with the MAXQ Value Function Decomposition
Residual Algorithms: Reinforcement Learning with Function Approximation