Reinforcement Learning Algorithms for MDPs
The MAXQ Method for Hierarchical Reinforcement Learning