The MAXQ Method for Hierarchical Reinforcement Learning
Between MDPs and Semi-MDPs: Learning, Planning, and Representing Knowledge at Multiple Temporal Scales