Hierarchical model-based reinforcement learning: R-max + MAXQ
Recent advances in hierarchical reinforcement learning