Hierarchical model-based reinforcement learning: R-max + MAXQ
Exploiting Structure in Policy Construction