Hierarchical Policy Gradient Algorithms
Infinite-Horizon Policy-Gradient Estimation