Are Deep Policy Gradient Algorithms Truly Policy Gradient Algorithms?
On the Computational Efficiency of Training Neural Networks