Implementation Matters in Deep RL: A Case Study on PPO and TRPO This paper identifies mechanisms which are called ingredients in onpolicy policy  - Information from www.semanticscholar.org