Before revision:  We have developed a new distributed RL agent, named Recurrent Distributed DDPG (RD2), which adds a recurrent neural network layer to Ape-X DDPG  and makes two important improvements on prioritized experience replay to stabilize training.
After revision:  We have developed a new distributed RL agent, named Recurrent Distributed DDPG (RD2), which adds a recurrent neural network layer to Ape-X DDPG and makes two structural improvements on prioritized experience replay to stabilize training.