Before revision: Experience replay is widely used in various deep off-policy reinforcement learning(RL) algorithms. It stores previously collected samples for further reuse.
After revision: In reinforcement learning, experience replay stores past samples for further reuse.