I actually want to keep the replay buffer

Since I need to hear something back to remove from it.