before training with the replay controller