However, to discover such actions, it has to try actions that is has not selected before. The agent has to exploit what it already knows in order to obtain reward, but it also has to explore in order to make better selections in the future. Therefore, the dilemma is that neither exploration nor exploitation can be pursued exclusively without failing at the task. The agent must try a variety of actions and progressively favour those that appear to be best. Reinforcement appears suited to the problem of a predator learning autonomously to herd a flock, and I would like to research this in a future study.
Any comments welcome.