Patent ID: 11907837
Assignee: DEEPMIND TECHNOLOGIES LIMITED
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 21:
22. The computer-readable storage media of claim 17, the operations further comprising:
training the actor policy network and the Q network, comprising:
receiving a current observation representing a current state of the environment;
processing the current observation using the actor policy network to generate a current ideal point in the multi-dimensional space in accordance with current values of the parameters of the actor policy network;
determining, from the points that represent actions in the discrete set of actions, a nearest point to the current ideal point;
selecting a current action to be performed by the agent in response to the current observation in accordance with an exploration policy using the nearest point to the current ideal point;
in response to the agent performing the current action, receiving an actual reward and a next observation representing a next state of the environment;
generating a current experience tuple that comprises the current observation, the current action, the actual reward, and the next observation; and
storing the current experience tuple in a replay buffer.