Patent ID: 11934951
Assignee: HONDA MOTOR CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G  B  Y | IPC B  G

Claim 15:
16. A control system comprising a control apparatus configured to perform predetermined control for a predetermined system using reinforcement learning, and an information processing server,
the control apparatus comprising:
one or more processors; and
a memory storing instructions which, when the instructions are executed by the one or more processors, cause the control apparatus to function as:
a detection unit configured to detect an event in a life cycle of the predetermined system,
a first transmission unit configured to transmit, in response to the detection of the event, the detected event to the information processing server,
a setting unit configured to set an exploration parameter specified in accordance with the event and received from the information processing server as a value for adjusting a ratio of exploration in the reinforcement learning, and
a processing unit configured to execute the predetermined control using the reinforcement learning in accordance with the set exploration parameter,
wherein when a first event is detected, the setting unit sets the exploration parameter so that the ratio of the exploration set during a first period after the first event is smaller than the ratio of the exploration set during a second period before the first event is detected, and
the information processing server comprising:
one or more processors; and
a memory storing instructions which, when the instructions are executed by the one or more processors, cause the information processing server to function as:
a specifying unit configured to specify the exploration parameter in accordance with the event, and
a second transmission unit configured to transmit the specified exploration parameter to the predetermined system.