Patent ID: 11860589
Assignee: HONEYWELL INTERNATIONAL INC.
Field: Control (Instruments)
Classification: CPC G | IPC G

Claim 15:
16. A controller for controlling at least part of a process, the controller comprising:
a memory for storing a policy of the controller;
a processor operatively coupled to the memory;
the processor configured to provide one or more control actions to control at least part of the process, wherein one or more control actions are based on the policy;
the processor configured to perform a plurality of iterations, wherein during each iteration the processor: updates the policy of the controller;
provides one or more control actions based on the updated policy to control the at least part of the process;
associates the updated policy with a performance level of the controller in controlling the at least part of the process;
wherein for each iteration, the updated policy is determined using the associations generated during one or more previous iterations between the policies and the corresponding performance levels of the controller in controlling the at least part of the process, such that the updated policy is optimized to have a highest likelihood of producing a positive sign in a change in the performance level of the controller in controlling the at least part of the process without regard to a magnitude of the change rather than optimized to have a highest likelihood of producing a largest positive magnitude of change in the performance level of the controller in controlling the at least part of the process relative to the immediate previous iteration; and
wherein for each iteration, the updated one or more tuning parameters are determined using reinforcement learning based on an advantage function, and wherein the updated one or more tuning parameters are optimized to have a highest likelihood of producing an advantage function sign that is positive while ignoring an absolute value of the advantage function.