Patent ID: 11860589
Assignee: HONEYWELL INTERNATIONAL INC.
Field: Control (Instruments)
Classification: CPC G | IPC G

Claim 10:
11. A method of controlling one or more pieces of equipment using a regulatory controller, the regulatory controller configured to regulate the one or more pieces of equipment, the method comprising:
the regulatory controller regulating one or more pieces of equipment by providing control actions to the one or more pieces of equipment, wherein the regulatory controller uses one or more programmable tuning parameters in regulating the one or more pieces of equipment;
while controlling the one or more pieces of equipment, and during each of a plurality of iterations:
updating one or more of the tuning parameters of the regulatory controller;
regulating the one or more pieces of equipment using the one or more updated tuning parameters;
monitoring a performance of how well the regulatory controller controlled the one or more pieces of equipment using the one or more updated tuning parameters;
wherein for each iteration, the one or more updated tuning parameters are determined based at least in part on the performance of how well the regulatory controller performed in controlling the one or more pieces of equipment during one or more previous iterations, such that the updated one or more tuning parameters are optimized to have a highest likelihood of producing a positive sign n-a change in the performance of how well the regulatory controller controlled the one or more pieces of equipment without regard to a magnitude of the change rather than optimized to have a highest likelihood of producing a largest positive magnitude of change in the performance of how well the regulatory controller controlled the one or more pieces of equipment relative to the immediate previous iteration; and
wherein for each iteration, the updated one or more tuning parameters are determined using reinforcement learning based on an advantage function, and wherein the updated one or more tuning parameters are optimized to have a highest likelihood of producing an advantage function sign that is positive while ignoring an absolute value of the advantage function.