Patent ID: 11892809
Assignee: VERITONE, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 20:
21. The non-transitory computer-readable medium of claim 15 wherein the automated operations further include:
updating, by the one or more computing systems, the generated model to reflect the implementing of the at least one control action using the at least determined particle, including to reflect updated state information for the physical system; and
controlling, by the one or more computing systems and using the updated generated model, the operations of the physical system for multiple successive time periods after the indicated time period, including, for each of the multiple successive time periods:
receiving, by the one or more computing systems, further information that includes projected available functionality of an indicated type from the physical system for a current successive time period of the multiple successive time periods and includes projected demand for the functionality for the current successive time period;
generating, by the one or more computing systems, multiple particles for the current successive time period that each represents a different set of state information for the physical system;
propagating, by the one or more computing systems, and for each of a plurality of iterations during a time window that lasts for at least some of the current successive time period, the respective state information for each of the multiple particles to attempt to determine further projected future state information for the particle that reflects improved ability of the physical system to satisfy the projected demand for the current successive time period for the functionality using the projected available functionality for the current successive time period in light of the indicated goal, including using reinforcement learning as part of combining information for the multiple particles;
determining, by the one or more computing systems, one or more of the multiple particles for the current successive time period whose further projected future state information provides a further solution for the current successive time period for the physical system to satisfy the projected demand for the current successive time period for the functionality using the projected available functionality for the current successive time period in light of the indicated goal;
implementing, by the one or more computing systems, and using the further solution for the determined one or more particles for the current successive time period, at least one control action in the physical system to cause the multiple providers to satisfy the projected demand for the current successive time period for the functionality using the projected available functionality for the current successive time period; and
further updating, by the one or more computing systems, a current version of the generated model to reflect the implementing for the current successive time period of the at least one control action using the at least determined particle, including to reflect further updated state information for the physical system.