Patent ID: 11860975
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 7:
8. On a computing device comprising a machine learning model configured to analyze one or more video streams, a method for allocating computing resources and selecting a configuration for the machine learning model, the method comprising:
for a plurality of jobs corresponding to retraining and operation of the machine learning model, the plurality of jobs including at least one of an inference job and a retraining job, iteratively:
designating a selected job of the plurality of jobs as a thief, and designating one or more other jobs each as a victim;
reallocating an amount of computing resources from each victim to the thief to form an updated allocation,
testing a plurality of configurations for the machine learning model using the updated allocation to determine an updated inference accuracy, and
when the updated inference accuracy is more accurate than an initial stored inference accuracy of an initial resource allocation, then
storing a selected configuration that produced the updated inference accuracy as a stored configuration,
storing the updated inference accuracy as a stored inference accuracy, and
storing the updated allocation as a stored resource allocation; and

after iterating through each job of the plurality of jobs as the thief, during a retraining window, retraining the machine learning model and making an inference with the machine learning model using the stored resource allocation and the stored configuration.