Patent ID: 11886963
Assignee: OCTOML, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 6:
7. A system to obtain a plurality of machine learning models and optimize the plurality of machine learning models, the system comprising:
an optimization result data repository configured to store optimization logs containing optimization result data for machine learning models; and
a computing device configured to:
obtain an indication of one or more machine learning models and one or more model types each corresponding to a machine learning model of the one or more machine learning models; and
for each machine learning model:
identify a hardware target of the machine learning model, wherein the hardware target includes an indication of hardware upon which the machine learning model is to be deployed;
retrieve optimization result data from the repository based on the identified hardware target and the model type that corresponds to the machine learning model, the retrieved optimization result data reflecting a level of consumption of hardware resources resulting from changing one or more machine learning models;
changing software code used to implement the machine learning model for optimized operation on hardware specified by the identified hardware target, based on the hardware target and the retrieved optimization result data;
obtain second optimization result data by evaluating the performance of the optimized machine learning model on hardware indicated by the identified hardware target, the second optimization result data including an indication of the hardware target and the model type; and
store the second optimization result data in the optimization result data repository.