Patent ID: 11868756
Assignee: PAYPAL, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A service provider system comprising:
a non-transitory memory;
one or more hardware processors coupled to the non-transitory memory and configured to read instructions from the non-transitory memory to cause the service provider system to perform operations comprising:
receiving a request for deploying a machine learning (ML) model package for a ML engine, wherein the ML model package comprises a plurality of ML models,
testing each of the plurality of ML models for decision-making using live production environment traffic executed by the ML engine with the ML model package,
flagging a first ML model of the plurality of ML models as a non-performant ML model based at least on one or more non-performant compute items in the first ML model, and
excluding, during a deployment of the ML model package, the one or more non-performant compute items from an execution directed graph of the first ML model; and

a listener configured to perform the flagging and pass the flagging to a live production environment that enables the live production environment to skip at least one of the first ML model or the one or more non-performant compute items in the execution directed graph.