Patent ID: 11941668
Assignee: ZETA GLOBAL CORP.
Field: IT methods for management (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. A method of allocating data across multiple platforms, the method comprising:
receiving a request to deploy a piece of content to available inventory;
receiving a bid result for a bid on the available inventory, the bid submitted to a real time bid server in response to the request;
storing state data including a sequence of bids sent to the real time bid server, the bid result, and a response rate for the available inventory;
training a bidding model by:
using a first neural network, determining a plurality of action Q-values based on the state data, the plurality of action Q-values including at least one Q-value for each possible action at a current state of the bid server;
selecting an action based on a maximum action Q-value;
using a second machine learning model, determining a target Q-value for the selected action based on the state data and experience data, the experience data including the selected action and a reward earned for the selected action;
training the first neural network to update the plurality of action Q-values based on the target Q-value, the training using a stochastic gradient descent;
determining a bid action using the trained bidding model; and
submitting a new bid on the available inventory to the real time bid server based on the bid action.