Patent ID: 11947411
Assignee: BANK OF AMERICA CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 19:
20. A method for evaluating, validating, correcting, and loading data feeds based on artificial intelligence input, the method comprising:
training a first machine learning model using first historical data to determine thresholds for likelihoods of data feeds failing to load, wherein the thresholds are determined based on (i) sizes of data feeds associated with higher likelihoods of failing to load and (ii) associations of the data feeds with repeat failure histories, and wherein the first historical data comprises characteristics of historical data feeds and outcomes of loading the historical data feeds;
receiving a data feed from a source for loading to a target data structure;
determining, using the first machine learning model and based on characteristics of the data feed, a threshold for a likelihood of the data feed failing to load;
analyzing, based on historical feed data, metadata of the data feed to determine the likelihood of the data feed failing to load;
determining whether the likelihood of the data feed failing to load satisfies the threshold;
determining whether the data feed is associated with a recent rejection of another data feed based on characteristics of the data feed, characteristics of historical data feeds, the source from which the data feed was received, and the target data structure to which the data feed is to be loaded;
loading, based on determining that the likelihood of the data feed failing to load satisfies the threshold and based on determining that the data feed is not associated with the recent rejection of the other data feed, the data feed to the target data structure;
determining, after loading the data feed to the target data structure, whether the data feed failed to load;
training a second machine learning model using second historical data to determine numbers of parts into which to split data feeds to have shortest times for at least one of successfully identifying errors or successfully loading the data feeds, wherein splitting the data feeds comprises, for a given data feed, dividing a total number of rows in the given data feed by a number N of parts and splitting the given data feed into the number N of subdivided data feeds each having the same number of rows;
based on determining that the data feed failed to load, iteratively and until each subdivided data feed loads or is added to a failed data log:
determining, using the second machine learning model, a number N of parts into which to split the data feed;
subdividing, into N subdivided data feeds, the data feed or each of the subdivided data feeds that fails to load and that is not a single data row;
loading each of the subdivided data feeds to the target data structure; and
for each of the subdivided data feeds that fails to load and that is a single data row, correcting an error in the subdivided data feed or adding the subdivided data feed to the failed data log;

transmitting, to a user device associated with the source, the failed data log; and
continuously retraining the first machine learning model and the second machine learning model using data and metadata associated with loaded data feeds, subdividing the loaded data feeds, correcting errors in the loaded data feeds, outcomes of attempts to load subdivided parts of the loaded data feeds, and outcomes of attempts to load loaded data feeds including corrected errors.