Patent application EP18205292A (EP), filed 2018-11-09
Publication number: EP3483797A1
Title: TRAINING, VALIDATING, AND MONITORING ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING MODELS
Abstract: [0001]    A device identifies training data and scoring data for a model, and removes bias from the training data to generate unbiased training data. The device trains the model with the unbiased training data to generate trained models, and processes the trained models, with the scoring data, to generate scores for the trained models. The device selects a trained model, from the trained models, based on model metrics and the scores, and processes a training sample, with the trained model, to generate first results, wherein the training sample is created based on the unbiased training data and production data. The device processes a production sample, with the trained model, to generate second results, wherein the production sample is created based on the production data and the training sample. The device provides the trained model for use in a production environment based on the first results and the second results.
IPC codes: G06N  20/    20            A I
Claims: number: 1
text: A device, comprising:
number: 2
text: The device of claim 1, wherein the one or more processors are further to:
number: 3
text: The device of claim 1 or 2, wherein the one or more processors, when identifying the training data and the scoring data, are to one or more of:
number: 4
text: The device of any one of claims 1 to 3, wherein the one or more processors, when processing the plurality of trained models with the scoring data, are to:
number: 5
text: The device of any one of claims 1 to 4, wherein the one or more processors, when evaluating and selecting the trained model, are to:
number: 6
text: The device of any one of claims 1 to 5, wherein the one or more processors, when creating the training sample for the trained model based on the unbiased training data and the production data, are to:
number: 7
text: The device of any one of claims 1 to 6, wherein the one or more processors, when creating the production sample, are to:
number: 8
text: A method, comprising:
number: 9
text: The method of claim 8, further comprising:
number: 10
text: The method of claim 8 or 9, wherein processing the plurality of trained models with the scoring data includes:
number: 11
text: The method of any one of claims 8 to 10, wherein selecting the trained model includes:
number: 12
text: The method of any one of claims 8 to 11, further comprising:
number: 13
text: The method of any one of claims 8 to 12, further comprising:
number: 14
text: A computer program product comprising machine executable instructions residing on non-transitory computer readable media, which, when loaded and executed by a processor, cause the processor to perform operations according to the method of any one of claims 8-13.
number: 15
text: A system for training, validating, and monitoring artificial intelligence and machine learning models, the system configured to perform operations according to any one of claims 8-13.
Office action: search_report, dated 2019-05-15
Prior art cited: ref_id: US2017193392A1
ref_type: patent
severity: background
ref_id: US2017243140A1
ref_type: patent
severity: background
ref_id: US2017193392
ref_type: patent
severity: background
ref_id: US2017243140
ref_type: patent
severity: background
Final disposition: pending (2019-05-15)