PATENT CLAIM ANALYSIS

Application Number: 15941175
Application Type: Utility
Filing Date: 2018-03
Publication Date: 2019-01
Patent Classification: ["703", "002000"]

Abstract:
Systems and methods include: collecting digital threat scores of an incumbent digital threat machine learning model; identifying incumbent and successor digital threat score distributions; identifying quantiles data of the incumbent digital threat score distribution; collecting digital threat scores of a successor digital threat machine learning model; calibrating the digital threat scores of the successor digital threat score distribution based on the quantiles data of the incumbent digital threat score distribution and the incumbent digital threat score distribution; and in response to remapping the digital threat scores of the successor digital threat score distribution, publishing the successor digital scores in lieu of the incumbent digital threat scores based on requests for digital threat scores.

Claim (Index 16):
A method of calibrating a machine learning model of a machine learning system, the method comprising:\n generating a first score distribution for an active machine learning model and a second score distribution for a nascent machine learning model based on a same input dataset; acquiring quantiles data from each of the first and second score distributions; computing a monotonic remapping function based on the quantiles data for each of the first and the second score distributions; transforming the nascent machine learning model to a calibrated machine learning model by applying the monotonic remapping function to the second score distribution of the nascent machine learning model; implementing the calibrated machine learning model within a machine learning service and returning one or more machine learning scores using the calibrated machine model in response to one or more requests for machine learning scores.

Metadata:
- Claim Count in Document: 38.0
- Percentile: 90.0
- Lexical Diversity: 3.18421
- Patent Class: 703.0
- Transitional Phrase Type: open
- Component Type: 1
- Foreign Priority: False
- Related Applications: ['15653373', '15653354', '15922746', '15842379', '15396273']

Analysis Scores:
- 35 USC 101 Eligibility (BERT): 0.2228778765861754
- 35 USC 102 Novelty (BERT): 0.5067690520723112
- Combined Prediction Score: 0.251266994134789
- Mean Citation Score: 215.505092
- Max Citation Score: 250.36577000000003
- Similarity Product: 183.30430322745087

Labels:
- Claim Label 101: 0
- Claim Label 102: 1
- Claim Label 103: 1
- Claim Label 112: 1
- Combined Label: 0
- Label 101 Adjusted: 0

Dataset: test