Patent ID: 11972220
Assignee: ORACLE INTERNATIONAL CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G  H | IPC G  H

Claim 41:
42. A system comprising:
one or more data processors; and
a non-transitory computer readable storage medium containing instructions which, when executed on the one or more data processors, cause the one or more data processors to perform operations comprising:
receiving a training dataset, wherein the training dataset includes a plurality of utterances generated by users interacting with a chatbot system;
accessing a machine-learning model comprising a series of network layers, wherein a final network layer of the series of network layers includes a logit function that transforms a first probability for a resolvable class into a first real number representative of a first logit value and a second probability for an unresolvable class into a second real number representative of a second logit value;
training the machine-learning model with the training dataset such that the machine-learning model:
determines the first probability for the resolvable class and the second probability for the unresolvable class; and
maps the first probability for the resolvable class to the first logit value using the logit function, wherein the logit function for mapping the first probability is a logarithm of odds corresponding to the first probability for the resolvable class, the logarithm of odds being weighted by a centroid of a distribution associated with the resolvable class;

replacing the logit function with an enhanced logit value such that the second probability for the unresolvable class is mapped to the enhance logit value, wherein:
the enhanced logit value is a third real number determined independently from the logit function used for mapping the first probability; and
the enhanced logit value includes: (i) a statistical value determined based on a set of logit values generated from the training dataset; (ii) a bounded value that is selected from a range of values defined by a first logarithm of odds corresponding to the second probability for the unresolvable class, the first logarithm of odds being constrained to a range of values by a bounding function and weighted by a centroid of a distribution associated with the unresolvable class; (iii) a weighted value generated by a second logarithm of odds corresponding to the second probability for the unresolvable class, the second logarithm of odds being constrained to the range of values by the bounding function, scaled by a scaling factor, and weighted by the centroid of the distribution associated with the unresolvable class; (iv) a hyperparameter-optimized value that is generated based on hyperparameter tuning of the machine-learning model; or (v) a learned value that is adjusted during training of the machine-learning model; and

deploying the trained machine-learning model with the enhanced logit value.