Patent ID: 11868727
Assignee: ORACLE INTERNATIONAL CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 7:
8. A chatbot system comprising:
one or more processors; and
a memory coupled to the one or more processors, the memory storing a plurality of instructions executable by the one or more processors, the plurality of instructions comprising instructions that when executed by the one or more processors cause the one or more processors to:
receive, at the chatbot system, at least one utterance comprising one or more words;
generate, with a transformer-based model, a plurality of embeddings for the one or more words of the at least one utterance;
generate, with a first vectorizer, at least one regular expression and gazetteer feature vector for the at least one utterance;
generate, with a second vectorizer, at least one context tag distribution feature vector for the at least one utterance;
concatenate or interpolate the plurality of embeddings with the at least one regular expression and gazetteer feature vector and the at least one context tag distribution feature vector to generate a first set of feature vectors;
generate, with a main sequence model, an encoded form of the at least one utterance based on the first set of feature vectors;
generate, with a discriminative model, a plurality of log-probabilities for candidate entities based on the encoded form of the at least one utterance; and
identify, using the plurality of log-probabilities, one or more constraints for the at least one utterance based on the candidate entities.