Patent ID: 11869535
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 17:
18. A character-level emotion detection system, comprising:
a turn detection module configured to process audio data that includes speech to determine a first segment of the speech corresponding to a first user and a second segment of the speech corresponding to a second user;
a character module configured to process the first segment of the speech, without determining words included in the speech, to determine character data that includes a sequence of characters representative of the speech corresponding to the first user;
an embedding layer configured to receive, as an input to the character-level emotion detection system, the character data;
a first residual layer to process the character data to produce a feature map;
a first pooling layer to reduce a length of the feature map and produce a pooled feature map;
a residual feed forward network to process the pooled feature map and produce sentiment data indicative of an emotional state of the first user when the first user output the speech; and
an advisory module configured to at least:
process the sentiment data and a goal corresponding to the first user to determine, based at least in part on the sentiment data, that the first user is not achieving the goal; and
generate advisory data that includes at least a recommended action that the first user may follow in an effort to achieve the goal.