Patent ID: 11955026
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method comprising:
retrieving, by one or more processors, speaker data regarding a speech made by a user;
separating, by the one or more processors, the speaker data into one or more speaker modalities;
extracting, by the one or more processors, one or more speaker features from the speaker data for the one or more speaker modalities;
extracting, by the one or more processors, one or more audience features from audience data gathered in association with the speech made by the user;
generating, by the one or more processors, an audience classification of the one or more audience features;
generating, by the one or more processors, a first performance classification based on a multimodal deep-learning neural network, wherein each of the one or more speaker modalities and each of the one or more audience features are connected to a respective input layer of a respective neural network for the multimodal deep-learning neural network the one or more speaker features and the audience classification;
in response to the first performance classification indicating positive performance by the user while at least one of the one or more audience features indicating negative performance by the user, retraining, by the one or more processors, the multimodal deep-learning neural network with the one or more audience features indicating negative performance by the user; and
generating, by the one or more processors, a second performance classification regarding a second speech based on the retrained multimodal deep-learning neural network.