Patent ID: 11874899
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 8:
9. A computer program product for automated multimodal adaptation of multimedia content, the computer program product comprising:
one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions comprising:
program instructions to transform, using a first trained generative adversarial network, a non-text portion of a first multimedia content into a text description of the first multimedia content;
program instructions to adjust, using a trained attention layer, the text description, the adjusting creating an adjusted text description, the adjusting performed according to a presentation mode constraint, the presentation mode constraint specifying a presentation mode of a second multimedia content; and
program instructions to transform, using a trained model, the adjusted text description into a non-text portion of the second multimedia content, the second multimedia content presented in the presentation mode specified by the presentation mode constraint;
program instructions to adjust, according to feedback data, the presentation mode constraint;
program instructions to transform, using the first trained generative adversarial network, a second portion of the first multimedia content into a second text description of the second portion;
program instructions to adjust, using the trained attention layer, the second text description, the adjusting creating an adjusted second text description, the adjusting performed according to the adjusted presentation mode constraint; and
program instructions to transform, using the trained model, the adjusted second text description into a second portion of the second multimedia content, the second portion of the second multimedia content presented in the presentation mode specified by the presentation mode constraint.