Patent ID: 11901047
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G  A | IPC A  G

Claim 14:
15. A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor of a neural network to cause the processor to perform operations comprising:
extracting a domain-specific object feature from a first image data, wherein the feature describes an object in the first image data;
determining domain-specific semantic meaning of text data;
mapping the object feature to a portion of the text data, wherein the portion of the text data describes the object;
creating a joint representation of the object and the portion of the text data;
receiving a second image data and a query directed towards an object in the second image data; and
generating, by the processor, an answer to the query based on the joint representation.