Patent ID: 11901047
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G  A | IPC A  G

Claim 7:
8. A system comprising:
a memory having computer readable instructions; and
one or more processors for executing the computer readable instructions, the computer readable instructions controlling the one or more processors to perform operations comprising:
extracting a domain-specific object feature from a first image data, wherein the feature describes an object in the first image data;
determining domain-specific semantic meaning of text data;
mapping the object feature to a portion of the text data, wherein the portion of the text data describes the object;
creating a joint representation of the object and the portion of the text data;
receiving a second image data and a query directed towards an object in the second image data; and
generating, by the processor, an answer to the query based on the joint representation.