Patent ID: 11860932
Assignee: ADOBE INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 7:
8. A non-transitory computer readable medium storing code for information retrieval, the code comprising instructions executable by at least one processor to:
receive a search query from a user;
generate a query embedding for the search query;
identify an image comprising a plurality of objects;
generate a scene graph of the image comprising a node representing an object and an edge representing a relationship between two of the objects;
generate a node vector for the node, wherein the node vector represents semantic information of the object;
generate an edge vector for the edge, wherein the edge vector represents semantic information of the relationship;
generate a scene graph embedding using a graph convolutional network (GCN) that performs a convolution on the scene graph based on the node vector and the edge vector;
assign metadata to the image based on the scene graph embedding;
store the image in a database together with the metadata;
retrieve the image from the database based on the metadata and a similarity between the query embedding and the scene graph embedding; and
display the image to the user.