Patent ID: 11860932
Assignee: ADOBE INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for information retrieval, comprising:
receiving a search query from a user;
generating a query embedding for the search query;
identifying an image comprising a plurality of objects;
generating a scene graph of the image comprising a node representing an object and an edge representing a relationship between two of the objects;
generating a node vector for the node, wherein the node vector represents semantic information of the object;
generating an edge vector for the edge, wherein the edge vector represents semantic information of the relationship;
generating a scene graph embedding using a graph convolutional network (GCN) that performs a convolution on the scene graph based on the node vector and the edge vector;
assigning metadata to the image based on the scene graph embedding;
storing the image in a database together with the metadata;
retrieving the image from the database based on the metadata and a similarity between the query embedding and the scene graph embedding; and
displaying the image to the user.