Patent ID: 11860928
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 18:
19. A computer program product comprising one or more computer readable storage media that embody computer executable instructions, which when executed by a computer cause the computer to perform a method comprising:
receiving initial input from a client at least partially specifying one or more characteristics, wherein the initial input includes a seed image and a natural language statement describing a desired change to the seed image;
predicting one or more attributes of the seed image by operation of a neural network on the seed image;
parsing the natural language statement to identify desired changes to the one or more attributes of the seed image;
generating an interim target image by changing the one or more attributes of the seed image, according to the parsed natural language statement;
selecting a first set of images from an image database for output to the client, each of said first set of images being determined to at least partially satisfy the one or more changed attributes of the seed image;
displaying the first set of images to the client;
receiving from the client, responsive to the first set of images, a given input of which at least a portion compares a target image to at least a given image within the first set of images;
determining an image feature and a set of attribute features for the given image;
encoding, using a recurrent neural network (RNN), the given input to determine a feedback representation;
determining a joint visual semantic representation by combining the image feature and the set of attribute features for the given image with the feedback representation;
producing a query vector by aggregating the joint visual semantic representation with prior inputs received from the client; and
selecting a second set of images from the image database based at least in part on distances between the query vector and respective feature representations of images from the image database.