Patent ID: 11943181
Assignee: GOOGLE LLC
Field: Digital communication (Electrical engineering)
Classification: CPC H | IPC H

Claim 7:
8. A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor to perform operations, the operations comprising:
receiving an electronic communication that includes an image, the electronic communication being received at a computing device and from an additional computing device;
subsequent to receiving the electronic communication that includes the image, but prior to a reply electronic communication that is a reply to the electronic communication being transmitted to the additional computing device:
processing the image to identify one or more items included in the image from the received electronic communication, wherein processing the image to identify one or more of the items included in the image comprises:
processing, using an image recognition module, the image to extract one or more features of the image;
generating, based on one or more of the features extracted from the image, a label for one or more of the items included in the image, the label including a natural language description for one or more of the items included in the image;

generating, based on one or more of the items included in the image, multiple candidate replies that are each descriptive of the item in the image, wherein generating the multiple candidate replies comprises generating a given candidate reply, of the multiple candidate replies, based on media content items stored in one or more databases that are related to one or more of the items included in the image, wherein generating the given candidate reply based on the media content items stored in one or more of the databases that are related to one or more of the items included in the image comprises:
identifying, based on the natural language description for one or more of the items included in the image, at least one media content item, from one or more of the databases, that is associated with one or more of the items included in the image; and
generating the given candidate reply based on the at least one media content item that is associated with one or more of the items included in the image; and

causing one or more of the multiple candidate replies to be visually rendered for presentation to a user of the computing device via an electronic communications interface of the computing device;

receiving a user selection of a given candidate reply, of the multiple candidate replies, the user selection being received via the electronic communications interface of the computing device; and
causing the given candidate reply to be transmitted to the additional computing device as a reply electronic communication that is a reply to the electronic communication.