SYSTEMS AND METHODS FOR INCORPORATING DYNAMIC REACTIONS INTO E-MAIL COMMUNICATIONS

Systems and methods for incorporating reactions in electronic messages. A computer system can receive, from a computing device, a first request for one or more images responsive to the computing device accessing an electronic message, generate the one or more images using information indicative of reactions recorded in association with the email message, and send the one or more images to the computing device for display in the email message. The computer system can receive, from the computing device, a second request for recording a first reaction to the email message responsive to the computing device interacting with a first interactive element rendered in the email message, update the information indicative of the reactions recorded in association with the email message to account for the first reaction, and send a first page confirming the recording to the computing device for display.

BACKGROUND

Email messages are typically static. In other words, the content of an email message cannot be modified once the email message is sent. One reason that the content of email messages does not change once the messages are sent is that email messages are exchanged across different email platforms that are owned and/or controlled by different entities. For instance, the email account of a sender of an email message can be associated with a first email provider while the email account(s) of the recipient(s) of the email message can be associated with one or more second email providers. Other types of electronic messages, such as short message service (SMS) messages, are also static in nature and cannot be modified once sent.

SUMMARY

The systems and methods described herein improve upon conventional electronic messaging systems (e.g., email systems) by incorporating dynamic reactions in electronic messages and monitoring and recording the reactions of recipients of the electronic messages over time. According to embodiments described herein, a computer system can provide software instructions for embedding in a composed email message or other electronic message to incorporate interactive content in the electronic message, report user interactions with the interactive content, and display dynamic content in the electronic message indicative of reactions reported in relation with the electronic message. The incorporated interactive content allows recipients of the electronic message to react to content of the message. The computer system can record the reactions and reflect the recorded reactions in the electronic message when the message is refreshed by the recipient or accessed by another recipient. The interactive content can include one or more interactive elements, such as a link, an image map overlaid over one or more images depicting one or more reactions and/or one or more interactive images depicting the one or more reactions, e.g., emoji reactions.

The link when actuated can cause display of a window or page including a plurality of interactive content items (e.g., interactive images or graphical elements) representing a plurality of reactions, e.g., emoji reactions. The recipient of the email or electronic message can interact with, e.g., by clicking or tapping, one of the interactive content items in the window or page to record a specific reaction depicted by the content item. Upon the message recipient interacting with the interactive image in the window or page, a remote computer system (e.g., including one or more servers) can record the recipient's reaction. When the recipient refreshes the electronic message or another recipient accesses the same message, an updated version of the message indicating the recorded reaction can be displayed.

In some implementations, the electronic message can include a plurality of interactive images, each of which can depict a corresponding reaction (e.g., a corresponding emoji reaction) and can be associated with a corresponding link (e.g., a uniform resource locator (URL)). When the recipient of the electronic message interacts with an interactive image of the plurality of interactive images, a request to record the corresponding reaction can be sent from the recipient's computing device to the computer system using the corresponding link. The corresponding link can be viewed as a request to record the corresponding reaction that is sent to the computer system upon the recipient interacting with the interactive image. The corresponding link can include an identifier of the corresponding reaction or of the interactive image. Upon receiving the request, the computer system can record the recipient's reaction. The remote server can provide updated versions of the interactive images or an updated version of a graphical element to be displayed in the electronic message (e.g., when the message is refreshed or re-accessed by the recipient or accessed by another recipient). The updated versions of the interactive images or the updated version of a graphical element can depict the reactions recorded in association with the electronic message.

The image map can include one or more interactive areas each of which overlapping with, or overlaid over, a corresponding graphical element of the image. The recipient can select a reaction via the image map and the computing device of the recipient can report the selected reaction to the computer system for recording. In some other implementations, the interactive content can include a link of a page through which the recipient can select a reaction among one or more reactions. The page can be displayed in pop up window responsive to activating the link in the email message. The image can include one or more interactive content items depicting the one or more dynamic reactions.

At least one aspect of the present disclosure relates to a computer system including one or more processors and at least one memory that stores computer-executable instructions. The computer-executable instructions, when executed by the one or more processors, can cause the one or more processors to receive, from a computing device, a first request for one or more images responsive to the computing device accessing an email message, generate, responsive to the first request, the one or more images using information indicative of reactions recorded in association with the email message, and send the one or more images to the computing device for display in the email message. The one or more images when displayed in the email message depict one or more first graphical elements representing one or more reactions to the email message. The one or more processors can receive, from the computing device, a second request for recording a first reaction to the email message responsive to the computing device interacting with a first interactive element rendered in the email message. The second request can be a request for a first page and can include an indicator of the first reaction. The one or more processors can update, responsive to the second request, the information indicative of the reactions recorded in association with the email message to account for the first reaction. The one or more processors can send the first page to the computing device for display. The first page can confirm the recording of the first reaction to the email message.

In some implementations, the first interactive element includes an image map overlaid over the one or more images when displayed within the email message. The indicator of the first reaction can include an identifier of the image map and an identifier of a first interactive area, of a plurality of interactive areas of the image map, with which the computing device interacted. Each graphical element of the one or more first graphical elements can represent a corresponding reaction and can be associated with a corresponding interactive area of the plurality of interactive areas of the image map. The one or more processors can identify the first reaction using the identifier of the image map and the identifier of the first interactive area of the image map.

In some implementations, the second request can include at least one of a uniform resource locator (URL) including the indicator of the first reaction, or a session cookie of the computing device. In some implementations, the one or more image can include one or more interactive images. Each interactive image can depict a corresponding graphical element of the one or more first graphical elements and can represent a corresponding reaction of the one or more reactions. The first interactive element can include a first interactive image of the one or more interactive images. Each interactive image can be associated with a respective link including an identifier of the interactive image. The one or more processors can receive, from the computing device, a first link associated with the first interactive image upon the computing device interacting with the first image. The first link can represent the second request and can include an identifier of the first image. The one or more processors can identify the first reaction based on the identifier of the first image.

In some implementations, the first interactive element includes a link indicative of a second page including a plurality of interactive content items representing a plurality of reactions. In receiving the second request for recording the first reaction, the one or more processors can receive, from the computing device, a third request for the second page responsive to the computing device interacting with the link rendered in the email message. The one or more processors can provide, responsive to the third request, the second page to the computing device for display. The one or more processors can receive, from the computing device, the second request for recording the first reaction to the email message responsive to the computing device interacting with an interactive content item of the plurality interactive content items in the second page.

In some implementations, the one or more images when displayed in the email message can further depict a second graphical element indicative of a second page including one or more interactive content items representing one or more additional reactions. In receiving the second request for recording the first reaction, the one or more processors can receive, from the computing device, a third request for the second page responsive to the computing device interacting with the first interactive element rendered in the email message, provide, responsive to the third request, the second page to the computing device for display, and receive, from the computing device, the second request for recording the first reaction to the email message responsive to the computing device interacting with an interactive content item of the one or more interactive content items in the second page. The first interactive element can include an interactive area of an image map overlaid over the one or more images such that the interactive area overlaps the second graphical element or an interactive image displayed in the email message and depicting the second graphical element.

In some implementations, the one or more processors can further receive a third request for the one or more second images from a second computing device responsive to the second computing device accessing the email message. The one or more processors can generate the one or more second images using the updated information indicative of the reactions recorded in association with the email message. The one or more processors can send the one or more second images to the second computing device for display in the email message accessed by the second computing device. In some implementations, the one or more processors can receive a third request for the one or more images from the computing device responsive to the computing device refreshing the email message. The one or more processors can generate the one or more second images using the updated information indicative of the reactions recorded in association with the email message, and send the one or more second images to the computing device for display in the refreshed email message. In some implementations, the one or more first graphical elements depicted by the one or more images represent one or more reactions recorded in association with the email message.

At least one other aspect of the present disclosure is generally directed to a method for incorporating reactions in email messages. The method can include a computer system receiving, from a computing device, a first request for one or more images responsive to the computing device accessing an email message, generating, responsive to the first request, the one or more images using information indicative of reactions recorded in association with the email message, and sending the one or more images to the computing device for display in the email message. The one or more images when displayed in the email message can depict one or more first graphical elements representing one or more reactions to the email message. The method can include the computer system receiving, from the computing device, a second request for recording a first reaction to the email message responsive to the computing device interacting with a first interactive element rendered in the email message. The second request can be a request for a second page and can include an indicator of the first reaction. The method can include the computer system updating, responsive to the second request, the information indicative of the reactions recorded in association with the email message to account for the first reaction. The method can include the computer system sending the first page to the computing device for display. The first page can confirm the recording of the first reaction to the email message.

In some implementations, the first interactive element includes an image map overlaid over the one or more images when displayed within the email message. The indicator of the first reaction can include an identifier of the image map and an identifier of a first interactive area, of a plurality of interactive areas of the image map, with which the computing device interacted. Each graphical element of the one or more first graphical elements can represent a corresponding reaction and can be associated with a corresponding interactive area of the plurality of interactive areas of the image map. The method can further include the computer system identifying the first reaction using the identifier of the image map and the identifier of the first interactive area of the image map.

In some implementations, the second request can include at least one of a uniform resource locator (URL) including the indicator of the first reaction or a session cookie of the computing device. In some implementations, the one or more images include one or more interactive images. Each interactive image can depict a corresponding graphical element of the one or more first graphical elements and can represent a corresponding reaction of the one or more reactions. The first interactive element can include a first interactive image of the one or more interactive images. Each interactive image can be associated with a respective link including an identifier of the interactive image. The method can include the computer system receiving a first link associated with the first interactive image upon the computing device interacting with the first interactive image. The first link can represent the second request and can include an identifier of the first interactive image. The method can include the computer system identifying the first reaction based on the identifier of the first interactive image.

In some implementations, the first interactive element includes a link indicative of a second page including a plurality of interactive content items representing a plurality of reactions. Receiving the second request for recording the first reaction can include the computer system receiving, from the computing device, a third request for the second page responsive to the computing device interacting with the link rendered in the email message, providing, responsive to the third request, the second page to the computing device for display, and receiving, from the computing device, the second request for recording the first reaction to the email message responsive to the computing device interacting with an interactive content item of the plurality interactive content items in the second page.

In some implementations, the one or more images when displayed in the email message further depict a second graphic element indicative of a second page including one or more interactive content items representing one or more additional reactions. Receiving the second request for recording the first reaction can include the computer system receiving, from the computing device, a third request for the second page responsive to the computing device interacting with the first interactive element rendered in the email message, providing, responsive to the third request, the second page to the computing device for display, and receiving, from the computing device, the second request for recording the first reaction to the email message responsive to the computing device interacting with an interactive content item of the one or more interactive content items in the second page. The first interactive element can include an interactive area of an image map overlaid over the one or more images such that the interactive area overlaps the second graphical element, or an interactive image displayed in the email message and depicting the second graphical element. In some implementations, the method can further include the computer system receiving a third request for one or more images from a second computing device responsive to the second computing device accessing the email message, and generating the one or more second images using the updated information indicative of the reactions recorded in association with the email message. The method can include the computer system sending the one or more second images to the second computing device for display in the email message

In some implementations, the method can further include the computer system receiving a third request for one or more second images from the computing device responsive to the computing device refreshing the email message, and generating the one or more second images using the updated information indicative of the reactions recorded in association with the email message. The method can include the computer system sending the one or more second images to the computing device for display in the refreshed email message. In some implementations, the one or more first graphical elements depicted by the one or more images represent one or more reactions recorded in association with the email message.

At least one other aspect of the present disclosure is a non-transitory computer-readable medium storing computer-executable instructions. The computer-executable instructions, when executed by at least one processor, can cause the at least one processor to receive, from a computing device, a first request for one or more images responsive to the computing device accessing an email message, generate, responsive to the first request, the one or more images using information indicative of reactions recorded in association with the email message, and send the one or more images to the computing device for display in the email message. The one or more images when displayed in the email message depict one or more first graphical elements representing one or more reactions to the email message. The at least one processor can receive, from the computing device, a second request for recording a first reaction to the email message responsive to the computing device interacting with a first interactive element rendered in the email message. The one or more processors can send the first page to the computing device for display. The second request can be a request for a first page and can include an indicator of the first reaction. The at least one processor can update, responsive to the second request, the information indicative of the reactions recorded in association with the email message to account for the first reaction. The at least one processor can send the first page to the computing device for display. The first page can confirm the recording of the first reaction to the email message.

At least one aspect of the present disclosure relates to a computer system including one or more processors and at least one memory that stores computer-executable instructions. The computer-executable instructions, when executed by the one or more processors, can cause the one or more processors to receive, from a first computing device, a request to incorporate reactions in an email message, and provide, to the first computing device, software instructions for embedding within the email message. The software instructions, when executed by the second computing device accessing the email message, can cause the second computing device to (i) send, to a computer system, a first request for one or more images upon the second computing device accessing the email message, (ii) receive, responsive to the first request, the one or more images from the computer system, the one or more images generated using information indicative of reactions recorded in association with the email message, (iii) display the one or more images in the email message, and (iv) send, to the computer system, a second request for recording a first reaction to the email message upon the second computing device interacting with the first interactive element rendered in the email message. The one or more images when displayed in the email message can depict one or more first graphical elements representing one or more reactions to the email message. Displaying the one or more images in the email message can include rendering a first interactive element in the email message. The second request can be a request for a first page and including an indicator of the first reaction.

At least one other aspect of the present disclosure relates to a method comprising one or more processors receiving, from a first computing device, a request to incorporate reactions in an email message, and providing, to the first computing device, software instructions for embedding within the email message. The software instructions, when executed by the second computing device accessing the email message, can cause the second computing device to (i) send, to a computer system, a first request for one or more images upon the second computing device accessing the email message, (ii) receive, responsive to the first request, the one or more images from the computer system, the one or more images generated using information indicative of reactions recorded in association with the email message, (iii) display the one or more images in the email message, and (iv) send, to the computer system, a second request for recording a first reaction to the email message upon the second computing device interacting with the first interactive element rendered in the email message. The one or more images when displayed in the email message can depict one or more first graphical elements representing one or more reactions to the email message. Displaying the one or more images in the email message can include rendering a first interactive element in the email message. The second request can be a request for a first page and including an indicator of the first reaction.

At least one aspect of the present disclosure relates to a non-transitory computer-readable medium storing computer-executable instructions. The computer-executable instructions, when executed by one or more processors, can cause the one or more processors to receive, from a first computing device, a request to incorporate reactions in an email message, and provide, to the first computing device, software instructions for embedding within the email message. The software instructions, when executed by a second computing device accessing the email message, can cause the second computing device to (i) send, to a computer system, a first request for one or more images upon the second computing device accessing the email message, (ii) receive, responsive to the first request, the one or more images from the computer system, the one or more images generated using information indicative of reactions recorded in association with the email message, (iii) display the one or more images in the email message, and (iv) send, to the computer system, a second request for recording a first reaction to the email message upon the second computing device interacting with the first interactive element rendered in the email message. The one or more images when displayed in the email message can depict one or more first graphical elements representing one or more reactions to the email message. Displaying the one or more images in the email message can include rendering a first interactive element in the email message. The second request can be a request for a first page and including an indicator of the first reaction.

These and other aspects and implementations are discussed in detail below. The foregoing information and the following detailed description include illustrative examples of various aspects and implementations, and provide an overview or framework for understanding the nature and character of the claimed aspects and implementations. The drawings provide illustration and a further understanding of the various aspects and implementations, and are incorporated in and constitute a part of this specification. Aspects can be combined and it will be readily appreciated that features described in the context of one aspect of the invention can be combined with other aspects. Aspects can be implemented in any convenient form. For example, by appropriate computer programs, which may be carried on appropriate carrier media (computer readable media), which may be tangible carrier media (e.g. disks) or intangible carrier media (e.g. communications signals). Aspects may also be implemented using one or more suitable apparatuses, which may take the form of programmable computers running computer programs arranged to implement the aspect. As used in the specification and in the claims, the singular form of ‘a’, ‘an’, and ‘the’ include plural referents unless the context clearly dictates otherwise.

DETAILED DESCRIPTION

Below are detailed descriptions of various concepts related to, and implementations of, techniques, approaches, methods, apparatuses, and systems for incorporating reactions, e.g., emoji reactions, in electronic messages (e.g., email messages) and monitoring reactions selected by recipients of the electronic messages. The various concepts introduced above and discussed in greater detail below may be implemented in any of numerous ways, as the described concepts are not limited to any particular manner of implementation. Examples of specific implementations and applications are provided primarily for illustrative purposes.

In social networks, some messaging applications and/or teleconferencing applications, users can express their reactions to posts or messages generated by other users. Specifically, such platforms or applications provide animated “emoji” reactions that users can select in connection with messages or posts. In response, the teleconferencing platforms, messaging applications and/or social networks record or keep track of the reactions selected by users over time, and update the posts or messages to indicate or reflect the recorded reactions. In particular, the teleconferencing platforms, messaging applications and/or social networks usually add interactive graphical elements in shared content to allow users with whom the content is shared to select from various possible reactions, and add images or visual representations in the shared content depicting recorded reactions. The images or visual representations depicting recorded reactions are updated with each new recorded reaction. The reactions as used herein can reflect the users' feelings or opinions about the shared content.

Unlike the teleconferencing platforms, messaging applications and/or social networks, some electronic messaging systems or services, such as email systems, do not include functionalities or processes for incorporating reactions in electronic messages (e.g., email messages). For instance, content of email messages is static and cannot be changed once the email messages are sent. While shared content in teleconferencing platforms, some messaging applications and/or social networks is confined to a single system or platform, email messages once sent can traverse different email platforms associated with different email providers. In other words, the email account of the sender and the email account(s) of the recipient(s) can be associated with different email providers. As such, once the sender sends an email message to the recipient, the email provider associated with the email account of the sender will have no control on the email message. This characteristic of email systems makes it technically challenging to incorporate dynamic reactions in email messages.

The systems and methods described herein solve the above described technical problem and provide various processes for incorporating reactions in electronic messages and recording reactions selected by recipients of the electronic messages. The systems and methods described herein also allow for depicting visual representations of already recorded reactions in the electronic messages. In particular, when composing an electronic message, e.g., an email message, a user can select to incorporate reactions in the electronic message. In response, a data processing system (also referred to herein as a computer system) can insert executable instructions in the electronic message, e.g., before the electronic message is sent to the intended recipient(s), to allow for recording various reactions to the electronic message from recipients of the electronic message. When a recipient opens or accesses the electronic message, the computing device of the recipient can execute the instructions in the electronic message. When executed, the instructions can cause the computing device of the recipient to request and display one or more interactive visual representations of possible reactions. The computing device of the recipient can also display an indication of reactions already recorded in relation with the electronic message. The already recorded reactions can include reactions previously selected or made by other recipients of the electronic message.

The current recipient can select, or interact with, one of the interactive visual representations. In response, the computing device of the recipient can transmit an indication of the interaction to the data processing system, which in turn can record the reaction selected by the recipient. The data processing system can update data indicative of already recorded reactions based on the received indication. Upon the recipient refreshing the accessed electronic message or upon another recipient accessing the electronic message, the data processing system can generate and send a visual representation of the recorded reactions, based on the updated data, for display to the recipient or to the other recipient, e.g., within the electronic message. Accordingly, recipients of the electronic message can be presented with a visual representation of the up-to-date recorded reactions each time a recipient accesses an instance of the electronic message or refreshes an accessed instance of the electronic message.

The systems and methods described herein can incorporate reactions in electronic messages according to various embodiments. According to an example embodiment, the executable instructions can cause the computing device of the recipient to request one or more images from the data processing system responsive to opening or accessing an instance of the electronic message. In response, the data processing system can send the one or more images to the computing device of the recipient for display within the accessed instance of the electronic message. The one or more images can include visual representations of various possible reactions. The data processing system can also provide instructions for an image map to the computing device of the recipient. The computing device of the recipient can overlay the image map over the one or more images displayed within the instance of the email message to allow the recipient to select a reaction among the various possible reactions depicted in the one or more images.

According to another embodiment, the executable instructions can cause the computing device of the recipient to request a plurality of images or graphical representations from the data processing system responsive to opening or accessing an instance of the electronic message. In response, the data processing system can send the plurality of images or graphical representations to the computing device of the recipient for display within the accessed instance of the electronic message. Each of the images or graphical representations can depict a corresponding reaction of a plurality of possible reactions, and can be associated with a corresponding link (e.g., hyperlink or URL). The corresponding link can be viewed as, or can include information or parameters of, a request to record the corresponding reaction. The data processing system can also provide instructions for an image map to the computing device of the recipient. Upon the recipient interacting with an image of the plurality of images displayed within the electronic message, the computing device of the recipient can send a request, using the corresponding link, to a remote server to record the corresponding reaction. The remote server can update data indicative of recorded reactions associated with electronic message. The remote server may provide updated versions of the plurality images or graphical representations in new instances of the electronic message (e.g., instances requested upon the recipient refreshing the electronic message or upon other recipients requesting access to the electronic message) to reflect the updated recorded reactions.

According to another example embodiment, the executable instructions embedded in the electronic message can cause the computing device of the recipient, upon accessing an instance of the electronic message, to display a hyperlink of a page within the accessed instance of the electronic message. The page can include interactive visual representations of the various possible reactions. The page may also include indications of already recorded reactions in relation to the electronic message. Upon the recipient activating the hyperlink, the computing device can request and display the page. The recipient can interact with any of the interactive visual representations, and in response the computing device of the recipient can send an indication of the reaction made or selected by the recipient to the data processing system. Upon receiving the indication, the data processing system can update data indicative of recorded reactions in relation to the electronic message. The updated data can be reflected in the page pointed to by the hyperlink, e.g., upon refreshing the page. In other words, when accessed again by the same recipient or another recipient, the page can depict updated indications of the already recorded reactions in relation to the electronic message.

The systems and methods described herein provide an improvement over conventional electronic systems, e.g., email systems, by providing interactive items indicative of various possible reactions for display with electronic messages, upon accessing the electronic messages. The interactive items allow recipients to express their reactions to received electronic messages, such as email messages. Reactions made by different recipients can be recorded and up-to-date indications of the recorded reactions can be displayed within or with new instances (e.g., based on new access or refresh requests) of the electronic messages. Accordingly, the embodiments described herein make the content of electronic messages, e.g., email messages, dynamic and more interactive.

Referring now toFIG.1, illustrated is a block diagram of an example computer environment100for incorporating dynamic reactions in electronic messages, in accordance with one or more implementations. The computer environment100can include a plurality of client devices102a-102nreferred to hereinafter, either individually or collectively, as client device(s)102. The client devices102can include computing devices such as a desktop, a laptop, a tablet device or a smart phone, among others. Each of the client devices102can include, or can have access to, an application104for accessing user electronic accounts. The application104can include an email application, such as the OUTLOOK application, the GMAIL application or the YAHOO MAIL application, among other email applications. In some implementations, the application104can include a web browser. For instance, the client devices102can access an email service using a web browser. The application104can include an SMS application or an application for accessing other types of electronic messages.

Each client device102can include a local machine, computer, laptop, desktop, smart phone, tablet, personal digital assistant, set-top box for a television set, a smart television, or server device configured to communicate with other devices via the network110. The client device102can include a processor and a memory. The memory may store machine instructions that, when executed by the processor, cause the processor to perform one or more of the operations described herein, such as operations associated with the application104. The memory may also store data to effect presentation of one or more resources, content items, etc., on the computing device. The processor may include a microprocessor, an ASIC, an FPGA, a GPU, or combinations thereof. The memory may include, but is not limited to, electronic, optical, magnetic, or any other storage or transmission device capable of providing processor with program instructions. The memory may include a floppy disk, CD-ROM, DVD, magnetic disk, memory chip, ROM, RAM, EEPROM, EPROM, flash memory, optical media, or any other suitable memory from which processor can read instructions. The processor may execute computer-executable instructions to carry out the operations described herein. The instructions may include code from any suitable computer programming language such as, but not limited to, ActionScript®, C, C++, C #, HTML, Java®, JavaScript®, Perl®, Python®, Visual Basic®, and XML.

The computer environment100can include a data processing system106(also referred to herein as computer system106) and a plurality of electronic messaging servers108a-108mreferred to hereinafter, either individually or collectively, as electronic messaging server(s)108. The electronic messaging servers108can include, for example, email servers that provide email services to users and host their email accounts. The client devices102, the data processing system106and the electronic messaging servers108can be communicatively coupled through a communication network110. The data processing system106can communicate via the network110, for instance with at least one client device102. The network110may be any form of computer network that can relay information between the client devices102, the data processing system106, the electronic messaging servers108, and one or more content sources, such as web servers, amongst others. In some implementations, the network110may include the Internet and/or other types of data networks, such as a local area network (LAN), a wide area network (WAN), a cellular network, a satellite network, or other types of data networks. The network110may also include any number of computing devices (e.g., computers, servers, routers, network switches, etc.) that are configured to receive and/or transmit data within the network110. The network110may further include any number of hardwired and/or wireless connections. Any or all of the computing devices described herein (e.g., the data processing system106, the client devices102, the computer system900, etc.) may communicate wirelessly (e.g., via WiFi, cellular, radio, etc.) with a transceiver that is hardwired (e.g., via a fiber optic cable, a CAT5 cable, etc.) to other computing devices in the network110. Any or all of the computing devices described herein (e.g., the data processing system106, the computer system900, etc.) may also communicate wirelessly with the computing devices of the network110via a proxy device (e.g., a router, network switch, or gateway).

The data processing system106can include one or more computing devices, such as computer servers, configured to implement and execute functionalities and/or processes of the data processing system106. The data processing system106can include at least one processor and a memory (e.g., a processing circuit). The memory can store computer-executable instructions that, when executed by the processor, cause the processor to perform one or more of the operations described herein. The processor may include a microprocessor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a graphics processing unit (GPU), or combinations thereof. The memory may include, but is not limited to, electronic, optical, magnetic, or any other storage or transmission device capable of providing the processor with program instructions. The memory may further include a floppy disk, CD-ROM, DVD, magnetic disk, memory chip, ASIC, FPGA, read-only memory (ROM), random-access memory (RAM), electrically erasable programmable ROM (EEPROM), erasable programmable ROM (EPROM), flash memory, optical media, or any other suitable memory from which the processor can read instructions. The instructions may include code from any suitable computer programming language. The data processing system106can include one or more computing devices or servers that can perform various functions as described herein. The data processing system106can include any or all of the components and perform any or all of the functions of the computer system800described herein in conjunction withFIG.8.

The data processing system106can include various functional components. For instance, the data processing system106can include an instructions provider112, a reaction recorder114and an image generator116. Each of these functional components can be implemented as software modules, hardware components, firmware components or a combination thereof. For instance, each of the functional components112,114and116can be implemented as software instructions that are executable by one or more processors to perform the corresponding functions or processes. In some implementations, one or more functional components (e.g., any combination of the functional components112,114and116) of the data processing system106can be implemented by one or more email servers108.

The instructions provider112can be configured to provide executable instructions to client devices102for embedding within electronic messages. The executable instructions when executed by client devices102accessing or drafting an electronic message can cause one or more interactive elements or data items, e.g., a link or one or more interactive images, to be incorporated in the electronic message. The one or more interactive elements and/or the instructions embedded in the electronic message allow recipients of the electronic message to electronically express their reactions to the electronic message and to report the expressed reactions to the data processing system106or the reaction recorder114. The reaction recorder114can be configured to receive indications of reactions made or selected by recipients of the electronic message and maintain a record and/or keep track of already registered (or selected) reactions in relation with the electronic message. The image generator116can generate and/or provide images for display within or with the electronic message. The images provided by the image generator116can include images indicative of possible reactions (e.g., reaction bars or separate images depicting separate reactions) and/or images depicting statistics or information of already recorded reactions. The functions and/or processes performed by each of the functional processes112,114and116and/or the data processing system106are discussed in further detail below in relation withFIGS.2-8.

Referring now toFIG.2, a flowchart illustrating a method200of incorporating dynamic reactions into electronic messages is shown, according to example embodiments. In brief overview, the method200can include the data processing system106receiving a request from a client device102to incorporate reactions or visual representations thereof in an electronic message (STEP202), and the data processing system106sending software instructions to the computing device102for embedding within the electronic message (STEP204). The electronic message can include an email message, e.g., drafted by the c computing device102and/or sent to one or more recipients. The software instructions, when executed by a second computing device accessing the electronic message, can cause the second computing device to (i) send, to the computer system106, a first request for one or more images upon the second computing device accessing the electronic message, (ii) receive, responsive to the first request, the one or more images from the computer system106, (iii) display the one or more images in the electronic message, and (iv) send, to the computer system106, a second request for recording a first reaction to the electronic message upon the second computing device interacting with an interactive element rendered in the email message. The one or more images can be generated using information indicative of reactions recorded in association with the electronic message. The one or more images when displayed in the electronic message can depict one or more first graphical elements representing one or more reactions to the electronic message. Displaying the one or more images in the electronic message can include rendering the first interactive element in the email message. The second request can be a request for a first page and including an indicator of the first reaction.

The method200can include the data processing system (or computer system)106receiving a request from a client device102to incorporate reactions in an electronic message, e.g., an email message drafted, sent or accessed by the computing device102(STEP202). For instance, when a user is composing an email message, the user can select to incorporate reactions into the email message. In response, the corresponding computing device102can send a request to the data processing system106to incorporate reactions in the electronic message. The data processing system106or the instructions provider112can send software instructions to the client device102for embedding within the electronic message. In some implementations, the data processing system106or the instructions provider112can provide the software instructions to an electronic messaging server108, such as an email server associated with an email system hosting the email account of the user (e.g., sender of the email message). When the sender sends the email message, the email server can embed the software instructions into the email message, e.g., prior to forwarding the email message to email accounts of intended recipients.

Referring now toFIGS.3A and3B, screenshots of two instances300A and300B of a window300for composing an email message are shown, according to example embodiments. The application104(e.g., email application or a browser) can display the window300on a display device associated with a client device of a user (e.g., a sender) responsive to the user initiating composing of an email message. The window300can include a selectable icon302to enable or disable reactions within the email message being composed. In the instance300A of the window300the icon302is not selected yet. In the instance300B, the icon302is selected. Responsive to selecting the icon302by the sender, the client device102of the sender can send a request to the data processing system106. The request can be indicative of the user selection to incorporate reactions into the email message being composed.

The method200can include the data processing system106or the instructions provider112sending software instructions for embedding within the electronic message (STEP204). The data processing system106or the instructions provider112can respond to the received request by sending the software instructions to the client device102of the sender for embedding in the electronic message. The client device102of the sender can embed the received software instructions into the electronic message. The software instructions when embedded in the electronic message (e.g., email message) are not to be rendered by the client device102in the window300or as part of the content of the email message. Instead, the embedded executable software are for execution by client devices102accessing the email message.

In some implementations, the client device102of the sender can execute at least part of the software instructions embedded into the electronic message being composed. For instance, upon embedding the software instructions within the electronic message, the client device102of the sender can send a request to the data processing system106for one or more images depicting various reactions to the electronic message. As depicted inFIG.3B, the client device102of the sender can display a received image304within the email message being composed. For example, the client device102of the sender can display the received image304at the end (or at the bottom) of the email message being composed.

The image304can depict a reaction bar including a plurality of (or one or more) graphical elements, such as graphical elements306a-f. The graphical elements can include one or more graphical elements, such as graphical elements306a-e, indicative of various possible reactions. The image304can include a graphical element, e.g., graphical element306f, to indicate that additional graphical elements representing other reactions (other than those depicted in the image304) can be accessed. Displaying the image304(or the reaction bar) to the sender in the email message (or electronic message) being composed provides a visual picture to the sender of how the email message will look like when sent and opened by intended recipients. The image304displayed in the email message being composed also provides the sender a visual indicator that the request to incorporate reactions into the email message was successfully handled.

In some implementations, the request to incorporate reactions in the electronic can be a request for a plurality of images. Each image can depict a separate reaction (e.g., emoji reaction). Each image can be associated with a corresponding hyperlink (e.g., URL). The software instructions may cause display of the plurality of images to the sender within the electronic message to indicate successful incorporation of the reactions into the electronic message. In some other implementations, the request for reactions can be a request for a hyperlink to be displayed within the electronic message. The hyperlink can be a link of a web page (e.g., to be displayed in a pop-up window when the hyperlink is activated) that includes a plurality of interactive images or graphical representations, each of which representing a separate reaction (e.g., emoji reaction). The executable instructions may cause display of the hyperlink to the sender within the electronic message to indicate successful incorporation of the reactions into the electronic message.

The sender can send the electronic message (e.g., email message) to intended recipients and the software instructions embedded in the electronic message can be configured to be executed by computing devices accessing the electronic message. For instance, the software instructions embedded in the electronic message can be configured to be executed each time a recipient of the intended recipients opens, accesses or refreshes the received electronic message. Responsive to the recipient opening the electronic message, the corresponding client device102can immediately execute the software instructions embedded within the electronic message. When executed, the instructions can cause the client device102of the recipient to (i) send, to the computer system106, a first request for one or more images upon the client device102of the recipient accessing the electronic message, (ii) receive, responsive to the first request, the one or more images from the computer system106, (iii) display the one or more images in the electronic message, and (iv) send, to the computer system106, a second request for recording a first reaction to the electronic message upon the second computing device interacting with a first interactive element rendered in the email message.

The client device102of the recipient can send the first request to the data processing system106. The first request can be a request for one or more images for display within the accessed electronic message. For instance, the software instructions can include a first uniform resource locator (URL) of a server of the data processing system106that is used to request the image(s) from the server. The requested image(s) can be generated by the data processing system106using information indicative of reactions recorded (so far) in association with the electronic message. For instance, the data processing system106can check whether any reactions were already recorded, e.g., by one or more other recipients, in association of the electronic message. If one or more reactions were previously recorded, the data processing system106can generate the one or more images to depict graphical elements representing the previously recorded reaction(s). If no reactions were previously recorded, the data processing system106can generate the one or more images to depict graphical elements representing default or randomly selected reaction(s).

Upon receiving the image(s), the executable instructions can cause the client device102of the recipient to display the received image(s) within the electronic message accessed (or displayed) by the client device102of the recipient. Similar to the image304, the image(s) displayed within the electronic message accessed by the client device102of the recipient can include one or more graphical elements representing or indicative of one or more possible reactions (e.g., emoji reactions). For instance, the graphical elements can include graphical symbols, animated stickers, digital sub-images, icons or a combination thereof among others. Each graphical element can be indicative of a corresponding emotional response, idea or opinion that a user (e.g., the recipient) may express in relation with the received electronic message. The displayed image(s) can depict reactions previously recorded (e.g., by one or more other recipients) in association with the electronic message. If no reactions were recorded yet in association with the electronic message, the image(s) can depict one or more default or randomly selected reactions. The displayed image(s) can be interactive or non-interactive. For instance, one or more non-interactive images depicting reactions previously recorded in association with the electronic message can be displayed in the electronic message with a hyperlink that is used to record additional reactions. The received image(s) can include one or more images depicting graphical elements representing one or more reactions and an image map overlaid over the one or more images when displayed in the electronic message. The received image(s) can include multiple images corresponding to separate reactions that re displayed in the electronic message, such that each image is associated with a corresponding hyperlink.

In some implementations, the software instructions embedded within the electronic message can include (or can request and receive from the data processing system106) a software code (e.g., an HTML code) that defines an image map. The software code, when executed by the client device102of the recipient, can cause the image map to be overlaid over the image(s) displayed within the electronic message accessed by the client device102of the recipient. The image map can define a plurality of interactive (e.g., clickable) areas, also referred to herein as slices. For instance, the interactive areas can be defined using one or more <area> tags. Each interactive area can overlap or coincide with a corresponding graphical element of the image(s) displayed in the electronic message, when the image map is overlaid over the image(s) within the electronic message. The image map, when overlaid over the image(s) displayed within the electronic message accessed by the recipient, allows the recipient to select a reaction among the possible reactions represented by the graphical elements to be recorded. In a way, the image map transforms static image(s) displayed within the electronic message into interactive image(s) such that different image regions corresponding to different predefined areas or slices of the image map can be selected. In other words, the image(s) displayed within in the accessed electronic message together with the image map overlaid over it/them can be viewed as forming interactive graphical elements. The graphical elements corresponding to different predefined areas or slices of the image map can represent previously recorded reactions or, if no reactions were recoded yet, default or randomly selected reactions.

The software instructions embedded within the electronic message can include (or can receive from the data processing system106) an identifier of the image (e.g., reaction bar) displayed within the accessed electronic message and/or separate identifiers of the predefined interactive areas or slices of the image map. Upon the recipient (or the user of the client device102accessing the electronic message) selects one of the reactions or corresponding graphical elements (e.g., by clicking or tapping on the corresponding display area), the executable instructions can cause the client device102to send a request for recording the corresponding reaction to the electronic message. The request can be or can include a request for a page. The request can include the identifier of the image and an indicator of the interactive area of the image map with which the recipient or the corresponding client device102interacted.

In the case where multiple interactive images corresponding to separate reactions are displayed in the electronic message, each image can be associated with a corresponding hyperlink (e.g., URL). The URL can include an identifier of the corresponding image. When the recipient interacts with an image of the plurality of images displayed within the electronic message, the client device102of the recipient can send a request to the data processing system106using the corresponding hyperlink or URL. The data processing system106or a server thereof can use the image identifier in the hyperlink or URL to identify or determine the reaction made by the recipient. The reactions depicted by the interactive images can represent reactions previously recorded in association with the electronic message or default/randomly selected reactions if no reactions were recorded yet in association with the electronic message.

In some implementations, the received image(s) can be non-interactive image(s) depicting one or more reactions (e.g., previously recorded or default reactions) and can be displayed with a hyperlink within the electronic message. The recipient can activate the hyperlink to cause display of a corresponding web page, e.g., in a pop-up window. The web page can include a plurality of interactive images corresponding to separate reactions. The recipient can interact with one of the images in the web page, and a server associated with the web page can record the recipient's reaction. The server associated with the web page can be a server of the data processing system106. The server can maintain a data structure mapping each interactive image in the web page (or an identifier thereof) to the corresponding reaction, and use the data structure to record reactions from various recipients.

Processes and/or steps performed by the software instructions embedded within the electronic message, when executed by the client device102accessing the electronic message, are further discussed below with regard toFIGS.4-7C.

Referring now toFIG.4, a flowchart illustrating a method400for incorporating reactions in electronic messages (e.g., email messages) is shown, according to example embodiments. In brief overview, the method400can include receiving, from a computing device, a first request for one or more images to display in an electronic message (STE402), generating, responsive to the first request, the one or more images using information indicative of reactions recorded in association with the electronic message (STEP404), and sending the one or more images to the computing device for display in the electronic message (STEP406). The method400can include receiving, from the computing device, a second request to record a first reaction to the electronic message (STEP408), updating the information indicative of the reactions recorded in association with the electronic message (STEP410), and sending a page confirming the recording of the first reaction for display on the computing device (STEP412).

The method400can include the computer system106receiving, from a computing device102(e.g., of a recipient of the electronic message), a first request for one or more images to display in an electronic message (STE402). As discussed above with regard toFIG.2, the electronic message (e.g., email message) can include software instructions embedded therein. The software instructions (e.g., HTML code), when executed by the computing device102of the recipient of the electronic message, can cause the computing device102to send the first request to the computer106in response to the computing device102accessing or opening the electronic message (e.g., accessing an email message from recipient's Inbox). The recipient or the corresponding client device102can trigger access or opening of the electronic message using a web browser or an application104(e.g., email application) running on the client device102. The software instructions embedded in the electronic message can include a first hyperlink (e.g., URL) that is used by the computing device102to request the one or more images to be displayed in the electronic message.

The method400can include the computer system106generating, responsive to the first request, the one or more images using information indicative of reactions recorded in association with the electronic message (STE404). The computer system106can check or determine whether any reactions were previously recorded in association with the electronic message. The first request (or the corresponding URL) can include an identifier of the electronic message. The computer system106can assign or generate the identifier of the electronic message as part of providing the software instructions to the computing device102of the sender of the electronic message. If the computer system106determines that one or more reactions were previously recorded (e.g., by one or more other recipients of the electronic message) in association with the electronic message, the computer system106can generate the one or more images to include graphical elements representing types of previously recorded reactions. The computer system106may generate the one or more images may to further depict statistics of the reactions previously recorded in association with the electronic message. The computer system106may maintain one or more data structure storing the information indicative of the reactions recorded in association with the electronic message. If the computer system106determines that no reaction was recorded in association with the electronic message, the computer system106can generate the one or more images to include graphical elements representing default or randomly selected types of recorded reactions.

As discussed above in relation withFIG.2, the one or more images can be non-interactive or interactive. For instance, the computer system106can generate an image map (or instructions to implement an image map) to be overlaid over the one or more images and having one or more interactive areas. Each interactive area of the image map can correspond or can be configured to overlap with a corresponding graphical element of the one or more images when displayed in the electronic message. In generating the one or more images, the computer system106can generate interactive images, such that each image is associated with a corresponding hyperlink (or URL). Each image of the one or more images can be associated with corresponding instructions (e.g., HTML executable instructions) and including the corresponding URL. The corresponding instructions can cause the corresponding hyperlink or URL to be sent to the computer system106upon the computing device102interacting with the image. In some implementations, the one or more images can be non-interactive images to be displayed in the electronic message with a hyperlink of web page. The web page can include interactive graphical elements corresponding to different possible reactions that can be recorded in association with the electronic message.

The method400can include the computer system106sending the one or more images to the computing device102of the recipient for display in the electronic message (STEP406). Sending the one or more images can include sending the image map (or instructions thereof) to the computing device102. In the case where the one or more images are interactive images associated with different hyperlinks or URLs, sending the one or more images can include sending the corresponding hyperlinks and/or instructions associated with each interactive image to the computing device102of the recipient. In the case of non-interactive image(s) to be displayed with a hyperlink of the web page including interactive graphical elements corresponding to different possible reactions, the computer system106can send only the one or more images (e.g., the hyperlink is included in the software instructions embedded in the electronic message) or may further send the hyperlink of the web page to the computing device102of the recipient.

Upon receiving the one or more images, the computing device102of the recipient can display the image(s) in the electronic message. The image(s) can include one or more graphical elements representing one or more reactions (e.g., emoji reactions). The graphical elements can include emoji graphics, digital animated stickers, sub-images, icons and/or graphical symbols depicting or indicative of possible or available reactions. The software instructions embedded within the electronic message can cause the client device102accessing the electronic message to display the received image(s) within the accessed electronic message.

Referring now toFIGS.5A-5D, various screenshots of an example email message500with reactions incorporated as displayed on a recipient client device102are shown, according to example embodiments.FIGS.5A-5Dillustrate different ways of incorporating reactions in email message500. InFIGS.5A, the email message500includes an image502representing the image received from the data processing system106and including graphical elements indicative of various possible reactions. The image502depicts a reaction graphic or a reaction bar (e.g., emoji reaction bar) including emoji graphics504a-e. For instance, the emoji graphic504adepicts a thumb's up reaction, the emoji graphic504bdepicts a heart representing a “love it” reaction, the emoji graphic504cdepicts a smiling face, the emoji graphic504ddepicts a face with open mouth to express surprise or shock, and the emoji graphic504edepicts a sad face. It is to be noted, that other digital images or graphics, e.g., other emoji graphics such as a smiling face with heart-eyes or digital animated stickers among others, can be used in the image502to represent various reactions. The image502also includes the graphical element504ffor accessing or viewing additional graphical elements indicative of other reactions beyond those shown in the image502. The graphical elements504a-504ecan represent types of reaction that were previously recorded in association with the email message500or types of reactions selected randomly or by default (e.g., if no reactions were recorded yet in association with email message500). In some implementations, image502can depict statistics of previously recorded reactions. For example, each of the graphical elements504a-504ecan depict a corresponding number representing a number of times the corresponding reaction was recorded in association with email500.

The screenshot inFIG.5Billustrates an image map506that is overlaid over the image (or reaction bar)502in the email message500. The image map506includes a plurality of interactive areas508a-508f. Interactive area508aoverlaps with and is used to interact with graphical element504a, interactive area508boverlaps with and is used to interact with graphical element504b, interactive area508coverlaps with and is used to interact with graphical element504c, interactive area508doverlaps with and is used to interact with graphical element504d, interactive area508eoverlaps with and is used to interact with graphical element504e, and interactive area508foverlaps with and is used to interact with graphical element504f. The image map506and the corresponding interactive areas508a-508fcan be transparent or can be shaded.

The image map506can be implemented via the software instructions embedded within the email message500or can be implemented via a piece of code received from the data processing system106with image502. In either case, the software instructions or the piece of code cause image map506to be overlaid over the image502displayed within email message500when the email message500is accessed and displayed by the recipient client device102. The recipient can interact with (e.g., click or tap) any of the interactive areas508a-508eof the image map to select the corresponding graphic element, e.g., any of emoji graphics504-504ein the image502. Responsive to the recipient's selection, the software instructions embedded within the email message500and executed by the client device102of the recipient can cause the client device102to detect the selection and, in response, send a request to the data processing system106to record or register the selected reaction.

InFIG.5C, the email message500includes multiple interactive images510a-510fdisplayed therein. Each of the images510a-510edepicts a corresponding reaction, while image510fdepicts a symbol indicative of additional reactions that can be accessed, e.g., via a link of web page. Each of the images510a-510ecan be associated with a corresponding link and corresponding instructions. The recipient computing102can receive images510a-510eand corresponding executable instructions (e.g., HTML instructions) from the data processing system106. For each image of images510a-510e, the corresponding instructions can be executed by the computing device102accessing the email message500upon the computing device102interacting with the image to send a request to the data processing system106to record the reaction corresponding to the image. The request to record the interaction is sent using the corresponding link, which can be a link of a confirmation page and can include an identifier of the image with which the computing device102interacted. Images510a-510ecan depict types of reactions previously recoded in association with the email message500, or may depict default or randomly selected reactions if no reactions were recorded yet in association with email message500. In some implementations, images510a-510emay further depict statistics of recorded reactions (e.g., number of times different types of reactions have been recorded.

The screenshot inFIG.5Ddepicts the case where non-interactive images512aand512band a hyperlink514are displayed in email message500. The images512aand512bcan depict types and statistics of reactions previously recorded in association with the email message500. The hyperlink514represents a link of webpage that can be used to record reactions to the email message500. The web page associated with hyperlink514can include a plurality of interactive content items representing various possible reactions. The computing device102accessing the email message500can interact with the hyperlink514to access the interactive content items representing various possible reactions, and select a reaction among the possible reactions. The computing device102accessing the email message500can receive the images512aand512bfrom the data processing system106, whereas the hyperlink514can be included in the software instructions embedded in the email message500or can be received from the data processing system106

The method400can include the data processing system106receiving a second request, from the recipient client device102, to record or register a reaction to the electronic message (STEP408). The computer system106can receive, from the computing device102accessing the electronic message, a second request for recording the reaction to the electronic message, responsive to the computing device102interacting with an interactive element rendered in the electronic message. Referring back toFIGS.5A-5D, the interactive element can include an interactive area, e.g., among interactive areas508a-508f, of image map506, an interactive image of interactive images510a-510for hyperlink514. The second request can be a request for a page and can include an indicator of the reaction to be recorded.

In the case where an image map is overlaid over one or more images displayed in the electronic message as shown inFIGS.5A and5B, the request to record the reaction can include an identifier of the image (or the reaction bar)502and an identifier of the interactive area or slice (among interactive areas508a-508e) of the image map506with which the recipient or the respective client device102interacted. The identifier of the image depicting the graphical elements indicative of various reactions, such as image502, and/or the identifiers of separate interactive areas or slices508a-508eof the image map506can be received from the data processing system106(e.g., with image502and as part of executable instructions of the image map506). Each interactive area or slice, e.g., among areas508a-508d, of the image map506can have a corresponding identifier. The software instructions initially embedded in the electronic message or executable instructions of the image map506can cause the client device102to detect the interactive area of the image map that the recipient interacted with, and include the corresponding identifier in the request to record the reaction associated with interactive area with which the client device102interacted.

In some implementations, each interactive area of the image map can be associated with a corresponding link or URL. The URLs can be provided by the data processing system106, e.g., as part of image map. Each URL can include the identifier of the image502and the identifier of the corresponding interactive area of the image map. The software instructions initially embedded in the electronic message and/or instructions associated with the image map506can detect interaction with a given interactive area of the image map506, and in response send the corresponding URL to the data processing system106. In some implementations, a URL may be included in the software instructions initially embedded in the electronic message, and the computing device102may append the URL with the identifier of the image502and the identifier of the interactive area of the image map with which the computing device102interacted. The URL can point to a server of the data processing system106associated with reaction recorder114, and can represent the request to record the reaction.

In the case where multiple images are received and displayed in the electronic message as shown inFIG.5C, the interactive element can be one of the interactive images510a-510f. The request to record the reaction can include an identifier of the interactive image with which the computing device interacted. The request can be, or can include, the link or URL corresponding to the interactive image with which the computing device interacted. The link or URL can include, or can be appended to include, identifier of the interactive image with which the computing device interacted. The request, in general, can include an identifier of the e

In the case where non-interactive images are displayed in the electronic message with a hyperlink of a web page as shown inFIG.5D, the interactive element can be the hyperlink514. In response to an interaction with the hyperlink104, the computing device102can send a request for the corresponding web page. The computer system106or server can provide, the web page responsive to the request, and computing device can display the received web page. The computing device102can interact with an interactive content item in the web page representing a reaction, and the web page can cause the computing device102to send a request to the computer system106to record the reaction. The request to record the reaction can include an identifier of the interactive content item with which the computing device102interacted. As such, receiving the request for recording the first reaction, includes receiving, from the computing device102, a request for the web page corresponding to the hyperlink (responsive to the computing device102interacting with the hyperlink514rendered in the email message), providing, responsive to the request, the web page to the computing device102for display, and receiving, from the computing device102, the request for recording the reaction to the electronic/email message responsive to the computing device102interacting with an interactive content item of the plurality interactive content items in the web page corresponding to the hyperlink (e.g., hyperlink514).

In some implementations, the request to record can include a session cookie. For instance, if the electronic or email message is accessed via a browser, the web server providing the web site associated with the email message can send a cookie to the browser. The client device102can retrieve the cookie from the browser cache and include the cookie in the request to record the reaction to be sent to the data processing system106.

The data processing system106or the reaction recorder114can receive the request to record. The request to record can be or can include a request for a page or web page. The requested page can be a page confirming successful recording or registration of the reaction.

In some implementations, the recipient may be interested in a reaction that is not depicted in the image502or in the interactive images510a-510e. The recipient or the corresponding client device102can interact with the interactive area508f(when the image map506is used) or with the interactive image510f(when multiple interactive images are used). Interaction with the interactive area508fof the image map506causes the computing device102to send a request for a web page including additional graphical elements (or interactive content items) representing additional reactions. Similarly, interaction with the interactive image510fcauses the computing device102to send a request for a web page including additional graphical elements (or interactive content items) representing additional reactions. The request for the webpage can be a URL pointing to a web page associated with the data processing system106. The data processing system106can receive the request for the page, and provide the page to the client device102for display, e.g., in a pop up window.

Referring now toFIGS.6A and6B, screenshots of the email message500with a requested page600of additional reactions are shown, according to example embodiments. The client device102can receive the requested page600from the data processing system106and display the page in a pop-up window. The web page600depicts various interactive items (e.g., interactive images, interactive icons or interactive graphical symbols or items among others)602representing additional reactions, e.g., beyond those shown in the image502. The recipient can select or interact with (e.g., click or tap) one of the interactive items602depicted in the web page600. For instance,FIG.6Bshows an example interaction with or selection of the interactive item depicting a smiling face with heart-eyes. Responsive to the selection of the interactive item, the client device102can send a request for recording the selected reaction as discussed above. In some implementations, the recipient can select multiple reactions.

The page600shown inFIGS.6A and6Bis typically displayed responsive to interacting with the interactive area508fof the image506ofFIG.5B. However, a similar page can be displayed by the computing device102in response to interacting with the interactive image510fofFIG.5Cor interacting with the hyperlink514ofFIG.5D. In all these cases, the recording of a reaction can be achieved by interacting with one of the interactive contentment items (or graphical elements) of the displayed page.

Upon receiving the request to record the reaction, the computer system106can identify the type of the reaction using one or more identifiers or indicators of the interactive element with which the computing device102interacted. For instance, when an image map506is used as described in relation withFIGS.5A and5B, the data processing system106can use the identifier of the image502and the identifier of the interactive area of the image map506received in the request to record the reaction to identify the type of reaction to be recorded. The data processing system106or the reaction recorder114can maintain a mapping, e.g., in a data structure such a lookup table, between identifiers of the interactive areas508a-508eof the image map506and corresponding graphical elements or reactions in the image502displayed in the email message500. The data structure can associate each interactive area identifier with the corresponding graphical element or reaction. The reaction recorder114can maintain multiple data structures or lookup tables each associated with a corresponding image displayed in a corresponding email message of a plurality of email messages (e.g., email messages associated with different senders, different recipients and/or different content). Each data structure or lookup table can be associated with or mapped to the identifier of the corresponding image (e.g., reaction bar). The reaction recorder114can identify the proper data structure or lookup table to use based on the identifier of the image received in the request to record the reaction (e.g., within the URL). Once the data structure is identified, the reaction recorder114can identify the type of reaction (or the corresponding graphical element) selected by the recipient using the identified data structure and the identifier of the interactive area of the image map received within the request to record the reaction.

In the case where multiple interactive images, such as images510a-510eofFIG.5C, are used, the data processing system106can determine the type of reaction to be recorded using the identifier of the interactive image in the request. In the case where a hyperlink, such as hyperlink514ofFIG.5D, is used, the data processing system106can determine the type of reaction to be recorded using the identifier of the interactive content item included in the request.

The method400can include the computer system106updating the information indicative of the reactions recorded in association with the electronic message (STEP410). The computer system106can update, responsive to the request to record the reaction, the information indicative of the reactions recorded in association with the email message to account for the reaction identified based on the request. The data processing system106or the reaction recorder114can keep track of reactions made in association with each electronic message and maintain data records indicative of such reactions. Upon identifying the type of reaction selected by the recipient, the data processing system106or the reaction recorder114can update the corresponding data record(s) to take into account the reaction selected by the recipient. For instance, the data processing system106or the reaction recorder114can increment a counter associated with the identified type of the reaction. The data records can include indications of the number of times each available reaction was selected by various recipients of the electronic message.

The data processing system106or the reaction recorder114can identify the corresponding data record(s) using, for example, the identifier(s) or indicator(s) in the request to record the reaction. In some implementations, the identifier of the image502, the identifier of the interactive area (e.g., among interactive areas508a-508e) of the image map506or other indicators of the reaction to be recorded can be specific to the electronic/email message. For instance, each electronic/email message incorporating reactions can be assigned a different image identifier, different image map identifier and/or different interactive image identifiers compared to other electronic/email messages.

The method400can include sending a page confirming the recording of the reaction for display on the computing device (STEP412). The data processing system106or the reaction recorder114can maintain multiple web pages each of which associated with a corresponding reaction (or the graphical element representing the reaction). For instance, each web page can include content confirming successful recording or registration of the corresponding reaction. The data processing system106or the reaction recorder114can select the web page to send to the client device102based on the identified type of the reaction at step404. The data processing system106or the reaction recorder114can send the selected or identified web page to the client device102to confirm successful recording or registration of the reaction selected by the recipient. Upon receiving the web page, the client device102can display the web page, e.g., in a pop-up window. The one or more processors can send the first page to the computing device for display. The first page can confirm the recording of the first reaction to the email message.

Referring now toFIGS.7A-7C, screenshots of the email message500with web pages702,704and706confirming successful recording of the reaction are shown, according to example embodiments. The web pages702,704and/or706can be displayed in pop-up windows.FIG.7Adepicts a web page confirming the selection of a “thumb's up” reaction. For example, the web page702can be sent by the data processing system106responsive to the recipient selecting graphical element504aof image502inFIG.5Aor interacting with corresponding interactive area508aofFIG.5B. The web page704confirms the selection of a “smiling face with heart-eyes” reaction or graphical symbol. For example, the web page704can be sent by the data processing system106responsive to the recipient selecting interactive content item602from web page600ofFIG.6B. The web page706depicts a confirming the recording of a “thumb's up” reaction responsive to interaction with interactive image510aofFIG.5C.

The recipient or the corresponding client device102can refresh the electronic/email message500after receiving the confirmation that the selected reaction(s) was/were recorded or registered. In response, the executable instructions embedded in the email message can cause the client device102of the recipient to send another request for the image(s) depicting recorded reactions. The data processing system106can receive the request sent by the client device102responsive to refreshing the email message500. Given that some reactions were recorded in relation with electronic email message, the image generator116can generate new image(s) using, at least in part, the updated information indicative of recorded reactions. The generated image(s) can depict at least part of the updated information indicative of recorded reactions. For instance, the generated image(s) can depict the number of times each reaction was recorded or registered. In some implementations, the generated image(s) can depict only reactions or corresponding graphical elements that were recorded at least once. In some implementations, each instance of the generated instances of the multiple images depicts a corresponding updated number of recorded reactions. The data processing system106can then send the generated image(s) to the client device102of the recipient for display in the refreshed instance of the email message, and the client device102can display the received image in the refreshed instance of the email message.

In some implementations, the data processing system106can receive a request for the image(s) depicting various reactions (associated with the electronic/email message) from another recipient or the corresponding client device102. For instance, the other recipient can access the electronic/email message from a respective email account, and in response, the corresponding client device102can send a request for the image to the data processing system106. Given that some reactions were recorded in relation with electronic/email message, the image generator can generate one or more new images using, at least in part, the updated information indicative of recorded reactions. The generated image(s( )an depict at least part of the updated information indicative of recorded reactions. For instance, the generated image(s) can depict the number of times each reaction was recorded or registered. In some implementations, the generated image(s) can depict only reactions or corresponding graphical elements that were recorded at least once. The data processing system106can then send the generated image(s) to the client device of the second recipient for display in the instance of the email message accessed by that client device102. Upon receiving the generated image, the client device102of the second recipient can display the received image in the instance of the email accessed by the second recipient.

FIG.8is a block diagram of a computer system800that can be used to implement the client device102, the computer server(s) of the data processing system106, the email servers108and other components described herein. The computing system800includes a bus805or other communication component for communicating information and a processor810coupled to the bus805for processing information. The computing system800can also include one or more processors810coupled to the bus for processing information. The computing system800also includes main memory815, such as a RAM or other dynamic storage device, coupled to the bus805for storing information, and instructions to be executed by the processor810. Main memory815can also be used for storing position information, temporary variables, or other intermediate information during execution of instructions by the processor810. The computing system800may further include a ROM820or other static storage device coupled to the bus805for storing static information and instructions for the processor810. A storage device825, such as a solid state device, magnetic disk or optical disk, is coupled to the bus805for persistently storing information and instructions. Computing device800may include, but is not limited to, digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, cellular telephones, smart phones, mobile computing devices (e.g., a notepad, e-reader, etc.) etc.

The computing system800may be coupled via the bus805to a display835, such as a Liquid Crystal Display (LCD), Thin-Film-Transistor LCD (TFT), an Organic Light Emitting Diode (OLED) display, LED display, Electronic Paper display, Plasma Display Panel (PDP), or other display, etc., for displaying information to a user. An input device830, such as a keyboard including alphanumeric and other keys, may be coupled to the bus805for communicating information and command selections to the processor810. In another implementation, the input device830may be integrated with the display835, such as in a touch screen display. The input device830can include a cursor control, such as a mouse, a trackball, or cursor direction keys, for communicating direction information and command selections to the processor810and for controlling cursor movement on the display835.

According to various implementations, the processes or methods described herein can be implemented by the computing system800in response to the processor810executing an arrangement of instructions contained in main memory815. Such instructions can be read into main memory815from another computer-readable medium, such as the storage device825. Execution of the arrangement of instructions contained in main memory85causes the computing system800to perform the illustrative processes or method ACTs described herein. One or more processors in a multi-processing arrangement may also be employed to execute the instructions contained in main memory815. In alternative implementations, hard-wired circuitry may be used in place of or in combination with software instructions to effect illustrative implementations. Thus, implementations are not limited to any specific combination of hardware circuitry and software.

Although an implementation of a computing system800has been described inFIG.8, implementations of the subject matter and the functional operations described in this specification can be implemented in other types of digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them.

The computing system such as the data processing system106can include clients and servers. For example, the data processing system106can include one or more servers in one or more data centers or server farms. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. In some implementations, a server transmits data (e.g., an HTML, page) to a client device (e.g., for purposes of displaying data to and receiving input from a user interacting with the client device). Data generated at the client device (e.g., a result of an interaction, computation, or any other event or computation) can be received from the client device at the server, and vice-versa.

Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results.

In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the separation of various system components in the implementations described above should not be understood as requiring such separation in all implementations, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products. For example, the computing devices or servers described herein can be single modules, logic devices having one or more processing modules, one or more servers, or part of a cloud computing environment.