Data detection

In some embodiments, a device determines a current context of a plurality of terms, in accordance with a determination that the current context is a first context, selects one or more terms in the plurality of terms based on a first word list as actionable terms, and in accordance with a determination that the current context is a second context, different from the first context, selects one or more terms in the plurality of terms as actionable terms based on a second word list, different from the first word list. In some embodiments, the device displays the plurality of terms, wherein one or more of the actionable terms are visually distinguished from other terms. In some embodiments, a device obtains related content associated with the actionable terms, and after obtaining the related content, concurrently displays a representation of the related content along with the plurality of terms.

FIELD OF THE DISCLOSURE

This relates generally to electronic devices that detect relevant data in communications.

BACKGROUND OF THE DISCLOSURE

Communication between people using electronic devices has increased significantly in recent years. These devices can be devices such as computers, tablet computers, televisions, multimedia devices, mobile devices, and the like.

These communications often consist of user-provided content (e.g., text, images, etc.) being transmitted from one electronic device to another. Enhancing these communications improves the user's experience with the device and decreases user interaction time, which is particularly important where input devices are battery-operated.

SUMMARY OF THE DISCLOSURE

The embodiments described in this disclosure are directed to one or more devices that optionally select terms in communications as actionable terms based on context-dependent word lists, and automatically populate the communications with content related to the communications, and one or more actions related to the above that the devices optionally perform. The full descriptions of the embodiments are provided in the Drawings and the Detailed Description, and it is understood that the Summary provided above does not limit the scope of the disclosure in any way.

DETAILED DESCRIPTION

In the following description of embodiments, reference is made to the accompanying drawings which form a part hereof, and in which it is shown by way of illustration specific embodiments that are optionally practiced. It is to be understood that other embodiments are optionally used and structural changes are optionally made without departing from the scope of the disclosed embodiments.

Exemplary Devices

Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communications device, such as a mobile telephone, that also contains other functions, such as PDA and/or music player functions. Exemplary embodiments of portable multifunction devices include, without limitation, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, Calif. Other portable electronic devices, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and/or touch pads), are, optionally, used. It should also be understood that, in some embodiments, the device is not a portable communications device, but is a desktop computer or a television with a touch-sensitive surface (e.g., a touch screen display and/or a touch pad). In some embodiments, the device does not have a touch screen display and/or a touch pad, but rather is capable of outputting display information (such as the user interfaces of the disclosure) for display on a separate display device, and capable of receiving input information from a separate input device having one or more input mechanisms (such as one or more buttons, a touch screen display and/or a touch pad). In some embodiments, the device has a display, but is capable of receiving input information from a separate input device having one or more input mechanisms (such as one or more buttons, a touch screen display and/or a touch pad).

In the discussion that follows, an electronic device that includes a display and a touch-sensitive surface is described. It should be understood, however, that the electronic device optionally includes one or more other physical user-interface devices, such as a physical keyboard, a mouse and/or a joystick. Further, as described above, it should be understood that the described electronic device, display and touch-sensitive surface are optionally distributed amongst two or more devices. Therefore, as used in this disclosure, information displayed on the electronic device or by the electronic device is optionally used to describe information outputted by the electronic device for display on a separate display device (touch-sensitive or not). Similarly, as used in this disclosure, input received on the electronic device (e.g., touch input received on a touch-sensitive surface of the electronic device) is optionally used to describe input received on a separate input device, from which the electronic device receives input information.

It should be appreciated that device100is only one example of a portable or non-portable multifunction device, and that device100optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. The various components shown inFIG. 1Aare implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and/or application specific integrated circuits. Further, the various components shown inFIG. 1Aare optionally implemented across two or more devices; for example, a display and audio circuitry on a display device, a touch-sensitive surface on an input device, and remaining components on device100. In such an embodiment, device100optionally communicates with the display device and/or the input device to facilitate operation of the system, as described in the disclosure, and the various components described herein that relate to display and/or input remain in device100, or are optionally included in the display and/or input device, as appropriate.

Memory102optionally includes high-speed random access memory and optionally also includes non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Access to memory102by other components of device100, such as CPU120and the peripherals interface118, is, optionally, controlled by memory controller122.

In some embodiments, peripherals interface118, CPU120, and memory controller122are, optionally, implemented on a single chip, such as chip104. In some other embodiments, they are, optionally, implemented on separate chips.

Touch-sensitive display112provides an input interface and an output interface between the device and a user. As described above, the touch-sensitive operation and the display operation of touch-sensitive display112are optionally separated from each other, such that a display device is used for display purposes and a touch-sensitive surface (whether display or not) is used for input detection purposes, and the described components and functions are modified accordingly. However, for simplicity, the following description is provided with reference to a touch-sensitive display. Display controller156receives and/or sends electrical signals from/to touch screen112. Touch screen112displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively termed “graphics”). In some embodiments, some or all of the visual output corresponds to user-interface objects.

Device100optionally also includes one or more optical sensors164.FIG. 1Ashows an optical sensor coupled to optical sensor controller158in I/O subsystem106. Optical sensor164optionally includes charge-coupled device (CCD) or complementary metal-oxide semiconductor (CMOS) phototransistors. Optical sensor164receives light from the environment, projected through one or more lens, and converts the light to data representing an image. In conjunction with imaging module143(also called a camera module), optical sensor164optionally captures still images or video. In some embodiments, an optical sensor is located on the back of device100, opposite touch screen display112on the front of the device, so that the touch screen display is enabled for use as a viewfinder for still and/or video image acquisition. In some embodiments, another optical sensor is located on the front of the device so that the user's image is, optionally, obtained for videoconferencing while the user views the other video conference participants on the touch screen display.

Device100optionally also includes one or more proximity sensors166.FIG. 1Ashows proximity sensor166coupled to peripherals interface118. Alternately, proximity sensor166is coupled to input controller160in I/O subsystem106. In some embodiments, the proximity sensor turns off and disables touch screen112when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call).

Device100optionally also includes one or more accelerometers168.FIG. 1Ashows accelerometer168coupled to peripherals interface118. Alternately, accelerometer168is, optionally, coupled to an input controller160in I/O subsystem106. In some embodiments, information is displayed on the touch screen display in a portrait view or a landscape view based on an analysis of data received from the one or more accelerometers. Device100optionally includes, in addition to accelerometer(s)168, a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information concerning the location and orientation (e.g., portrait or landscape) of device100.

Contact/motion module130optionally detects a gesture input by a user. Different gestures on the touch-sensitive surface have different contact patterns and intensities. Thus, a gesture is, optionally, detected by detecting a particular contact pattern. For example, detecting a finger tap gesture includes detecting a finger-down event followed by detecting a finger-up (lift off) event at the same position (or substantially the same position) as the finger-down event (e.g., at the position of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger-down event followed by detecting one or more finger-dragging events, and subsequently followed by detecting a finger-up (lift off) event.

In conjunction with RF circuitry108, audio circuitry110, speaker111, microphone113, touch screen112, display controller156, optical sensor164, optical sensor controller158, contact module130, graphics module132, text input module134, contact list137, and telephone module138, videoconferencing module139includes executable instructions to initiate, conduct, and terminate a video conference between a user and one or more other participants in accordance with user instructions.

In conjunction with touch screen112, display controller156, contact module130, graphics module132, text input module134, and camera module143, image management module144includes executable instructions to arrange, modify (e.g., edit), or otherwise manipulate, label, delete, present (e.g., in a digital slide show or album), and store still and/or video images.

In conjunction with RF circuitry108, touch screen112, display system controller156, contact module130, graphics module132, text input module134, e-mail client module140, and browser module147, calendar module148includes executable instructions to create, display, modify, and store calendars and data associated with calendars (e.g., calendar entries, to do lists, etc.) in accordance with user instructions.

In conjunction with RF circuitry108, touch screen112, display system controller156, contact module130, graphics module132, text input module134, and browser module147, the widget creator module150are, optionally, used by a user to create widgets (e.g., turning a user-specified portion of a web page into a widget).

In conjunction with touch screen112, display controller156, contact module130, graphics module132, and text input module134, notes module153includes executable instructions to create and manage notes, to do lists, and the like in accordance with user instructions.

In conjunction with touch screen112, display system controller156, contact module130, graphics module132, audio circuitry110, speaker111, RF circuitry108, text input module134, e-mail client module140, and browser module147, online video module155includes instructions that allow the user to access, browse, receive (e.g., by streaming and/or download), play back (e.g., on the touch screen or on an external, connected display via external port124), send an e-mail with a link to a particular online video, and otherwise manage online videos in one or more file formats, such as H.264. In some embodiments, instant messaging module141, rather than e-mail client module140, is used to send a link to a particular online video.

In some embodiments, device100is a device where operation of a predefined set of functions on the device is performed exclusively through a touch screen and/or a touchpad (whether included in device100or on a separate device, such as an input device). By using a touch screen and/or a touchpad as the primary input control device for operation of device100, the number of physical input control devices (such as push buttons, dials, and the like) on device100is, optionally, reduced.

FIG. 2illustrates a portable or non-portable multifunction device100having a touch screen112in accordance with some embodiments. As stated above, multifunction device100is described as having the various illustrated structures (such as touch screen112, speaker111, accelerometer168, microphone113, etc.); however, it is understood that these structures optionally reside on separate devices. For example, display-related structures (e.g., display, speaker, etc.) and/or functions optionally reside on a separate display device, input-related structures (e.g., touch-sensitive surface, microphone, accelerometer, etc.) and/or functions optionally reside on a separate input device, and remaining structures and/or functions optionally reside on multifunction device100.

FIG. 3is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface in accordance with some embodiments. Device300need not include the display and the touch-sensitive surface, as described above, but rather, in some embodiments, optionally communicates with the display and the touch-sensitive surface on other devices. Additionally, device300need not be portable. In some embodiments, device300is a laptop computer, a desktop computer, a tablet computer, a multimedia player device (such as a television or a set-top box), a navigation device, an educational device (such as a child's learning toy), a gaming system, or a control device (e.g., a home or industrial controller). Device300typically includes one or more processing units (CPU's)310, one or more network or other communications interfaces360, memory370, and one or more communication buses320for interconnecting these components. Communication buses320optionally include circuitry (sometimes called a chipset) that interconnects and controls communications between system components. Device300includes input/output (I/O) interface330comprising display340, which is typically a touch screen display. I/O interface330also optionally includes a keyboard and/or mouse (or other pointing device)350and touchpad355, tactile output generator357for generating tactile outputs on device300(e.g., similar to tactile output generator(s)167described above with reference toFIG. 1A), sensors359(e.g., optical, acceleration, proximity, touch-sensitive, and/or contact intensity sensors similar to contact intensity sensor(s)165described above with reference toFIG. 1A). Memory370includes high-speed random access memory, such as DRAM, SRAM, DDR RAM or other random access solid state memory devices; and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory370optionally includes one or more storage devices remotely located from CPU(s)310. In some embodiments, memory370stores programs, modules, and data structures analogous to the programs, modules, and data structures stored in memory102of portable or non-portable multifunction device100(FIG. 1A), or a subset thereof. Furthermore, memory370optionally stores additional programs, modules, and data structures not present in memory102of portable or non-portable multifunction device100. For example, memory370of device300optionally stores drawing module380, presentation module382, word processing module384, website creation module386, disk authoring module388, and/or spreadsheet module390, while memory102of portable or non-portable multifunction device100(FIG. 1A) optionally does not store these modules.

FIG. 4illustrates an exemplary user interface on a device (e.g., device300,FIG. 3) with a touch-sensitive surface451(e.g., a tablet or touchpad355,FIG. 3) that is separate from the display450(e.g., touch screen display112). Device300also, optionally, includes one or more contact intensity sensors (e.g., one or more of sensors357) for detecting intensity of contacts on touch-sensitive surface451and/or one or more tactile output generators359for generating tactile outputs for a user of device300.

User Interfaces and Associated Processes

Context-Based Data Detection

Users communicate with each other using electronic devices in many different contexts. In some circumstances, the electronic devices used for communication optionally analyze the communications and detect relevant information in the communications. That relevant information can change depending on the context in which the communications were made. For example, on a first day, a user may communicate with another user while the user is in a first geographic location, and on a second day, the user may communicate with the other user while the user is in a second geographic location. In such circumstances, the relevant information that the electronic devices detect is optionally different depending on whether the user was in the first location or the second location. The embodiments described below provide ways in which electronic devices detect information in communications based on a context of the communications, thereby enhancing the users' interactions with the electronic devices. Enhancing interactions with a device reduces the amount of time needed by a user to perform operations, and thus reduces the power usage of the device and increases battery life for battery-powered devices.

It is understood that people use devices. When a person uses a device, that person is optionally referred to as a user of the device. Thus, in this disclosure, references to a “person” or “people” are optionally interchangeable with references to a “user” or “users”, and references to a “user” or “users” are optionally interchangeable with references to a “person” or “people”.

FIGS. 5A-5Oillustrate exemplary ways in which electronic devices select terms in communications between users based on a context of the terms in accordance with some embodiments of the disclosure. The embodiments in these figures are used to illustrate the processes described below, including the processes described with reference toFIGS. 6A-6E.

It should be noted that the examples illustrated inFIGS. 5A-5Oare directed to electronic devices having touch screens, though it is understood that the electronic devices need not include touch screens. For example, the electronic devices may include displays without touch-sensitive capability, or the electronic devices may be capable of outputting display information for display on a separate display device, as described previously in this disclosure—in such circumstances, the touch screens described below optionally correspond to the displays mentioned above.

FIG. 5Aillustrates exemplary touch screen112. Touch screen112optionally displays one or more user interfaces that include various content. In the example illustrated inFIG. 5A, touch screen112optionally displays a messaging application running on an electronic device of which touch screen112is a part. The messaging application optionally displays communications between two or more users (e.g., messages504,506and508). Messages sent from a user of the electronic device of which touch screen112is a part (e.g., a first user) to another user (e.g., a second user) are optionally displayed on the right side of touch screen112(e.g., messages504and508). Messages received from the other user (e.g., the second user) by the user of the electronic device of which touch screen112is a part (e.g., the first user) are optionally displayed on the left side of the touch screen112(e.g., message506). In some embodiments, an identifier of the second user with which the first user is communicating is displayed on touch screen112(e.g., “John” inFIG. 5A).

In some embodiments, the electronic device receives terms that correspond to a communication with another user (e.g., voice input or text input including one or more words, phrases, email addresses, etc.). The terms are optionally a message received at the electronic device from another electronic device (e.g., messages504,506and508). The electronic device optionally determines a current context of the terms (e.g., determines the location of the electronic device, determines terms included in past terms that have been received, etc.), and selects one or more terms in the communications as actionable terms (e.g., terms that can be selected to perform an associated operation) based on word lists that are context-specific. As stated above, in some embodiments, the context is based on the location of the electronic device. For example, inFIG. 5A, the electronic device is optionally located in Los Angeles, as indicated by502. As a result, the electronic device optionally selects one or more terms in the communications between the first and second users based on a first word list512that is optionally associated with Los Angeles. Specifically, the electronic device optionally utilizes the first word list512, and not the second word list514, and identifies terms in the communications (e.g., messages504,506and508) that are included in the first word list512. In the example illustrated inFIG. 5A, message506includes the term “the boat”510, which is optionally also included in the first word list at516. As a result, the electronic device optionally selects “the boat”510in message506as an actionable term. In some embodiments, the actionable term “the boat” is optionally visually distinguished from other terms in the communications (e.g., the actionable terms are one or more of highlighted, underlined, bolded, etc.), as illustrated inFIG. 5A.

In some of the embodiments of the disclosure, an electronic device optionally selects a term as an actionable term when that term is a match for a term in the currently-utilized word list. In some embodiments, a term in a communication matches a term in a word list when the two terms are identical (e.g., case, letters, spacing, etc.). In some embodiments, a term in a communication matches a term in a word list when the two terms are partially identical (e.g., the two terms share some letters, some spacing, some case, etc.). When multiple terms in a currently-utilized word list match the same term in a communication, in some embodiments, the electronic device identifies the word list term that is a better match for the communication term, and selects the communication term as an actionable term based on the better match. In some embodiments, the electronic device selects the communication term as an actionable term based on the multiple matches.

As stated above, in some embodiments, the word list used to select the actionable terms in the communications is based on a current context of the communications. Thus, different actionable terms are optionally selected in different contexts.

FIG. 5Billustrates the electronic device optionally located in New York as opposed to Los Angeles, as inFIG. 5A. The messages504,506and508inFIG. 5Boptionally include the same terms as the messages inFIG. 5A. However, the electronic device inFIG. 5Bis optionally located in New York (as indicated by502), whereas the electronic device inFIG. 5Awas optionally located in Los Angeles (e.g., a current context of the terms inFIG. 5Ais optionally different than a current context of the terms inFIG. 5B).

As a result of the different context, the electronic device optionally selects actionable terms using the second word list514associated with New York, and not the first word list512associated with Los Angeles. Thus, as illustrated inFIG. 5B, the electronic device optionally selects “the game”520in message508as an actionable term, because “the game”518is a term in the second word list514. Also, the electronic device has optionally not selected “the boat” in message506as an actionable term (as it optionally did inFIG. 5A), because “the boat” is a term in the first word list512, which the electronic device is not utilizing inFIG. 5B.

While the embodiments of the disclosure are described with an electronic device using a single context-dependent word list at a given time, it is understood that more than one context-dependent word list can similarly be used by the electronic devices of the disclosure.

In some embodiments, the current context of the terms of the communication is optionally based on one or more terms in the communication itself, as illustrated inFIG. 5C. InFIG. 5C, touch screen112optionally displays messages522,524and526, similar to before. The electronic device optionally has two word lists to choose from when selecting terms as actionable terms: a first word list528associated with vacation destinations, and a second word list530associated with movies. It is understood that two words lists are provided by example only, and the scope of the disclosure extends to any number of available word lists.

Message524optionally includes the term “vacation”536. As a result, the electronic device optionally uses the first word list528, which is optionally associated with vacations, to select actionable terms in messages522,524and526. Specifically, the electronic device optionally selects “Italy”538and “Spain”540in message524as actionable terms, because “Italy”532and “Spain”534are optionally included in the first word list528.

FIG. 5Dillustrates an electronic device that has the same word lists available to it as the electronic device inFIG. 5C, except that the messages inFIG. 5Ddiffer from those inFIG. 5C. InFIG. 5D, the communications optionally include the term “movie”544in message542instead of the term “vacation,” as inFIG. 5C. As a result, the electronic device optionally uses the second word list530, which is optionally associated with movies, to select actionable terms in messages522,542and526. Specifically, the electronic device optionally selects “cruise”546in message526as an actionable term, because “Tom Cruise”548is optionally included in the second word list530.

In some embodiments, the electronic device optionally obtains content associated with the actionable terms it identifies.FIG. 5Eillustrates the electronic device obtaining content associated with an actionable term. Specifically, the term “the Game”520in message508has optionally been selected by the electronic device as an actionable term as previously described inFIGS. 5A-5D, for example. The electronic device optionally further obtains content550associated with “the game”520. Because the electronic device optionally recognizes “the game”520as referring to a game between the Knicks and the Lakers (e.g., because the “the game” in the word list used by the electronic device is optionally associated with content), the electronic device is optionally able to obtain content relating to that game.

In the embodiment illustrated inFIG. 5E, the content550optionally includes information about the teams that are involved in “the game” (e.g., Knicks and Lakers), the time of the game (e.g., 7:30 pm ET), the location of the game, a TV station on which the game will be broadcasted, the record of the Knicks, and the record of the Lakers. In some embodiments, the electronic device optionally obtains alternative or additional content to the content illustrated inFIG. 5E. In some embodiments, the obtained content is a link to additional content associated with one or more of the actionable terms (e.g., “the game”). In some embodiments, the link is a link to an application on the electronic device (e.g., the determined content is in an application on the electronic device, such as an application that has information about restaurants, and the link is a link to information about a particular restaurant in the application).

In some embodiments, the electronic device only obtains content associated with an actionable term after detecting selection of the actionable term. FIG.5F illustrates selection of an actionable term (e.g., “the game”520) in accordance with some embodiments. As inFIG. 5E, the term “the Game”520in message508has optionally been selected by the electronic device as an actionable term as previously described inFIGS. 5A-5D, for example. A user has optionally selected “the Game”520by touching touch screen112using finger552, as illustrated inFIG. 5F. Touch input using touch screen112is provided by way of example only, and it is understood that other ways of selecting actionable terms are also within the scope of the disclosure (e.g., mouse input, keyboard input, voice input, etc.).

In response to the selection of “the Game”520inFIG. 5F, the electronic device optionally obtains content550associated with “the Game”520, as illustrated inFIG. 5G. Content550can be as described with reference toFIG. 5E.

In some embodiments, the electronic device displays the obtained content along with the communications between the users, and in some embodiments, communicates the obtained content to the other user.FIG. 5Hillustrates obtained content550fromFIGS. 5E and/or 5Gdisplayed as content554along with messages506and508on touch screen112. In some embodiments, content554is also communicated from one user to the other user by the electronic device (e.g., from the first user to the second user, or from the second user to the first user, in the messaging application). Content554optionally corresponds to content550inFIGS. 5E and/or 5G.

In some embodiments, the actionable terms are selectable, and in some embodiments, the electronic device performs an operation in response to selection of an actionable term based on a type of the actionable term (e.g., making a phone call to an actionable term that is a detected phone number, sending an email to an actionable term that is a detected email address, performing a search on an actionable term that is a detected search term, displaying content associated with the actionable term, etc.). For example,FIG. 5Iillustrates messages504,506and508with the term “the Game”520having been selected as an actionable term as previously described inFIGS. 5A-5D, for example. The term “the Game”520is optionally selectable, and selection of the term “the Game” optionally causes the electronic device to perform an operation based on the type of the term “the Game,” as will be described below. A user has selected “the Game”520with finger552inFIG. 5I.

In response to the selection of “the Game”520inFIG. 5I, the electronic device optionally allows for the purchase of tickets for the Knicks vs. Lakers game corresponding to the term “the Game”520inFIG. 5J. Specifically, the electronic device optionally displays a ticket purchase user interface element556along with messages506and508on touch screen112. A user can then choose options for the tickets to be purchased (e.g., quantity, section, seat number, price, etc.), and can purchase the tickets from the electronic device (e.g., by selecting the “Buy Now” button).

In some embodiments, in addition to selecting terms as actionable terms based on context-specific word lists, the electronic device optionally selects terms as actionable terms based on a standard word list (e.g. a word list that is not based on the current context of the terms of the communications, such as email addresses, websites, street addresses, etc.). In some embodiments, the actionable terms selected based on the standard word list optionally operate in the same way and are visually distinguished in the same way as the actionable terms selected based on the first or second context-dependent word lists.FIG. 5Killustrates an electronic device with access to three word lists: one standard word list558, a first word list528associated with vacation destinations, and a second word list530associated with movies. Similar to the examples described above with reference toFIG. 5D, the electronic device optionally selects the term “cruise”546in message564as a result of the term “movie”544in message542(e.g., the current context) causing the electronic device to utilize the second word list530to select actionable terms—the term “Tom Cruise”548is optionally included in the second word list530.

However, additionally, the electronic device optionally has a standard word list558based upon which the electronic device additionally selects actionable terms regardless of the current context of the communications. Thus, the electronic device has additionally selected the term “iPhone”560in message564as an actionable term, because the term “iPhone”562is optionally included in the standard word list558.

In some embodiments, in addition to selecting terms as actionable terms based on context-specific word lists, the electronic device optionally selects terms as actionable terms based on regular expressions. For example, the detected occurrence of special symbols such as the @ symbol are used to identify email addresses, xxx-xxx-xxxx formats are used to identify phone numbers, “www.” prefixes are used to identify uniform resource locators that correspond to webpages, etc. In some embodiments, the actionable terms selected based on the regular expressions optionally operate in the same way (e.g., provide additional content upon selection) and are visually distinguished in the same way as the actionable terms selected based on the first or second context-dependent word lists.FIG. 5Lillustrates an electronic device that optionally selects actionable terms based on context-specific word lists and regular expressions. Touch screen112optionally displays messages522,544and565. Further, the electronic device has optionally selected the term “cruise”546as an actionable term, as described with reference toFIG. 5K.

However, additionally, the electronic device has optionally selected the term “123-456-7890”566in message565as an actionable term, because the term “123-456-7890”566optionally has the format of a telephone number. As a result, the electronic device optionally selects the term “123-456-7890”566as an actionable term, and the user can optionally select the term to perform an appropriate operation (e.g., to call the phone number 123-456-7890 from the electronic device or other device).

In some embodiments, the electronic device searches for certain keywords in the communications, each of which is optionally associated with a word list with which to select actionable terms in the communications. In response to detecting the existence of one of the keywords in the communications, the electronic device optionally uses the word list associated with the keyword to select actionable terms. In some embodiments, the electronic device uses the word lists associated with the keywords only for a predetermined time period (e.g., 5, 15 or 30 minutes) after detecting the existence of the keywords in the communications.FIG. 5Millustrates an electronic device that searches for keywords574in communications with a user, and has access to various word lists that are associated with the keywords. Specifically, the electronic device optionally has keywords574. The “politics” keyword is optionally associated with the politics word list576. The “San Francisco” keyword is optionally associated with the San Francisco word list578. The “Lakers” keyword is optionally associated with the Lakers word list580. Touch screen112optionally displays messages568,570and572corresponding to communications between a first user and a second user.

InFIG. 5N, the electronic device has optionally identified the term “Lakers”584in message570as matching the term “Lakers”582in keywords574. As a result, inFIG. 5O, the electronic device optionally uses the Lakers word list580to select actionable terms in messages568,570and572. Specifically, the electronic device has optionally selected the terms “Kobe”586and “Phil Jackson”588in message570as actionable terms, because the terms “Kobe Bryant”590and “Phil Jackson”592are optionally included in the Lakers word list580. The electronic device optionally utilizes multiple word lists in response to detection of multiple keywords in messages568,570and572.

FIGS. 6A-6Eare flow diagrams illustrating a method600of selecting terms in communications between users based on a context of the terms in accordance with some embodiments. The method600is optionally performed at an electronic device such as device100or device300as described above with reference toFIGS. 1A-1B and 2-3. Some operations in method600are, optionally, combined and/or the order of some operations is, optionally, changed.

As described below, the method600provides ways in which a device optionally selects terms as actionable terms in communications. The method reduces the cognitive burden on a user when interacting with a user interface of the device of the disclosure, thereby creating a more efficient human-machine interface. For battery-operated electronic devices, increasing the efficiency of the user's interaction with the user interface conserves power and increases the time between battery charges.

In some embodiments, an electronic device (e.g., device100or300) with one or more processors and memory receives (602) a plurality of terms that correspond to a communication with another user (e.g., voice input or text input including one or more words, phrases, email addresses, etc.). The terms are optionally a message received at the electronic device from another electronic device, such as messages504,506and508inFIG. 5A.

The electronic device optionally determines (604) a current context of the plurality of terms (e.g., determines the location of the electronic device, determines terms included in past terms that have been received, etc.). In some embodiments, the current context of the plurality of terms is based on one or more of: a current application on the electronic device, a time of day, one or more recently used applications on the electronic device, a location of the electronic device, and previously received terms on the electronic device (606) (e.g., certain previously received terms optionally trigger certain word lists). For example, “movie” triggers movie title wordlist, “dinner” triggers restaurant word list, “game” triggers sports word list, “TV” triggers television show word list, etc.FIGS. 5A-5Dillustrate some of these contexts.

In some embodiments, in accordance with a determination that the current context is a first context (e.g., determining that the electronic device is in a first location, such as inFIG. 5A), the electronic device selects (608) one or more terms in the plurality of terms based on a first word list (e.g., word list512inFIG. 5A) as actionable terms (e.g., selecting terms in the plurality of terms that match words in the first word list). In some embodiments, the first context is based on one or more of activities of a user of the electronic device, a time of day, a currently-utilized application on the electronic device, current news events, calendar information on the electronic device (e.g., appointment information), location interests of a user of the electronic device, and content on the electronic device (610) (e.g., music, video, books on the electronic device). In some embodiments, selecting the one or more terms in the plurality of terms comprises (612) determining (614) a context associated with a first term in the plurality of terms, and selecting (616) the one or more terms based on the context associated with the first term (e.g., as illustrated inFIGS. 5C-5D).

In some embodiments, in accordance with a determination that the current context is a second context, different from the first context (e.g., determining that the electronic device is in a second location, different from the first location, such as inFIG. 5B), the electronic device selects (618) one or more terms in the plurality of terms as actionable terms based on a second word list (e.g., word list514inFIG. 5B), different from the first word list (e.g., identifying terms in the plurality of terms that match words in the second word list). In some embodiments, the second context is based on one or more of activities of a user of the electronic device, a time of day, a currently-utilized application on the electronic device, current news events, calendar information on the electronic device, location interests of a user of the electronic device, and content on the electronic device (620). In some embodiments, the first and second word lists are provided by one or more applications on the electronic device (622) (e.g., third party applications can provide their own word lists which are also, optionally, updated over time). In some embodiments, a first application on the electronic device and a second application on the electronic device provide different word lists (624).

In some embodiments, the plurality of terms that corresponds to the communication with the other user is received from a second electronic device (e.g., the other user sends a text message from the other user's electronic device), and the first and second word lists are based on information from the second electronic device (626) (e.g., if a second user's device triggered data detection for a word or phrase, then that word or phrase is optionally flagged for data detection by the current user's device). In some embodiments, selecting the one or more terms in the plurality of terms comprises (628) determining (630) a context associated with a first term in the plurality of terms, and selecting (632) the one or more terms based on the context associated with the first term (e.g., look for key terms (e.g., movie names, TV show names, reservation information, restaurant names, etc.), and then do data detection around the key terms using a word list that is specific to those key terms, as illustrated inFIGS. 5M-5O). For example, the electronic device optionally identifies the name of a sports team in the plurality of terms, and then uses a word list associated with that sports team to identify other terms around the name of the sports team.

In some embodiments, the electronic device displays (634) the plurality of terms (e.g., in a messaging application), wherein one or more of the actionable terms are visually distinguished from other terms (e.g., the actionable terms are one or more of highlighted, underlined, bolded, etc.), such as illustrated inFIGS. 5A-5L and 5O.

In some embodiments, the electronic device obtains (636) content associated with one or more of the actionable terms (e.g., the device identifies and retrieves content from a content source, the content associated with the actionable terms, such as content550inFIG. 5E). For example, if one of the actionable terms is the name of a movie, the retrieved content is optionally information about the movie, such as actors, show times, box office statistics, etc. Obtaining the content optionally comprises obtaining a link to additional content associated with one or more of the actionable terms (638). The link optionally comprises a link to an application on the electronic device (640) (e.g., the determined content is in an application on the electronic device, such as an application that has information about restaurants, and the link is a link to information about a particular restaurant in the application).

In some embodiments, the electronic device communicates (642) the plurality of terms and the obtained content to the other user (e.g., communicate the plurality of terms to the other user, such as in a text message, with the content in-line with the plurality of terms), as illustrated inFIG. 5H.

In some embodiments, the plurality of terms is to be communicated to the other user from the electronic device (e.g., the plurality of terms is part of an outgoing text message), and the first word list and the second word list correspond to a user of the electronic device (644) (e.g., the first and second word lists are based on information about a user of the electronic device). In some embodiments, the plurality of terms is received from the other user of a second electronic device (e.g., the plurality of terms is part of an incoming text message), and the first word list and the second word list correspond to the other user of the second electronic device (646) (e.g., the first and second word lists are based on information about the other user of the second electronic device). In some embodiments, the first word list and the second word list correspond to a user of the electronic device and the other user of a second electronic device (648) (e.g., the first and second word lists are based on information about a user of the electronic device and information about the other user of the second electronic device).

In some embodiments, prior to obtaining the content associated with the one or more of the actionable terms, the electronic device receives (650) a selection of the one or more of the actionable terms (e.g., detecting a touch input on the one or more of the actionable terms), as illustrated inFIG. 5F. In response to receiving the selection of the one or more of the actionable terms, the electronic device optionally obtains (652) the content associated with the selected actionable terms, as illustrated inFIG. 5G.

In some embodiments, selection of an actionable term causes performance of an operation associated with the selected actionable term (654) (e.g., making a phone call to an actionable term that is a detected phone number, sending an email to an actionable term that is a detected email address, performing a search on an actionable term that is a detected search term, displaying content associated with the actionable term, etc.). In some embodiments, the electronic device detects (656) a selection of one of the actionable terms, and in response to the selection, performs (658) an operation associated with the selected actionable term, wherein the operation is dependent on a type of the selected actionable term (e.g., search locations for an address when the selected actionable term is an address, search TV listings for a TV show when the selected actionable term is a TV show, search restaurant ratings for a restaurant when the selected actionable term is the name of a restaurant, search sports scores for a sports team when the selected actionable term is the name of a sports team), as illustrated inFIGS. 5J-5K.

In some embodiments, the electronic device selects (660) one or more terms in the plurality of terms as actionable terms based on a standard word list (e.g. a word list that is not based on the current context of the plurality of terms, such as email addresses, websites, street addresses, etc., such as word list558inFIG. 5K). In some embodiments, the actionable terms selected based on the standard word list optionally operate in the same way and are visually distinguished in the same way as the actionable terms selected based on the first or second context-dependent word lists, as illustrated inFIG. 5K. In some embodiments, the electronic device selects (662) one or more terms in the plurality of terms as actionable terms based on regular expressions, as illustrated inFIG. 5L. For example, the detected occurrence of special symbols such as the @ symbol are used to identify email addresses, (xxx) xxx-xxxx format is used to identify phone numbers, “www.” prefix is used to identify uniform resource locators that correspond to webpages, etc. In some embodiments, the actionable terms selected based on the regular expressions optionally operate in the same way (e.g., provide additional content upon selection) and are visually distinguished in the same way as the actionable terms selected based on the first or second context-dependent word lists, as illustrated inFIG. 5L. In some embodiments, the electronic device receives (664) updates to the first and second word lists at intervals of time (e.g., regular intervals of time, such as once a week or based on current events or changing seasons). In some embodiments, updates to the first and second wordlists add words. In some embodiments, updates to the first and second wordlists remove words. In some embodiments, updates to the first and second wordlists add words and remove words (e.g., so as to provide a more relevant list of words without dramatically increasing the overall number of words that are being detected).

In some embodiments, the electronic device receives (666) a first plurality of terms at a first time (e.g., receiving a first text message). The plurality of terms that corresponds to the communication with the other user optionally comprises a second plurality of terms received at a second time, later than the first time (668) (e.g., receiving a second text message after the first text message). Selecting the one or more terms in the second plurality of terms as the actionable terms optionally comprises, in accordance with a determination that the second plurality of terms was received after the first plurality of terms, selecting (670) the one or more terms in the second plurality of terms as the actionable terms (e.g., selecting terms as actionable terms in the more recently-received text message). In some embodiments, in accordance with the determination that the second plurality of terms was received after the first plurality of terms, the electronic device forgoes selecting (672) one or more terms in the first plurality of terms as actionable terms (e.g., do not select terms as actionable terms in the earlier-received text message).

In some embodiments, in accordance with a determination that the plurality of terms includes a first term, the electronic device utilizes (674) a third word list and a fourth word list associated with the first term for selecting one or more terms in the plurality of terms as actionable terms for a predetermined time period (e.g., 5, 15 or 30 minutes), wherein the third and fourth words lists are different from the first and the second word lists (e.g., certain terms in the plurality of terms cause the word lists used to identify terms to change for a predetermined time period). For example, if the plurality of terms includes the name of a movie, the electronic device changes the word lists to be used for the next five minutes, for example, to word lists associated with the movie.

It should be understood that the particular order in which the operations inFIGS. 6A-6Ehave been described is merely exemplary and is not intended to indicate that the described order is the only order in which the operations could be performed. One of ordinary skill in the art would recognize various ways to reorder the operations described herein. Additionally, it should be noted that details of other processes described herein with respect to other methods described herein (e.g., method800) are also applicable in an analogous manner to method600described above with respect toFIGS. 6A-6E. For example, the plurality of terms, first word list, second word list and actionable terms described above with reference to method600optionally have one or more of the characteristics of the plurality of terms, first word list and actionable terms described herein with reference to other methods described herein (e.g., method800). For brevity, these details are not repeated here.

The operations in the information processing methods described above are, optionally, implemented by running one or more functional modules in an information processing apparatus such as general purpose processors (e.g., as described above with respect toFIGS. 1A and 3) or application specific chips.

Automatic Content Population

Automatically populating a user interface with content associated with a user's actions (e.g., communications) on an electronic device can enhance the user's interaction with the content and the device. Such automatic population in the context of communications between users can similarly enhance each user's interaction with the content and their respective devices. The embodiments described below provide ways that a device optionally automatically populates a user interface with content. Enhancing interactions with a device reduces the amount of time needed by a user to perform operations, and thus reduces the power usage of the device and increases battery life for battery-powered devices.

FIGS. 7A-7Fillustrate exemplary ways in which an electronic device automatically populates a user interface with content in accordance with some embodiments of the disclosure. The embodiments in these figures are used to illustrate the processes described below, including the processes described with reference toFIGS. 8A-8C.

It should be noted that the examples illustrated inFIGS. 7A-7Fare directed to electronic devices having touch screens, though it is understood that the electronic devices need not include touch screens. For example, the electronic devices may include displays without touch-sensitive capability, or the electronic devices may be capable of outputting display information for display on a separate display device, as described previously in this disclosure—in such circumstances, the touch screens described below optionally correspond to the displays mentioned above.

FIG. 7Aillustrates exemplary touch screen112. Touch screen112optionally displays one or more user interfaces that include various content. In the example illustrated inFIG. 7A, touch screen112optionally displays a messaging application running on an electronic device of which touch screen112is a part, as described with reference toFIGS. 5A-5O. The messaging application optionally displays communications between two or more users (e.g., messages702and704). Messages sent from a user of the electronic device of which touch screen112is a part (e.g., a first user) to another user (e.g., a second user) are optionally displayed on the right side of touch screen112(e.g., message704). Messages received from the other user (e.g., the second user) by the user of the electronic device of which touch screen112is a part (e.g., the first user) are optionally displayed on the left side of the touch screen112(e.g., message702). In some embodiments, an identifier of the second user with which the first user is communicating is displayed on touch screen112(e.g., “John” inFIG. 7A).

In some embodiments, the electronic device receives terms that correspond to a communication with another user (e.g., voice input or text input including one or more words, phrases, email addresses, etc.). The terms are optionally a message received at the electronic device from another electronic device. In some embodiments, the electronic device optionally identifies one or more terms in messages702and704as actionable terms (e.g., terms that can be selected to perform an associated operation), similar to the examples discussed with reference toFIGS. 5A-5O. In some embodiments, the actionable terms are identified using a word list, such as movies word list706, which, in the example illustrated inFIG. 7A, optionally includes the names of various movies. It is understood, however, that the electronic device can identify terms as actionable terms in other ways within the scope of the disclosure.

FIG. 7Billustrates identification of an actionable term in messages702and704. Specifically, the electronic device has identified the term “the Skateboard”708in message704. The electronic device has done so in the example illustrated inFIG. 7Bbecause the term “The Skateboard”712is included in movies word list706, similar to the examples described previously with reference toFIGS. 5A-5D.

Additionally, the electronic device has optionally obtained related content710associated with the term “the Skateboard”708, and concurrently displayed a representation of the content710along with messages702and704(e.g., the electronic device has optionally displayed the content in-line with or otherwise in close proximity to the received plurality of terms (e.g., messages704and702) displayed in the user interface). The electronic device optionally obtains content710in a manner similar to the examples described with reference toFIGS. 5E-5H. For example, if an identified term is the name of a movie, the electronic device optionally obtains information about the movie and displays the information in the user interface adjacent to or otherwise in close proximity to the identified actionable term—the information optionally is information such as actors, show times, box office statistics, etc. In the example illustrated inFIG. 7B, the related content710includes the name of the movie (e.g., The Skateboard: The Movie), a summary of the movie, and a list of actors and actresses starring in the movie, though it is understood that other related content can additionally or alternatively be obtained and displayed by the electronic device.

In some embodiments, the electronic device identifies actionable terms based on regular expressions, similar to the example described with reference toFIG. 5L. For example, the detected occurrence of special symbols such as the @ symbol are optionally used to identify email addresses, (xxx) xxx-xxxx formats are optionally used to identify phone numbers, “www.” prefixes are optionally used to identify uniform resource locators that correspond to webpages, etc.FIG. 7Cillustrates messages702and714displayed on touch screen112. InFIG. 7D, the electronic device has optionally identified an actionable term in messages702and714based on a regular expression. Specifically, the electronic device has optionally identified the term “www.skateboardmovie.com”716in message714based on, for example, a prefix of “www.” Additionally, the electronic device has optionally obtained content718associated with the term “www.skateboardmovie.com”716(e.g., a preview of the website), and has concurrently displayed the content718along with messages702and714in the user interface. In the example illustrated inFIG. 7D, the related content718includes a short description of the movie from the website, as well as a link to a preview of the movie, though it is understood that other content is similarly within the scope of the disclosure. In some embodiments, as inFIG. 7D, the related content is actionable (e.g., the related content allows a user to perform some action related to the content and/or its associated term—for example, making a dinner reservation, purchasing tickets for a movie, etc., such as described with reference toFIG. 5J).

In some embodiments, the obtained related content includes transaction options for an event (e.g., for the movie).FIG. 7Eillustrates messages702and704(as illustrated inFIGS. 7A-7B) and related content720for The Skateboard movie that includes the ability to buy tickets for the movie. Specifically, the related content720allows for selection of a show time for the movie, and indication of a number of tickets to purchase. It is understood that other embodiments may include additional or alternative content to the content inFIG. 7E.

In some embodiments, the electronic device is more proactive in identifying actionable terms and/or displaying related content for actionable terms for more recently-received terms than for less recently-received terms, thus conserving processing resources while still providing robust data detection for recent communications that a user is most likely to be reviewing.FIG. 7Fillustrates two messages received at separate times. Specifically, message722was optionally received by the electronic device from another user at a first time. Message724was optionally received by the electronic device from the user of the electronic device (e.g., the user optionally typed-in message724to respond to message722) at a second time, later than the first time.

In the example illustrated inFIG. 7F, the electronic device optionally has two word lists with which to identify actionable terms in messages722and724. The first word list728is optionally a word list for use in identifying actionable terms in older messages (e.g., message722), and the second word list730is optionally a word list for use in identifying actionable terms in recent messages (e.g., message724). The second word list730optionally includes all of the terms in the first word list728, in addition to extra terms of its own (e.g., the term “The Skateboard”736), though it is understood that this need not be the case.

The electronic device has identified the term “I Love Pizza”738in message722as an actionable term using the first word list728. The electronic device has also optionally identified the terms “The Skateboard”742and “I Love Pizza”740in message724as actionable terms using the second word list730. Thus, the electronic device has identified actionable terms in an older message using one word list, and has identified actionable terms in a more recent message using a different word list. In some embodiments, the electronic device identifies a term as actionable only in the more recent message, even if the term also exists in the older message.

Additionally, the electronic device has not displayed content associated with the term “I Love Pizza”738in message722, but has displayed content726associated with the term “I Love Pizza”740in message724. Thus, the electronic device has displayed content for actionable terms identified in more recent messages, but has not displayed content for actionable terms identified in older messages so as to provide additional content for messages that a user is likely to look at, but not for messages that the user is less likely to look at, thereby improving the user experience without unnecessarily using processing resources. In the example illustrated inFIG. 7F, the related content726optionally includes the name of the restaurant, a description of the restaurant, and the ability to make reservations at the restaurant by supplying a reservation time and a party size, though it is understood that the related content726can include additional or alternative content to that illustrated inFIG. 7F.

FIGS. 8A-8Care flow diagrams illustrating a method800of automatically populating a user interface with content in accordance with some embodiments. The method800is optionally performed at an electronic device such as device100or device300as described above with reference toFIGS. 1A-1B and 2-3. Some operations in method800are, optionally, combined and/or the order of some operations is, optionally, changed.

As described below, the method800provides ways in which a device optionally automatically populates a user interface with content. The method reduces the cognitive burden on a user when interacting with a user interface on the device, thereby creating a more efficient human-machine interface. For battery-operated electronic devices, increasing the efficiency of the user's interaction with the user interface conserves power and increases the time between battery charges.

In some embodiments, an electronic device with one or more processors and memory generates (802) a user interface for display on a display device (e.g., as illustrated inFIG. 7A). While the user interface is displayed on the display device, the electronic device optionally receives (804) a plurality of terms that corresponds to a communication with another user (e.g., voice input or text input including one or more words, phrases, email addresses, etc., such as messages702and704inFIG. 7A). The terms are optionally received at the electronic device from another electronic device. In some embodiments, the plurality of terms includes a first set of terms received at a first time (e.g., receiving a first text message, such as message702inFIG. 7A) and a second set of terms received at a second time (e.g., message704inFIG. 7A) that was after the first time (806). In some embodiments, the received plurality of terms includes a name of a movie (808), as illustrated inFIG. 7B.

In some embodiments, after receiving the plurality of terms, the electronic device identifies (810) one or more terms in the plurality of terms as actionable terms (e.g., terms that can be selected to perform an associated operation), as illustrated inFIG. 7B. Identifying the one or more terms in the plurality of terms as the actionable terms is optionally based on regular expressions (812), as illustrated inFIG. 7D. For example, the detected occurrence of special symbols such as the @ symbol are used to identify email addresses, (xxx) xxx-xxxx formats are used to identify phone numbers, “www.” prefixes are used to identify uniform resource locators that correspond to webpages, etc. In some embodiments, identifying the one or more terms in the plurality of terms as the actionable terms is based on a first word list (814), as illustrated inFIGS. 7A-7B(e.g., the electronic device identifies terms in the plurality of terms that match words in the first word list). In some embodiments, the plurality of terms is optionally received from a second electronic device (e.g., the other user sends a text message from the other user's electronic device), and the first word list is optionally based on information from the second electronic device (816) (e.g., if a second user's device triggered data detection for a word or phrase, then that word or phrase is optionally flagged for data detection by the current user's device).

In some embodiments, identifying one or more terms in the plurality of terms as actionable terms includes comparing the first set of terms to a first word list and comparing the second set of terms to a second word list that includes more terms than the first word list (818), as illustrated inFIG. 7F. In some embodiments, the first set of terms is a subset of the second set of terms. Thus, in some embodiments, more aggressive data detection is used for more recent text (e.g., more recently received messages), so as to conserve processing resources while still providing robust data detection for recent communications that the user is most likely to be reviewing. In some embodiments, identifying one or more terms in the plurality of terms as actionable terms includes identifying one or more actionable terms in the first set of terms, and identifying one or more actionable terms in the second set of terms (820), as illustrated inFIG. 7F. In some embodiments, identifying the one or more terms in the plurality of terms comprises (822) determining (824) a context associated with a first term in the plurality of terms, and identifying (826) the one or more terms based on the context associated with the first term (e.g., the electronic device optionally look for key terms (e.g., movie names, TV show names, reservation information, restaurant names, etc.), and then does data detection around the key terms using a word list that is specific to those key terms, similar to the examples described with reference toFIGS. 5M-5O). For example, the electronic device optionally identifies the name of a sports team in the plurality of terms, and then uses a word list associated with that sports team to identify other terms around the name of the sports team. In some embodiments, one of the actionable terms comprises the name of the movie (828), as illustrated inFIGS. 7B and 7E-7F.

In some embodiments, the electronic device obtains (830) related content associated with the identified one or more terms, as illustrated inFIGS. 7B and 7D-7F(e.g., the device identifies and retrieves content from a content source, the content associated with the identified one or more terms). For example, if one of the identified terms is the name of a movie, the retrieved content is optionally information about the movie, such as actors, show times, box office statistics, etc. In some embodiments, the related content is actionable (832) (e.g., the related content allows a user to perform some action related to the content and/or its associated term, such as making a dinner reservation, purchasing tickets for a movie, etc.). In some embodiments, the related content includes information about an event (834), as illustrated inFIG. 7B(e.g., menu for a dinner, show times for a movie, venue information for a game, hours of operation of a restaurant, menu for the restaurant, sports scores for a sporting event, game start time for a sporting event, etc.). In some embodiments, the related content includes transaction options for an event (836), as illustrated inFIG. 7E(e.g., purchasing tickets (sports or non-sports) for an event, reserving tables for a dinner, etc.). In some embodiments, the related content comprises show times for the movie at one or more theaters that are local to the electronic device (838), as illustrated inFIG. 7E. In some embodiments, the related content comprises a link to purchase one or more tickets for the movie at one or more theaters that are local to the electronic device (840), as illustrated inFIG. 7E.

In some embodiments, after obtaining the related content, the electronic device concurrently displays (842) a representation of the related content along with the received plurality of terms, as illustrated inFIGS. 7B and 7D-7F(e.g., the electronic device displays the content in-line with or otherwise in close proximity to the received plurality of terms displayed in the user interface). For example, if an identified term is the name of a movie, the electronic device optionally displays information about the movie, such as actors, show times, box office statistics, etc., adjacent to the identified term. In some embodiments, concurrently displaying a representation of the related content along with the received plurality of terms includes displaying the related content for one or more of the actionable terms in the second set of terms without displaying related content for any of the actionable terms in the first set of terms (844), as illustrated inFIG. 7F. In some embodiments, even if the same actionable term is identified in an earlier message and a later message, the related content is displayed for the later message but not for the earlier message, so as to provide additional content for messages that the user is likely to look at but not for messages that the user is less likely to look at, thereby improving the user experience without unnecessarily using processing resources. In some embodiments, the identified actionable terms are visually distinguished from other terms (846) (e.g., the actionable terms are one or more of highlighted, underlined, bolded, etc.).

In some embodiments, in accordance with a determination that the plurality of terms includes a first term, the electronic device utilizes (848) a second word list for identifying one or more terms in the plurality of terms as actionable terms for a predetermined time period (e.g., 5, 15 or 30 minutes), wherein the first word list is different from the second word list (e.g., certain terms in the plurality of terms optionally cause the word list used to identify terms to change for a predetermined time period). For example, if the plurality of terms includes the name of a movie, the word list to be used for the next 5 minutes is optionally changed, for example, to a word list associated with the movie.

It should be understood that the particular order in which the operations inFIGS. 8A-8Chave been described is merely exemplary and is not intended to indicate that the described order is the only order in which the operations could be performed. One of ordinary skill in the art would recognize various ways to reorder the operations described herein. Additionally, it should be noted that details of other processes described herein with respect to other methods described herein (e.g., method600) are also applicable in an analogous manner to method800described above with respect toFIGS. 8A-8C. For example, the plurality of terms, first word list and actionable terms described above with reference to method800optionally have one or more of the characteristics of the plurality of terms, first word list, second word list and actionable terms described herein with reference to other methods described herein (e.g., method600). For brevity, these details are not repeated here.

The operations in the information processing methods described above are, optionally, implemented by running one or more functional modules in an information processing apparatus such as general purpose processors (e.g., as described above with respect toFIGS. 1A and 3) or application specific chips.

As shown inFIG. 9, an electronic device900optionally includes a receiving unit902configured to receive inputs, a processing unit904coupled to the receiving unit902, a communicating unit916coupled to the receiving unit902and the processing unit904and configured to communicate data, and a detecting unit918coupled to the communicating unit916and the processing unit904and configured to detect inputs. In some embodiments, the processing unit904includes a display enabling unit906, a determining unit908, a selecting unit910, an obtaining unit912and a performing unit914.

In some embodiments, the receiving unit902is configured to receive a plurality of terms that corresponds to a communication with another user. In some embodiments, the processing unit904is configured to determine a current context of the plurality of terms (e.g., with the determining unit908). In some embodiments, the processing unit904is configured to, in accordance with a determination that the current context is a first context, select (e.g., with the selecting unit910) one or more terms in the plurality of terms based on a first word list as actionable terms. In some embodiments, the processing unit904is configured to, in accordance with a determination that the current context is a second context, different from the first context, select (e.g., with the selecting unit) one or more terms in the plurality of terms as actionable terms based on a second word list, different from the first word list. In some embodiments, the processing unit904is configured to display (e.g., with the display enabling unit906) the plurality of terms, wherein one or more of the actionable terms are visually distinguished from other terms.

In some embodiments, the processing unit904is configured to obtain (e.g., with the obtaining unit912) content associated with one or more of the actionable terms. In some embodiments, the communicating unit916is configured to communicate the plurality of terms and the obtained content to the other user. In some embodiments, obtaining the content comprises obtaining (e.g., with the obtaining unit912) a link to additional content associated with one or more of the actionable terms. In some embodiments, the link comprises a link to an application on the electronic device.

In some embodiments, the receiving unit902is configured to, prior to obtaining the content associated with the one or more of the actionable terms, receive a selection of the one or more of the actionable terms. In some embodiments, the processing unit904is configured to, in response to receiving the selection of the one or more of the actionable terms, obtain (e.g., with the obtaining unit912) the content associated with the selected actionable terms.

In some embodiments, selection of an actionable term causes performance of an operation (e.g., with the performing unit914) associated with the selected actionable term. In some embodiments, the detecting unit918is configured to detect a selection of one of the actionable terms. In some embodiments, the processing unit904is configured to, in response to the selection, perform an operation (e.g., with the performing unit914) associated with the selected actionable term, wherein the operation is dependent on a type of the selected actionable term.

In some embodiments, the processing unit904is configured to select (e.g., with the selecting unit910) one or more terms in the plurality of terms as actionable terms based on a standard word list. In some embodiments, the processing unit904is configured to select (e.g., with the selecting unit910) one or more terms in the plurality of terms as actionable terms based on regular expressions.

In some embodiments, the first and second contexts are based on one or more of activities of a user of the electronic device, a time of day, a currently-utilized application on the electronic device, current news events, calendar information on the electronic device, location interests of a user of the electronic device, and content on the electronic device. In some embodiments, the receiving unit902is configured to receive updates to the first and second word lists at intervals of time. In some embodiments, the first and second word lists are provided by one or more applications on the electronic device. In some embodiments, a first application on the electronic device and a second application on the electronic device provide different word lists.

In some embodiments, the plurality of terms that corresponds to the communication with the other user is received (e.g., with the receiving unit902) from a second electronic device, and the first and second word lists are based on information from the second electronic device. In some embodiments, the processing unit904is configured to select (e.g., with the selecting unit910) the one or more terms in the plurality of terms by: determining (e.g., with the determining unit908) a context associated with a first term in the plurality of terms, and selecting (e.g., with the selecting unit910) the one or more terms based on the context associated with the first term.

In some embodiments, the receiving unit902is configured to receive a first plurality of terms at a first time, wherein the plurality of terms that corresponds to the communication with the other user comprises a second plurality of terms received at a second time (e.g., with the receiving unit902), later than the first time, and the processing unit904is configured to select (e.g., with the selecting unit910) the one or more terms in the second plurality of terms as the actionable terms by, in accordance with a determination (e.g., with the determining unit908) that the second plurality of terms was received after the first plurality of terms, selecting (e.g., with the selecting unit910) the one or more terms in the second plurality of terms as the actionable terms. In some embodiments, the processing unit904is configured to, in accordance with the determination that the second plurality of terms was received after the first plurality of terms, forgo selecting (e.g., with the selecting unit910) one or more terms in the first plurality of terms as actionable terms.

In some embodiments, the processing unit904is configured to, in accordance with a determination that the plurality of terms includes a first term, utilizing a third word list and a fourth word list associated with the first term for selecting (e.g., with the selecting unit910) one or more terms in the plurality of terms as actionable terms for a predetermined time period, wherein the third and fourth words lists are different from the first and the second word lists. In some embodiments, the plurality of terms is to be communicated (e.g., with the communicating unit916) to the other user from the electronic device, and the first word list and the second word list correspond to a user of the electronic device. In some embodiments, the plurality of terms is received (e.g., with the receiving unit902) from the other user of a second electronic device, and the first word list and the second word list correspond to the other user of the second electronic device. In some embodiments, the first word list and the second word list correspond to a user of the electronic device and the other user of a second electronic device.

In some embodiments, the current context of the plurality of terms is based on one or more of: a current application on the electronic device, a time of day, one or more recently used applications on the electronic device, a location of the electronic device, and previously received terms on the electronic device.

As shown inFIG. 10, an electronic device1000optionally includes a receiving unit1002configured to receive inputs, and a processing unit1004coupled to the receiving unit1002. In some embodiments, the processing unit1004includes an obtaining unit1006, a display enabling unit1008, an identifying unit1010and a determining unit1012.

In some embodiments, the receiving unit1002is configured to receive a plurality of terms that corresponds to a communication with another user while a user interface is displayed (e.g., with the display enabling unit1008) on a display device. In some embodiments, the processing unit1704is configured to: generate (e.g., with the display enabling unit1008) a user interface for display on the display device; after receiving the plurality of terms (e.g., with the receiving unit1002), identify (e.g., with the identifying unit1010) one or more terms in the plurality of terms as actionable terms; obtain (e.g., with the obtaining unit1006) related content associated with the identified one or more terms; and after obtaining the related content, concurrently display (e.g., with the display enabling unit1008) a representation of the related content along with the received plurality of terms. In some embodiments, identifying (e.g., with the identifying unit1010) the one or more terms in the plurality of terms as the actionable terms is based on regular expressions. In some embodiments, identifying (e.g., with the identifying unit1010) the one or more terms in the plurality of terms as the actionable terms is based on a first word list.

In some embodiments, the plurality of terms is received (e.g., with the receiving unit1002) from a second electronic device, and the first word list is based on information from the second electronic device. In some embodiments, the processing unit1004is configured to in accordance with a determination (e.g., with the determining unit1012) that the plurality of terms includes a first term, utilizing a second word list for identifying (e.g., with the identifying unit1010) one or more terms in the plurality of terms as actionable terms for a predetermined time period, wherein the first word list is different from the second word list.

In some embodiments, the related content is actionable. In some embodiments, the plurality of terms includes a first set of terms received (e.g., with the receiving unit1002) at a first time and a second set of terms received (e.g., with the receiving unit1002) at a second time that was after the first time, and identifying one or more terms in the plurality of terms as actionable terms includes comparing (e.g., with the identifying unit1010) the first set of terms to a first word list and comparing the second set of terms to a second word list that includes more terms than the first word list.

In some embodiments, the plurality of terms includes a first set of terms received (e.g., with the receiving unit1002) at a first time and a second set of terms received (e.g., with the receiving unit1002) at a second time that was after the first time, and identifying one or more terms in the plurality of terms as actionable terms includes identifying (e.g., with the identifying unit1010) one or more actionable terms in the first set of terms, and identifying (e.g., with the identifying unit1010) one or more actionable terms in the second set of terms, and concurrently displaying (e.g., with the display enabling unit1008) a representation of the related content along with the received plurality of terms includes displaying the related content for one or more of the actionable terms in the second set of terms without displaying related content for any of the actionable terms in the first set of terms.

In some embodiments, identifying (e.g., with the identifying unit1010) the one or more terms in the plurality of terms comprises: determining (e.g., with the determining unit1012) a context associated with a first term in the plurality of terms; and identifying (e.g., with the identifying unit1010) the one or more terms based on the context associated with the first term. In some embodiments, the related content includes information about an event. In some embodiments, the related content includes transaction options for an event. In some embodiments, the identified actionable terms are visually distinguished (e.g., with the display enabling unit1008) from other terms.

In some embodiments, the received (e.g., with the receiving unit1002) plurality of terms includes a name of a movie, one of the actionable terms comprises the name of the movie, and the related content comprises show times for the movie at one or more theaters that are local to the electronic device. In some embodiments, the received (e.g., with the receiving unit1002) plurality of terms includes a name of a movie, one of the actionable terms comprises the name of the movie, and the related content comprises a link to purchase one or more tickets for the movie at one or more theaters that are local to the electronic device.