# Patent

## Title
Method and apparatus for providing soft reminders

## Abstract

An approach is provided for presenting soft reminders (e.g., reminders for notes with no triggering criteria). A reminder manager receives an input, from a user, for specifying a note. The note is not associated with triggering criteria. In response to the request, the reminder manager retrieves contextual information from a device associated with the user, and causes, at least in part, presentation of a reminder of the note based, at least in part, on the contextual information.

## Background
BACKGROUND
Service providers and device manufacturers are continually challenged to deliver value and convenience to consumers by, for example, providing compelling network services and advancing the underlying technologies. One area of interest has been the development of services and technologies for personal information management (e.g., calendaring, task management, goal planning, and the like). In particular, service providers and device manufacturers face significant technical challenges in adapting such personal information management services for organizing and planning the personal and social lives of users where events, goals, and plans are fluid, dynamic, and nebulous.
SOME EXAMPLE EMBODIMENTS
Therefore, there is a need for an approach for providing a reminder (e.g., a soft reminder) of a note or other personal information that is nebulous.
According to one embodiment, a method comprises receiving an input, from a user, for specifying a note. The note is associated with no specific triggering criteria. The method also comprises retrieving contextual information from a device associated with the user. The method further causing, at least in part, presentation of a reminder of the note based, at least in part, on the contextual information.
According to another embodiment, an apparatus comprising at least one processor, and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause, at least in part, the apparatus to receive an input, from a user, for specifying a note. The note is associated with no specific triggering criteria. The apparatus is also caused to retrieve contextual information from a device associated with the user. The apparatus further causes, at least in part, presentation of a reminder of the note based, at least in part, on the contextual information.
According to another embodiment, a computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause, at least in part, an apparatus to receive an input, from a user, for specifying a note. The note is associated with no specific triggering criteria. The apparatus is also caused to retrieve contextual information from a device associated with the user. The apparatus further causes, at least in part, presentation of a reminder of the note based, at least in part, on the contextual information.
According to another embodiment, an apparatus comprises means for receiving an input, from a user, for specifying a note. The note is associated with no specific triggering criteria The apparatus also comprises means for retrieving contextual information from a device associated with the user. The apparatus further comprises means for causing, at least in part, presentation of a reminder of the note based, at least in part, on the contextual information.
Still other aspects, features, and advantages of the invention are readily apparent from the following detailed description, simply by illustrating a number of particular embodiments and implementations, including the best mode contemplated for carrying out the invention. The invention is also capable of other and different embodiments, and its several details can be modified in various obvious respects, all without departing from the spirit and scope of the invention. Accordingly, the drawings and description are to be regarded as illustrative in nature, and not as restrictive.



BRIEF DESCRIPTION OF THE DRAWINGS
The embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings:
FIG. 1 is a diagram of a system capable of providing a soft reminder, according to one embodiment;
FIG. 2 is a diagram of components of a note manager capable of providing a soft reminder, according to one embodiment;
FIG. 3 is a diagram of components of a polymorphic note, according to one embodiment;
FIG. 4 is a diagram illustrating organization of a plurality of polymorphic notes into electronic notebooks, according to one embodiment;
FIG. 5 is a flowchart of a process for providing soft reminders, according to one embodiment;
FIG. 6 is a flowchart of a process for generating soft reminders, according to one embodiment;
FIG. 7 is a flowchart of a process for generating recommendations based on a soft reminder, according to one embodiment;
FIG. 8 is a diagram of a user interface for providing soft reminders, according to one embodiment;
FIG. 9 is a flowchart of a process for presenting polymorphic notes in a graphical user interface, according to one embodiment;
FIG. 10 is a flowchart of a process for determining relevance factors for presenting polymorphic notes in a graphical user interface, according to one embodiment;
FIG. 11 is a flowchart of a process for displaying a recent activity cue related to polymorphic notes in a graphical user interface, according to one embodiment;
FIG. 12 is a diagram of a graphical user interface presenting polymorphic notes, according to one embodiment;
FIGS. 13A and 13B are flowcharts of a processes for generating a polymorphic note, according to various embodiments;
FIG. 14 is a flowchart of a process for storing and sharing a polymorphic note in an electronic notebook, according to one embodiment;
FIG. 15 is flowchart of a process for recording updates to the polymorphic note, according to one embodiment;
FIG. 16 is a diagram of a user interface for interacting with a polymorphic note, according to one embodiment;
FIGS. 17A and 17B are diagrams of user interfaces for entering information into a polymorphic note, according to various exemplary embodiments;
FIG. 18 is a diagram of hardware that can be used to implement an embodiment of the invention;
FIG. 19 is a diagram of a chip set that can be used to implement an embodiment of the invention; and
FIG. 20 is a diagram of a mobile terminal (e.g., a handset) that can be used to implement an embodiment of the invention.



DESCRIPTION OF SOME EMBODIMENTS
Examples of a method, apparatus, and computer program for providing soft reminders are disclosed. In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the invention. It is apparent, however, to one skilled in the art that the embodiments of the invention may be practiced without these specific details or with an equivalent arrangement. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the embodiments of the invention.
Although various embodiments are described with respect to a polymorphic note, it is contemplated that the approach described herein may be used with any other information object that can be associated with a reminder and that specifies no triggering criteria. Further, the term “triggering criteria” (e.g., time, location, people, etc.) refer to factors that will cause the reminder to be activated. For example, in a common example of an alarm clock, the triggering criterion is the time at which the alarm is set to sound.
As used in the approach described herein, a polymorphic note is a common object model for information that relieves users of the need to decide if they are creating a meeting, an event, a task, or a simple memo. The polymorphic note supports a variety of information traditionally corresponding to separate and distinct application types (e.g., a calendar application, a task management application, a note application, an e-mail application, an instant messaging application, a text messaging application, a social networking application, a location application, or a combination thereof). From the perspective of the user, a polymorphic note can be thought of as an event, a task, a simple reminder, etc. that is able to evolve into other objects of a different application type or even a combination of application types based on how the information within the polymorphic note develops over a period of time.
FIG. 1 is a diagram of a system capable of providing soft reminders, according to one embodiment. It is noted that there are numerous traditional electronic personal information management (PIM) solutions (e.g., calendaring applications, task management applications, etc.) for organizing a user's life available on the market. However, outside of business uses, there has been relatively little adoption or use of these traditional PIM solutions compared to e-mail, instant messaging, and other similar tools. This lack of adoption can be attributed, at least in part, on the fact that personal organizing often begins with potential events, fuzzy timeframes, and long-term goals. As users interact, these events, timeframes, and goals evolve into a more concrete form. Even then, this form can keep changing up to, during, and even after the event. Once an event has occurred, the planning documentation itself acts as a record of the event that provokes memories and inspires future actions and events.
Moreover, users generally have their own complex organizational methods that are very personal and intuitive. These methods typically have not been supported by traditional PIM solutions, which require discrete up-front knowledge of what and when with regards to an event or goal before considering who or where. Under traditional approaches, little or no support exists for incorporating possible alternatives to events or ambitions that are not tied to a specific time (e.g., a general ambition to “get more exercise” with no specific accompanying details). In other words, a user has to know exactly what the user wants to do and when the user wants to do it before the user can even start creating or recording an event in a traditional PIM application or solution. The regimented and inflexible approach of traditional PIM solutions does not reflect how most people actually plan events or goals that build on an initial (often fragmented) idea. If a user wants to initiate an event with just a thought, the user is generally limited to recording the thought in a memo or task that is stranded in its own tool or application. When the thought becomes more concrete, there is typically no easy or automated way to transfer the information recorded in the memo or task to, for instance, a calendaring application. Because these PIM solutions do not meet the full spectrum of user needs, adoption of existing tools is limited primarily to specific segments of users' lives (e.g., most often as a tool used only for work).
To address these problems, the system 100 of FIG. 1 introduces the capability to generate a note (e.g., a polymorphic note) to enable a user to record events, tasks, and other information whose details range from being concrete to ambiguous. It is noted that although several embodiments of the invention are discussed with respect to a user initiating or requesting the creation of a note, it is recognized by one of ordinary skill in the art that the embodiments of the inventions have applicability to any entity (e.g., both users and non-users of the note) for initiating the creation of the note. For example, a service provider, network operator, content provider, and the like may create a note for users. In particular, a service provider may, for instance, create notes as a way of communicating to all or some groups of users (e.g., communicating service updates, new functionalities, marketing information, etc.). Also, a service, service provider, or other authorized entity may create notes on behalf of the user, for instance, based on the user's usage behavior other pattern.
In the approach described herein, the note of the system 100 supports the capability of recording the fluid evolution of idea or concept into an event, task, or other similar PIM element or information, thereby enabling users to record their ideas and plan events in a more natural and evolutionary way. In one embodiment, the note is a polymorphic note, but it is also contemplated that the note may be any document or information object associated with a subject, idea, etc. for which the user would like to set a reminder. By providing a single object (i.e., the polymorphic note) that can fulfill the purposes or historically separate objects, the system 100 advantageously enables a more natural progression from a simple idea (e.g., a textual note) to a list of things to do next (e.g., a task) to a scheduled happening (e.g., a meeting, a social event, etc.) alone or with one or more friends. By way of example, planning an event is dynamic in which various options are considered from multiple sources and plans continue to evolve up to and even during an event. Moreover, it is rare for only one person to be involved in developing a plan. Coordinating events between two or more people is observed to be a highly iterative and disjointed process. This is especially true for information events which can start with a casual comment between two people and evolve into a planned event among many people. The constant conversation and coordination revolving around the event can cause it to gain momentum and become even more significant. There typically is no formal planning process for these types of casual events, and one is often not desired. Instead, what many users want is a cohesive history of the conversation building to the event that can span time, variable amounts of people, and multiple communication tools such as phone calls, text messaging, instant messaging, e-mail, and the like. The system 100 enables sharing of the polymorphic note among a group of users to record and leverage this type of group dynamic.
The time-critical factor among plans can vary widely and also affect the development of an idea or plan. For example, time spans associated with an idea or event can range from “I have a meeting in five minutes” to “I want to go to Australia this summer” to “I want to go skydiving someday.” In fact, some plans cannot or are not tied to a specific time. The flexible nature of the polymorphic note enables the note to capture any of these time frames within a common object construct. However, this same flexibility makes it difficult to remind users of specific notes of importance, particularly when those notes are nebulous. Referring to the three example ideas or events provided in the first part of this paragraph, each of these events has a different level of time specificity. For instance, in the statement “I have a meeting in five minutes,” time is expressed concretely and a corresponding traditional or hard reminder can be set for five minutes from to alert the user of the meeting. However, time becomes more nebulous in the two subsequent ideas. More specifically, the statement “I want to go to Australia this summer” indicates a season (e.g., summer) that traditionally spans anywhere from May to September depending on local convention. With a traditional reminder, it is difficult to determine when a hard reminder (e.g., that requires a specific triggering criterion such as date and/or time) should be set for such a statement. For instance, the reminder may be set a few days before the beginning of summer, sometime before the end of summer, sometime between the time of the statement and the end of summer, or any permutation thereof. Finally, the statement “I want to go skydiving someday” provides no specificity with respect to time, and therefore, setting a traditional reminder for this statement would be problematic. Moreover, the statement includes no other traditional triggering criteria (e.g., location, people) that can serve as the basis for a reminder. Without a suitable reminder system, these potentially valuable or important ideas may be lost to the user.
To address this additional problem, the system 100 introduces the capability to set reminders for notes or other personal information objects (e.g., polymorphic notes) that include no specific criteria associated with traditional reminders (e.g., time, location, people). More specifically, the system 100 provides for “soft reminders” which make notes become periodically visible to the user. In one embodiment, notes that a user does not want to lost track of are displayed periodically without needing a specific trigger. For example, the system 100 monitors contextual information associated with a user's device and then presents the one or more notes for which a soft reminder has been set based on the contextual information. Soft reminders are generally less obtrusive than traditional reminders, and, for instance, can be set to occur when the user is not engaged in some other activity on the device (e.g., photo gallery, e-mail, messaging, Internet browsing, etc.). In certain embodiments, soft reminders may be presented randomly during periods in which the device is dormant. In another embodiment, the user may opt to have the soft reminder displayed even when the user is engaged in an activity on the device. Soft reminders are particularly applicable for the many aspirations (e.g., “I need to get in shape,” “look into alternative professions”) people articulate that have no clear triggering criteria.
In one embodiment, the system 100 can parse the text of the note to determine a subject or other criteria related to the note. The soft reminder can then be triggered on detecting of contextual information that is related to the parsed subject. For example, if the note states “I need to go to the grocery store soon,” the system 100 can determine that the note concerns grocery shopping and then present a soft reminder to the user when contextual information shows that a grocery store is nearby.
In another embodiment, the system 100 can parse the text of the note to determine a subject or other criteria as in the above embodiment. Then, the system 100 can recommend activities, content, contacts, etc. and present these recommendations in connection with the corresponding soft reminder.
In another embodiment, the soft reminder may be applicable to a group of people. For example, a group of friends may set a common goal (e.g., travel to Europe someday). The system 100 can then apply the approach described herein to the entire group. In certain embodiments, the system 100 can coordinate the reminders so that the reminders are provided to members of the group at approximately the same time. In other embodiments, the system 100 may suggest or mediate a communication session among the group. The system 100 may also present the soft reminders based on the contextual information of each individual member of the group.
In yet another embodiment, the system 100 enables the user to convert a soft reminder to a traditional or hard reminder by receiving input from the user for specifying one or more triggering criteria. For example, a soft reminder to “Learn to ski someday” can be converted to a scheduled event of “Go skiing with friends on Saturday.”
In one sample use case, John is a busy student who wants to get in shape. He quickly jots a note into his organizer (e.g., a note application) to remind him. Later, when his phone or device is idle, a soft reminder appears on his phone and reminds him “Go running” Along with the note is a link labeled “Get Ideas.” He clicks on “Get Ideas” and sees a list of things related to running, ranging from local sporting goods stores to an upcoming “Fun Run” fund-raising event. He chooses the store “Running Revolution” and sees that they are open late tonight. He makes a related note with a reminder to go by the store later to buy a new pair of running shoes for a planned run the next day. After his run the next day, he feels great and realizes that he will be more likely to keep running if he actually schedules the running sessions. He set up “morning run” as a recurring event on Monday, Wednesday, and Friday mornings from 7 am to 8 am.
As shown in FIG. 1, the system 100 comprises user equipment (UEs) 101a-101n having connectivity to a note manager 103 and a service platform 105 via a communication network 107. In one embodiment, the note manager 103 facilitates the generation of a polymorphic note to record user events or other similar PIM related information over, for example, a period of time. As noted previously, the polymorphic may be created with no specific triggering criteria (e.g., time, location, people, etc.), but may nonetheless be associated with soft reminders. The note manager 103 also facilitates the subsequent access and/or manipulation of the polymorphic note and any corresponding soft reminder by a note application (e.g., note applications 109a-109n) executed by the UEs 101a-101n or by one or more of the services 111a-111n of the service platform 105. In one embodiment, the services 111a-111b include a suite of services such as a location management service (e.g., a mapping service or navigation service), contact management service, messaging service, social networking service, media content service (e.g., music service, video service, etc.). In another embodiment, the polymorphic note may contain information (e.g., parsed from the text of the note) to initiate corresponding actions or functions provided by the note manager 103, the services 111a-111n, and/or any other services available over the communication network 107 related to the soft reminder approach described herein. In addition or alternatively, the note manager 103 may operate a web server to facilitate access to and/or manipulation of the polymorphic note and/or soft reminders using a web browser (not shown) executed on one or more of the UEs 101a-101n. In this way, the UEs 101a-101n need not execute a note application 109 to access the functions of the note manager 103.
In one embodiment, the note manager 103 generates a polymorphic note or other type of note that includes information of a plurality of application types in which the information is developed or evolved over period of time. The note manager 103 stores the information in, for instance, the database 113 of user note data. In addition or alternatively, the user note database 113 can reside on one or more nodes connected directly or indirectly to one or more of the services 111a-111n. In other embodiments, the user note database 113 resides one or more nodes in the network 107. More specifically, the user note database 113 includes one or more processes (not shown) and one or more data structures that store polymorphic notes, soft reminders, and related information as well as data, configurations, user profiles, variables, conditions, and the like associated with operation of the note manager 103 and/or the note applications 109a-109n. The note manager 103 may also organize any generated polymorphic notes into one or more electronic notebooks. These notebooks can then be shared among one or more other users so that the other users can collaborate in developing the polymorphic note as described previously. By way of example, the notebooks may be assigned attributes (e.g., work, home, personal, private, etc.) that direct how and to whom the notebook is shared. The users can view these notebooks of polymorphic notes and/or the polymorphic notes themselves in, for example, a contextually based graphical user interface. The note manager 103 may also access the electronic notebooks to generate contextually appropriate soft reminders.
The graphical user interface can further depict underlying relationships between the information in the notes to enable the user to more easily exploit the information and manage the large amount of complex information contained in polymorphic notes and/or soft reminders. By enabling effective associative browsing through connections or notes, the note manager 103 can help users set soft reminders, achieve goals, complete tasks, and discover new types of information that the users find meaningful to record digitally. In addition, the exploration of links and connections between notes may potentially improve the relevance of contextual suggestions and related soft reminders made by the note manager 103 by enabling the user to randomly and spontaneously rediscover forgotten notes and ideas at opportune moments.
In one embodiment, the note manager 103 and the service platform 105 can be implemented via shared, partially shared, or different computer hardware (e.g., the hardware described with respect to FIG. 18).
By way of example, the communication network 107 of the system 100 includes one or more networks such as a data network (not shown), a wireless network (not shown), a telephony network (not shown), or any combination thereof. It is contemplated that the data network may be any local area network (LAN), metropolitan area network (MAN), wide area network (WAN), a public data network (e.g., the Internet), or any other suitable packet-switched network, such as a commercially owned, proprietary packet-switched network, e.g., a proprietary cable or fiber-optic network. In addition, the wireless network may be, for example, a cellular network and may employ various technologies including enhanced data rates for global evolution (EDGE), general packet radio service (GPRS), global system for mobile communications (GSM), Internet protocol multimedia subsystem (IMS), universal mobile telecommunications system (UMTS), etc., as well as any other suitable wireless medium, e.g., worldwide interoperability for microwave access (WiMAX), Long Term Evolution (LTE) networks, code division multiple access (CDMA), wideband code division multiple access (WCDMA), wireless fidelity (WiFi), satellite, mobile ad-hoc network (MANET), and the like.
The UEs 101 are any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, station, unit, device, multimedia tablet, multimedia computer, Internet node, communicator, desktop computer, laptop computer, Personal Digital Assistants (PDAs), or any combination thereof. It is also contemplated that the UE 101 can support any type of interface to the user (such as “wearable” circuitry, etc.). The UE 101 may also be equipped with one or more sensors (e.g., a global positioning satellite (GPS) sensor, accelerometer, light sensor, etc.) for use with the services 111a-111n. 
By way of example, the UEs 101, the note manager 103, and the service platform 105 communicate with each other and other components of the communication network 107 using well known, new or still developing protocols. In this context, a protocol includes a set of rules defining how the network nodes within the communication network 107 interact with each other based on information sent over the communication links. The protocols are effective at different layers of operation within each node, from generating and receiving physical signals of various types, to selecting a link for transferring those signals, to the format of information indicated by those signals, to identifying which software application executing on a computer system sends or receives the information. The conceptually different layers of protocols for exchanging information over a network are described in the Open Systems Interconnection (OSI) Reference Model.
Communications between the network nodes are typically effected by exchanging discrete packets of data. Each packet typically comprises (1) header information associated with a particular protocol, and (2) payload information that follows the header information and contains information that may be processed independently of that particular protocol. In some protocols, the packet includes (3) trailer information following the payload and indicating the end of the payload information. The header includes information such as the source of the packet, its destination, the length of the payload, and other properties used by the protocol. Often, the data in the payload for the particular protocol includes a header and payload for a different protocol associated with a different, higher layer of the OSI Reference Model. The header for a particular protocol typically indicates a type for the next protocol contained in its payload. The higher layer protocol is said to be encapsulated in the lower layer protocol. The headers included in a packet traversing multiple heterogeneous networks, such as the Internet, typically include a physical (layer 1) header, a data-link (layer 2) header, an internetwork (layer 3) header and a transport (layer 4) header, and various application headers (layer 5, layer 6 and layer 7) as defined by the OSI Reference Model.
In one embodiment, the note application 109a and the note manager 103 interact according to a client-server model. It is noted that the client-server model of computer process interaction is widely known and used. According to the client-server model, a client process sends a message including a request to a server process, and the server process responds by providing a service. The server process may also return a message with a response to the client process. Often the client process and server process execute on different computer devices, called hosts, and communicate via a network using one or more protocols for network communications. The term “server” is conventionally used to refer to the process that provides the service, or the host computer on which the process operates. Similarly, the term “client” is conventionally used to refer to the process that makes the request, or the host computer on which the process operates. As used herein, the terms “client” and “server” refer to the processes, rather than the host computers, unless otherwise clear from the context. In addition, the process performed by a server can be broken up to run as multiple processes on multiple hosts (sometimes called tiers) for reasons that include reliability, scalability, and redundancy, among others. In one embodiment, the server is integrated as part of the client.
FIG. 2 is a diagram of components of a note manager capable of providing a soft reminder, according to one embodiment. By way of example, the note manager 103 includes one or more components for generating, sharing, and updating a note (e.g., a polymorphic note) and for creating corresponding soft reminders. It is contemplated that the functions of these components may be combined in one or more components or performed by other components of equivalent functionality. In this embodiment, the note manager 103 includes at least a control logic 201 which executes at least one algorithm for executing functions of the note manager 103. For example, the control logic 201 interacts with the note generator module 203 to receive a request, from a user, to generate a note and/or soft reminder. The request can be initiated via the note application 109 or a via a web portal provided of the note manager 103 by initiating a command to create a new note. In one embodiment, the new note may be created as a blank note or as a duplicate of an existing note that can then be edited. In another embodiment, instead of creating a note, the note may be retrieved from another device (e.g., another UE 101), another component of the communication network 105, or any other source. In yet another embodiment, the soft reminder may also be created as a duplicate of or based on template provided an existing soft reminder. In this way, if the user likes a particular soft reminder, that soft reminder may then be used as the basis for creating a new soft reminder.
It is contemplated that the request can include any amount or specificity of information to initiate the creation of a polymorphic note. In the example of FIG. 2, the note generator module 203 interacts with the parsing module 205 to analyze any textual input that may have been provided in the request to determine at least a part of the information to include in the note. More specifically, the parsing module 205 enables input of information using free-form text input. For instance, a user can simply type “Meet with Steve at 6 pm next Thursday at Molly McGees,” resulting in the parsing module 205 creating a meeting at 6 pm next Thursday with the location “Molly McGees.” In one embodiment, the parsing module 205 also enables creation of soft reminders and determination of their time and/or mode of presentation based on the parsed information. The parsed results can then be presented to the user for confirmation and/or correction. In addition or alternatively, the note generator module 203 can present the user with a traditional input selection form to provide information for inclusion in the polymorphic note. The note generator module 203 may also determine whether any common attribute or information (e.g., event time, location, etc.) is missing from the information provided in the initial request and prompt or provide a reminder to the user that the information is missing (e.g., “Please set a start time for your event”). In one embodiment, the request to create or retrieve the note can be indicated by non-textual means. For example, the user can initiate a request by pointing out a location (e.g., a point of interest (POI)) on a digital map. The specified map location will then mean, for instance, the location of the event described in the note.
Next, either the note generator module 203 or the parsing module 205 can interact with the media module 207, social tools module 209, and/or context module 211 to supplement the information included in the note. The media module 207, for instance, enables the insertion or attachment or linking of media (e.g., audio, video, etc.) and/or document files to the polymorphic note. Once the media content is inserted into the polymorphic note, the media content effectively becomes a part of the polymorphic note and is transported (e.g., transmitted or copied to another UE 101 or node of the network 107) as a unit with the polymorphic note until the media is otherwise removed. In one embodiment, the media content may also be used as the alert for a corresponding soft reminder.
In another embodiment, the social tools module 209 enables the addition any number of social tools to any polymorphic note. Examples of social tools are a blog-like conversation thread, multiple choice voting, shared tasks, commenting, etc. For example, each of the social tools enables multiple users to interact with or express comments about the information in the polymorphic note. These interactions and/or comments can be recorded in the polymorphic note. In one embodiment, the social tools and information included in a note may be different or presented differently depending on the intended recipients of the note, e.g., family members may not need as much information as business associates or vice versa when they are invited to the same party. Accordingly, when requesting generation of the note, the user can specify what information is displayed depending on the intended recipients.
The context module 211 enables the note manager 103 to automatically determine attributes (e.g., location, people, time, etc.) of the note that can be retrieved from either one or more of the services 111 of the service platform 105 and/or a sensor included in the UE 101 associated with the user. By way of example, place attributes can be set via navigation of places specified in the user's contact list or through a maps database or determined by a location-based sensor (e.g., GPS satellite receiver). In this case, the user can select or enter a location for recognition by the context module 211. It is contemplated that the note may be associated with any number of locations. In one embodiment, the context information may also be used to direct the functioning and/or operation of a soft reminder corresponding to the note.
Similarly, people attributes can be set through selection from the user's contact list or a public directory. In another embodiment, the user may begin typing the names of people to associate with the note. The context module 211 can then match the typed name against the user's contact list or public directory to specify the name. It is contemplated that the user can associate any number of names with the note. The time attributes can be set via traditional calendar views or a clock of the UE 101.
After generating the note, the control logic 201 of the note manager 103 interacts with the sharing module 213 to share the note with other users. In the approach described herein, individual notes as well as notes aggregated in electronic notebooks may be shared. Sharing can be “read only” (e.g., other users can view but not edit the data) or “read/write” (e.g., other users can edit any attribute or information in the polymorphic note). In one embodiment, the owner or creator of the note can share a note. If the note creator shares a note and then deletes it (or unshares it), the recipients receive, for instance, notification of the deletion or unsharing. In certain embodiments, the sharing module 213 will ask whether the recipient would like to make a local copy of the shared note, which creates a static snapshot of the note for the recipient. This local copy is no longer linked to the original note. The copying is offered because having a creator delete a note might be unnerving to the recipient if the recipient added information to the note, wanted to keep a record of the note contents, etc. If a recipient is removed from sharing a note, creates the recipient's own copy, and is later added back to the sharing the same note, the sharing module 213 can offer to merge the local copy into the original note. In one embodiment, a note or notification of a note that is no longer valid may disappear from the recipient's notes display (e.g., on the recipient's device) after a predetermined validity time has expired. The expiration may be determined, for instance, by comparing the time of validity to the clock of the user's device. It is noted that the note is only removed from the display note from memory; the note can still be accessed or linked to other notes if needed based on the dependencies between the notes.
In addition, UEs 101 associated with the users of the note can be temporarily disconnected from the network 107, therefore, local copies of the note are often edited and synchronization conflicts can arise. In embodiment, the sharing module 213 handles the synchronization and synchronization conflicts. If a user encounters synchronization conflicts with the user's own notes (e.g., when editing a note through both the web portal and a disconnected mobile device such as a handheld mobile computer and then reconnecting the mobile device), the user is prompted directly as to how to resolve the conflict or discrepancy (e.g., asked which version to accept).
However, in the social setting of shared notes, conflicts can be resolved differently. Upon information conflicts or discrepancies caused by different users, the users causing the conflict are presented with options to (socially and gracefully) resolve the conflict, including contacting each other directly (with contact information), adding to the note's conversation thread, and/or making a personal copy of the polymorphic note to save changes.
As shown, the sharing module 213 has connectivity to the logging module 215. The logging module 215 operations to record updates to the note by the owner or other users of the note. In one embodiment, the logging module 215 also records information related to use of any of the social tools included in the polymorphic note. For example, this information includes results of voting, comments, status of shared tasks, etc.
In yet another embodiment, the control logic 201 interacts with a user interface module 217 to present the notes and/or soft reminders stored in the user note database 113 in a navigable timeline or notestream view. By way of example, the user interface module 217 retrieves information for the user note database 113 to order the notes according the loose chronological order discussed above. In some embodiments, the notes are stored in the user note database 113 according the loose chronological order, and the user interface module 217 need not perform the ordering. The user interface module 217 may also evaluate context information associated with the note to determine the relevance of the notes and/or soft reminder with respect to a particular user and then direct the display of the most relevant notes and/or soft reminders to the user. In another embodiment, the user interface module 217 can highlight or mark one or more of the notes in the graphical user interface according to user-specified attributes (e.g., shared notes or notes that the user considers notable).
As shown in FIG. 2, the user interface module 217 may further interact with a connections module 219 to link the user's collection of notes and/or soft reminders to each other. Links enable the user to synergistically tie together smaller notes, ideas, or reminders into larger notes and bigger accomplishments. In one embodiment, the connections module 219 may define relationships between notes explicitly as specified by a user or implicitly based on associations, content, and the semantic structures of the notes. An explicit link between two notes ensures that they will be presented together in a graphical user interface of connections. For example, the user may want to link a note about a new restaurant to another note about catching up with an old friend in the same neighborhood as the new restaurant. In certain embodiments, the connections module 219, for instance, can predict or infer an implicit connection between notes based on contextual information and other associative factors. These implicit connections provide, for instance, contextual suggestions for possible connections among different notes in the user's collection. In one example, the connections module 219 may enable the user to make connections among separate notes to visualize a potential connection between an upcoming birthday for a vegan friend stored in one note with a recipe for a dairy-free chocolate cake recorded in another note.
In one embodiment, the user can link two notes by, for instance, dragging the graphical representation of one note on top of the other note. By way of example, this dragging may be accomplished using a cursor device (e.g., a mouse, pointer, trackpad, etc.). In addition or alternatively, if the user's device includes a touch screen display (e.g., a kiosk, smartphone, internet tablet, handheld computer, etc.) the drag the notes using finger control. In another embodiment, the user may use finger touching on a touch screen display to link the notes by, for instance, touching in sequence each of the two notes. The user can also easily correct of modify the links between notes by moving the notes against (e.g., to make a connection) or away (e.g., to delete a connection) from each other.
Alternatively, the user may access the functions of the note manager 103 via an access control application (e.g., the note application 109) in the UE 101 such as a widget, according to another embodiment. Widgets are light-weight applications, and provide a convenient means for presenting information and accessing services. It is contemplated that the functions of these components may be combined in one or more components or performed by other components of equivalent functionality. In this embodiment, the note application 109 includes modules similar to those of the note manager 103, as previously described. To avoid data transmission costs as well as save time and battery, its control logic can fetch polymorphic note data cached or stored in its own database, without requesting data from any servers or external platforms, such as the note manager 103 or the service platform 105.
FIG. 3 is a diagram of components of a polymorphic note, according to one embodiment. As previously discussed, a polymorphic is an example of a note that is used in the approach described herein. As shown in FIG. 3, a polymorphic note 301 includes four main sections: (1) a plain text section 303, (2) a media content section 305, (3) a social tools section 307, and (4) a contextual associations section 309. The plain text section 303 includes text input specified by users of the polymorphic note. As described previously, the text input is parsed to identify information such as soft reminders, web links, phone numbers, locations, e-mail addresses, and the like. The parsed information can then be used to determine one or more attributes (e.g., data elements) of the polymorphic note.
The social tools section 307 provides features to make polymorphic notes a social experience. For example, the social tools section 307 provides for a range of social interactions including commenting functions whereby users of the polymorphic note can provide commentary on any topic supported by the polymorphic note. The commentary can then be viewed by other users and included as part of the logged history of the polymorphic note for later access. The section 307 also provides for a structured task list for assigning tasks to one or more users of the polymorphic note. The polymorphic note can then document the assignments and completion status of the tasks. An example of another social tool is a voting or polling function which enables multiple people to set up a vote of any topic of interest (e.g., where to go for lunch, meeting dates and times, favorite actor, etc.). Yet another social function is the RSVP list which shows response of users who have been invited to a particular event.
The contextual associations section 309 enables the note manager 103 to associate information such as time, people, location, reminders, status, and soft reminders with the polymorphic note. For example, with respect to time, the note manager by default associates the creation time with polymorphic note. If a user of the polymorphic note sets a specific time (e.g., a start time, duration, end time, etc.), the set time replaces the default creation time. As described earlier, people and location can be obtained from sensors of the UE 101 or from one or more services 111 related to the contextual association. In one embodiment, the notes may be linked with each other so that the notes form a journey or chain. In one embodiment, the note manager 103 will suggest a link between two or more notes depending on, e.g., the relevancy or similarities of the notes.
With respect to reminders, user can associate one or multiple reminders to a note. These reminders can then appear online via the web portal or on the UE 101 of the user via the note application 109. By way of example, the type of reminder that is presented depends on the type of associations the user has added to the note.
In one embodiment, polymorphic notes have both “private” attributes that only the note creator or owner can view and edit, as well as “public” attributes that are viewable and sometimes editable by others through note sharing. By way of example, private attributes include the name of the notebook in which the polymorphic note is stored (e.g., see discussion of notebooks with respect to FIG. 4 below), personal flags, soft and hard reminders. Public attributes include the note title, the note body (which can contain text, clickable URLs, pictures, video clips, audio clips, and links to other notes), a variety of social tools (including voting for several options, RSVP, checklists, conversation thread, etc.), and a revision history (which anyone can view, but only the note creator can “undo” to a certain point in the history).
In another embodiment, polymorphic notes can be formatted and/or skinned. The note body allows, for instance, font color/family/size and similar common text formatting, background color and/or image, similar visual formatting. By way of example, an image of the location or POI associated with a polymorphic note can be used as a background for the note. This image may be obtained from, for instance, a mapping service of the service platform 105 or from a picture collection of the creator of the note. In yet another embodiment, the picture or formatting theme of the note may be selected to reflect advertising, marketing, branding, or other similar purposes. Users can create a blank note, apply formatting, and then save the note as a new formatting note “template,” for easy application to other notes in the future. In one embodiment, this appropriate template to apply to a new note can be determined based on the contextual information of the new note. For example, if one or more key words associated with the new note matches an existing template, the missing information for new note can be taken or suggested from the template. The suggested information can be edited according to the needs of the new note.
FIG. 4 is a diagram illustrating organization of a plurality of polymorphic notes into electronic notebooks, according to one embodiment. As shown in FIG. 4, polymorphic notes may be grouped into notebooks, which, in one embodiment, are the primary organizational tool available to users. Notebooks service three primary functions: (1) separations of polymorphic notes for sharing (or isolating), (2) managing subscriptions to indicate what polymorphic notes are shared with particular users, and (3) arbitrary organization of polymorphic notes through both explicit and implicit connections of the notes.
In one embodiment, for each user, a polymorphic note exists in one notebook. Users may have multiple notebooks including predetermined default notebooks if needed. Notebooks also have certain attributes that can be easily changed such as the list of users sharing the polymorphic note can be easily changed or a default display theme. For example, a user 401a can have a notebook 403a for the user's work calendar, a notebook 403c for family organization, and a notebook 403e for the local sports calendar. This organization scheme enables the user to easily sort the user's notes and focus on the items of most interest or importance.
In addition, notes (e.g., notes 301a-301b) can be linked to each other to provide an explicit relationship between them and to facilitate easy navigation between them and/or indicating sequence of the notes. Linking (e.g., indicated by the lines with a double circle) is independent of the notebooks 403a-403f, and any two notes 301 may be linked, though only two notes 301 may be associated with any single link. In certain embodiments, the note manager 103 may suggest implicit relationships among otherwise unlinked notes. These suggestion may be triggered by an evaluation of associative factors (e.g., associations, content, semantic structures, and the like).
For example, if a user decides to create a note for a birthday party and invite friends to it, she can then create a related note 301 to remind her to bake a cake and to shop for ingredients of the cake on time, and another related note 301 to remind her to talk to a friend about buying a birthday present. This way she can easily hop between the related notes 301 while she is thinking about them without sending all of this information along with the invitation.
In one embodiment, both the notebooks 403 and the linking are personal and are not shared, with the exception of the shared notebook 403a/403b. In this case, all notes 301 within a shared notebook 403a are seen within the shared notebook 403a by all parties sharing the notebook 403a. In another embodiment, if a user has had individual notes 301 from a notebook shared with him, then the entire notebook 403 is shared. A prompt asks, for instance, if the user would like to move all existing notes from that notebook 403 into the now-shared notebook 403.
FIG. 5 is a flowchart of a process for providing soft reminders, according to one embodiment. In one embodiment, the note manager 103 performs the process 500 and is implemented in, for instance, a chip set including a processor and a memory as shown in FIG. 19. In step 501, the note manager 103 retrieves a note with no specific triggering criteria from, for instance, the user note database 113, the service platform 105, another UE 101, a service provider, network operator, content provider, or the like. In addition or alternatively, the note can also be received as input from a user for specifying the note. For example, a typical note may state an aspiration such as “Get together more often with friends.” Although the aspiration may be an important goal for the user, the user does not yet have any firm plans in particular with respect to the note. In one embodiment, the note is created as a polymorphic note according to the processes for generating a polymorphic note described below with respect to FIGS. 13-17B. In addition, the processes for presenting a polymorphic note in a graphical user interface may also have been completed as described below with respect to FIGS. 9-12. It is also contemplated that the note may be any information object that can be associated with a soft reminder.
Next at step 503, the note manager 103 parses the note to determine a subject or criteria for directing the creation or display of the note. More specifically, the parsing process can result in isolating keywords, parameters, criteria, and the like for comparison against, for instance, a natural language model that correlates the isolated information against predetermined subjects or topics. In certain embodiments, the parsing process can result in creating new topics during the process. It is also contemplated that the parsing process may employ any algorithm well known in the art for semantically linking the parsed keywords and terms with the subjects or topics of interest. For example, in the above example, the note manager 103 may parse the terms “get together” and “friends” to mean that user is interested in the general subject or creating meetings linked with a group of contacts that are, for instance, identified as friends in the UE 101 or in an external service (e.g., social networking service) associated with the UE 101.
Per step 505, the note manager 103 then retrieves contextual information from the device. In addition or alternatively, the contextual information may be retrieved from a component of the communication network 105 such as the service platform 105 or other “cloud” or network based source of information related to the device. As described with respect to FIG. 2, the note manager 103 can automatically determine attributes (e.g., location, people, time, etc.) of associated with the UE 101 or a user that can be retrieved from either one or more of the services 111 of the service platform 105 and/or a sensor included in the UE 101. In one embodiment, the note manager 103 can then determine whether the contextual information relates to the subject of the note (step 507). For example, the contextual information may indicate that the user is performing a device activity (e.g., calling a friend).
Accordingly, the note manager 103 can match the context against the subject of the note (e.g., create meeting with friends) and present the soft reminder (step 509) at the UE 101. In one embodiment, the soft reminder can first be created and then presented at the UE 101 based on the context. By way of example, the presentation can be of the note itself that is overlaid on the home screen or other user interface of the UE 101. In addition or alternatively, the presentation of the soft reminder can be based on media associated with the note. For example, instead of presenting the note, the note manager 103 can display a related image as a background image on the home screen or screen saver, play audio related to the note, or the like. In this way, the note manager can present the soft reminder with more subtlety to spur the user's memory with regard to the note.
FIG. 6 is a flowchart of a process for generating soft reminders, according to one embodiment. In one embodiment, the note manager 103 performs the process 600 and is implemented in, for instance, a chip set including a processor and a memory as shown in FIG. 19. The process 600 assumes that at least one and a corresponding soft reminder has been generated as described with respect to FIG. 5.
The process 600 provides additional details and options to describe the process for generating and then presenting the soft reminder. In step 601, the note manager 103 specifies preferences for when to generate and/or show soft reminders. In one embodiment, options for generation and display of the reminder include generating and/or displaying the soft reminder only when the UE 101 is in a dormant activity period. For example, a UE 101 is dormant if the contextual information of the UE 101 indicates that no communication session is in progress, no applications are currently in active use, the user is making not inputs into the UE 101, and the like. In another embodiment, an option enables the user to specify during which specific applications or services can the note manager 103 generate and/or display soft reminders. By way of example, the note manager 103 may present a list of applications (e.g., email client, browser, messaging application, etc.) and enable the user to select specific applications or all applications to enable presentation of soft reminders. If this option is enabled, in one embodiment, the note manager 103 will provide for random, interstitial generation and/or appearance of notes overlaid in regular activity areas such as a photo gallery, email, messaging, browser home page, and the like.
After setting the preferences, the note manager 103 retrieves contextual information associated with the UE 101 as described with respect to FIG. 5 (step 603). If the context indicates that the UE 101 is dormant (step 605) and the preference is set to allow presentation of soft reminders during dormant periods, the note manager 103 will generate and/or present the soft reminder as, for instance, random appearances of noteworthy notes on a home screen or the note application screen. In one embodiment, the note manager 103 may first generate the reminder and then display the reminder during the same or another dormant period. If preferences are also configured to allow presentation of in other applications, the polymorphic note will determine from the context information whether the UE 101 is currently using the particular application (step 607) and then present the soft reminder overlaid on the application screen, home screen, or other user interface of the UE 101 (step 609).
FIG. 7 is a flowchart of a process for generating recommendations based on a soft reminder, according to one embodiment. In one embodiment, the note manager 103 performs the process 700 and is implemented in, for instance, a chip set including a processor and a memory as shown in FIG. 19. The process 700 assumes that at least one or more polymorphic notes have been created according to the processes for generating a polymorphic note described below with respect to FIGS. 13-17B. In addition, the processes for specifying a soft reminder as described with respect to FIG. 5 may also have been completed.
In step 701, the note manager 103 parses the note to determine related subjects and criteria as described with respect to FIG. 5. Next, the note manager 103 generates recommendations for actions, activities, content, contacts, and the like based on the subject of the note. For instance, in the above example of getting together with friends, the note manager 103 may suggest the friends to contact based on a communication history on the device, places to meet based on preferences of the contacts, time to meet based on calendar information, etc. (step 703).
In one embodiment, the recommendations are presented to the user if the user selects the option to “Get Ideas” or otherwise receive recommendations with respect to the note that is provided in the soft reminder (step 705). In other embodiments, the note manager 103 can automatically present the recommendations concurrently with the presentation of the soft reminder. In yet another embodiment, the note manager 103, for instance, at the user's option, can automatically initiate specific actions after presenting the soft reminder. For example, if the recommendation is to contact a friend about getting together, the note manager 103 can automatically initiate the call if directed by the user.
FIG. 8 is a diagram of a user interface for providing soft reminders, according to one embodiment. FIG. 8 depict an example user interface 800 of a note application through which a soft reminder is presented. As shown, the user interface screen 800 includes two main sections of note application: the notestream section 801 and the exploring connections section 803. The notestream section 801 displays a collection of polymorphic notes arranged in a loose chronological order along a timeline. In this example, as the user browses the note application, the note manager 103 determines that the contextual information (e.g., use of the note application) allows for random presentation of noteworthy polymorphic notes.
As shown, a soft reminder 805 is displayed as an overlay on the active application screen (e.g. the polymorphic application). In one embodiment, the soft reminder includes a header 807 indicating that it is a soft reminder, the text 807 of the note itself, and a media file 809 related to the note. In addition, the soft reminder provides an option 811 to receive recommendations on related actions to accomplish the task specified in the text 807 as described with respect to FIG. 7. If the user does not want to take any specific action, the user can dismiss the soft reminder by selecting the close icon 813 represented by the “x”.
Although the example of FIG. 8 depicts the soft reminder 805 as an overlay on the note application, it is contemplated that the soft reminder 805 may be presented on the home screen, browser home page, or any other designated application of the UE 101.
FIG. 9 is a flowchart of a process for presenting polymorphic notes in a graphical user interface, according to one embodiment. In one embodiment, the note manager 103 performs the process 900 and is implemented in, for instance, a chip set including a processor and a memory as shown in FIG. 19. The process 900 assumes that at least one or more polymorphic notes have been created according to the processes for generating a polymorphic note described below with respect to FIGS. 13-17B. In step 901, the note manager 103 receives a request to display one or more polymorphic notes on a graphical user interface of a UE 101 associated with a requesting user. This request may be initiated, for instance, via the note application 109 executed on the UE 101 or a web portal of the note manager 103 by selecting a command to display the graphical user interface.
The note manager 103 then determines an order for displaying the polymorphic notes according a loose chronological order (step 903). The loose chronological order reflects the inherent flexibility of the polymorphic note that enables the user to record a variety of information including information without a specific date. As used herein, the term loose chronological order is used to refer to an order of the polymorphic notes that is specified according to either a date associated with the notes or a creation date of the notes if there is no associated date. In certain embodiments, a last revised date can be used in place of the creation date when there is not date associated with a polymorphic note. In addition or alternatively, the note manager 103 may provide the option for the user to specify the ordering method (e.g., by associated date, creation date, revision date, etc.). This hybrid approach enables all notes to be attached with a date for display on timeline. The date information is stored, for instance, in either the note itself or in meta-data associated with the date. For example, when a user creates or revises a note the note manager 103 generates a time stamp and associates the time stamp with the polymorphic note. As new polymorphic notes are created, the new notes can be inserted in the determined order or the timeline based on the ordering scheme described above.
Next, the note manager 103 determines whether any of the polymorphic notes to display match specific attributes for highlighting in the graphical user interface. In one embodiment, the note manager 103 highlights: (1) notes that are shared with or by other users and (2) notes that are designated as notable by the user. Accordingly, in step 905, the note manager 103 determines whether any of the notes that are to be displayed are shared. For example, the note manager 103 retrieves information regarding each polymorphic note from the user note database 113 to determine whether the creator or the note has designated the note for sharing. In one embodiment (e.g., as described below with respect to FIG. 10), the sharing determination is made by querying whether the polymorphic note is organized in a notebook that includes an attribute for sharing. If the polymorphic note is shared, the graphical representation of the note is highlighted or otherwise marked to indicate its shared status (step 907). In one embodiment (see, e.g., FIG. 12 which depicts an example graphical user interface), the note is designated with an icon to indicate its shared status. It is contemplated that the note manager can use any mechanism (e.g., color, graphics, animation, audio alerts, etc.) to indicate the shared status.
If the the polymorphic note is not shared, the note manager 103 next determines whether the polymorphic note has been designated as notable by the user (step 909). In addition or alternatively, the note manager 103 may also determine whether the note has been marked as notable by another user of the polymorphic note. In this case, the note manager 103 may differentiate the highlighting based on which user has designated the note as notable (e.g., a different icon or color for each respective user). If the note has been designated as notable, the note manager 103 highlights the polymorphic note using the process described above for marking the shared status of note (step 911) with the exception that the highlighting or other marking is specific to the notable status.
The note manager 103 may continue marking and highlighting the notes based on additional attributes (e.g., user-defined categories such as home, work, personal, etc.) until all such attributes have been highlighted. It is contemplated that each polymorphic note may be designated and highlighted using any number of attributes or classifications for easy identification in the graphical user interface. In certain embodiments, the highlighting may be performed according to predetermined themes which specify common graphical elements, styles, colors, etc. to use in rendering the graphical user interface.
In step 913, the note manager 103 determines the appropriate display size of each polymorphic note. In one embodiment, the size of a polymorphic note is based at least in part on the content of the note and any recent activity of the note. By way of example, if a note contains content that includes media content (e.g., pictures, video, and the like), the note may be displayed in a larger size so that the content can be more easily seen. In one embodiment, the media content can be displayed in a separate window to maximize the available display size. Similarly, if there has been recent activity (e.g., adding new content, receiving replies, receiving comments, etc.) with respect to the polymorphic note, the note may be rendered in a larger size to draw attention to the recent activity.
Once the order, highlights, and sizes of the polymorphic notes have been determined, the note manager 103 renders and displays the graphical user interface on the requesting UE 101 (step 915). This rendering is based at least in part on the display capabilities of the UE 101. For example, if the UE 101 is a portable device (e.g., a smartphone) with a limited display size, the graphical user interface can be scaled based on how much detail can be rendered in the available display. It is noted that in any UE 101, there likely will be more polymorphic notes to display than are viewable at any one time. As a result, the note manager, as a default, may render the current (e.g., based on time) note in a central portion of the graphical user interface and then future and past notes extending out therefrom to the limit of the display size. The user may then scroll forwards or backwards in time to see other available notes. In this way, the user can quickly scan or navigate along the timeline or notestream of polymorphic notes. In another embodiment, the different parts of the polymorphic notes can be split under tabs depending on the categories of the data in the polymorphic notes.
FIG. 10 is a flowchart of a process for determining relevance factors for presenting polymorphic notes in a graphical user interface, according to one embodiment. In one embodiment, the note manager 103 performs the process 1000 and is implemented in, for instance, a chip set including a processor and a memory as shown in FIG. 19. It is noted that process 900 of FIG. 9 presents the polymorphic notes in a graphical user interface based on relevance with respect to date and time (e.g., either the date associated with the polymorphic note or the creation date). The process 1000 expands on this concept and introduces the capability to present the polymorphic notes in an order based on other criteria (e.g., people, location, reminders, task status, or a combination thereof) in addition to or as an alternate to time. In one embodiment, each criteria may be shown under respective tabs for viewing on a mobile device.
In step 1001, the note manager 103 determines a set of context information corresponding to the polymorphic notes that are to be displayed. This context information (e.g., people, location, reminders, task status, etc.) is obtained or parsed from the polymorphic note or metadata associated with the polymorphic note. In addition, the context information may be obtained from related services 111 in the service platform 105. For example, to obtain location information (e.g., directions, map coordinates, etc.), the note manager 103 may obtain an address from the polymorphic note and request additional location information from a mapping or navigation service. Similarly, the note manager 103 may obtain additional information about an identified name in the polymorphic note by retrieving the additional information from a contacts service. Optionally, the note manager 103 may obtain similar context information about the requesting UE 101 or a user associated with the requesting UE 101 (step 1003). In one embodiment, the user is registered in a social networking service. The contacts of his phone and/or desktop are synchronized with the service. That service may then provide a contacts service to the note manager 103.
Next, the note manager 103 computes a relevance factor for each of the polymorphic notes to be displayed based on the context information (step 1005). In one embodiment, the relevance factors of the notes are computed based on the context information of the polymorphic notes with respect to the context information of the requesting UE 101. For example, if the context information of the UE 101 indicates that the user is located at a place, the note manager 103 may determine the relevance of the notes based on the proximity of an associated location. Similarly, if the context information (e.g., a call log) indicates that the UE 101 contacts a particular person or set of people most often, those people can be used to determine the relevance factors of the notes by determining whether the UE 101 contacts are associated with any of the polymorphic notes to be displayed. This process can be repeated for any element of the available contextual information. It is also contemplated that any combination of the contextual information (e.g., people and location) may be used to determine relevance factors, and that each attribute may be weighted separately. In one embodiment, the combination and corresponding weighting of each attribute in the combination may be predetermined by, for instance, a service provider, network operator, and the like. In addition or alternatively, the combination and weighting may be specified or modified by the user or other authorized users.
The note manager 103 can then use the relevance factor to determine whether a particular polymorphic note is displayed and then the order for displaying the polymorphic notes (step 1007). In one embodiment, the note manager 103 can define a relevance factor threshold to determine whether a particular polymorphic note is displayed (e.g., if the relevance factor of a note is higher than the threshold then it is displayed; if not, the note is not displayed). In another embodiment, the order of the polymorphic notes can be determined by the relevance factors (e.g., notes are displayed in order of their relevance factors). In yet another embodiment, the notes may be displayed in loose chronological order as described above, but the focus of the graphical user interface can be made to change based on the order of the relevance factor. For example, the focus may be placed on a note with the highest relevance factor. When the user selects to view the next relevant note, the focus can then shift along the timeline to the note with the next highest relevance factor.
FIG. 11 is a flowchart of a process for displaying a recent activity cue related to polymorphic notes in a graphical user interface, according to one embodiment. In one embodiment, the note manager 103 performs the process 1100 and is implemented in, for instance, a chip set including a processor and a memory as shown in FIG. 19. It is noted that because of limited display sizes, it is possible that activity may take place in a polymorphic note that is currently not visible in the graphical user interface. For example, the one or more of the authorized users of a note may have sent an RSVP, provided a comment, or completed a task with respect to a note. In this case, the process 1100 enables the note manager to display a recent activity cue in the graphical user interface to direct the user to the note or notes with the recent activity.
In steps 1101 and 1103, the note manager 103 determines whether one or more of the polymorphic notes include recent activity. By way of example, the determination may be made by monitoring note generation and/or modification activity in the user note database 113. In addition or alternatively, a notification or alert may be received at the note manager 103 each time a user updates information in one of the polymorphic notes. If there is recent activity with respect to one or more of the polymorphic notes, the note manager 103 determines whether any of the one or more polymorphic notes are currently visible in the graphical user interface (steps 1105 and 1107). As described above, the number of polymorphic notes usually exceeds the display capabilities of the UE 101, resulting in only a limited number of notes being visible on the screen at the same time. Notes which do not have the focus of the graphical user interface typically are not visible. If any of the one or more polymorphic notes with recent activity are not visible, the note manager 103 displays one or more corresponding recent activity cues in the graphical user interface to indicate a relative location of the notes (step 1109). In one embodiment, this recent activity is typically an arrow with an alert symbol or message to indicate the direction the user should scroll the currently active user interface window to view the corresponding notes. The number of cues is used to indicate the number or relative number of notes with recent activity.
FIG. 12 is a diagram of a graphical user interface presenting polymorphic notes, according to one embodiment. As shown, the user interface 1200 depicts polymorphic notes in a loose chronological order along a timeline or notestream. For example, notes are displayed according to the specific date and time associated to them. If they have not been given a specific time, they are displayed according to when they were created. In this way, time-based and non-time based notes are shown in same user interface 1200. When a user navigates to the notestream, the most current note 1201 (e.g., the note most closely matching the current time) is centered in in the screen 1200. This view enables the full spectrum of polymorphic notes to be viewed in a time, whether or not they have a concrete time associated to them.
The user interface screen 1201 also provides a continuous, scannable presentation of all notes. As shown, notes are divided by day, with dotted lines 1203 separating consecutive days. The current focus position is represented by double lines 1205. Accordingly, notes that occur in the future (e.g., notes 1207 and 1209) are displayed to the right of the double lines 1205, and notes that occur in the past (e.g., note 1211) are displayed to the left of the double lines 1205. The user can scroll to the left to view additional notes in the past and to the right view additional notes in the future. The past direction of the notestream combines notes that the user has created, received, or have scheduled for a time that has passed. This enables the user to scan all notes in a continuous visual manner. The future direction of the notestream reveals notes that have been associated with a future time, thereby enabling the user to look ahead.
In this example, notes in the notestream are consistent in their horizontal size, but vary in vertical scale based on their content and recent activity. For example, if the note has no associated people, place, or time, the note is displayed as a small note. As more information is added the note can grow to a medium size and then a large size. If there is an image associated with the note, the image is also displayed. Small notes can be stacked vertically, medium notes can be paired with small notes, and large notes can stand alone to maximize the available display area. Notes may contain elements (e.g., visual elements) to make them stand out from one another. For example, a band atop each not indicates to which category or notebook the note belongs. At the top left corner, some notes (e.g., note 1201) have additional indicator icons.
The user interface screen 1200 further visually highlights shared items (e.g., notes 1211 and 1213) with arrow icons 1215a and 1215b, and visually highlights notable items (e.g., notes 1201 and 1217) with start icons 1219a and 1219b. In addition, the user interface screen 1200 includes an inbox 1218 portion of the screen to display notes that others have shared with the user and a notable notes 1221 portion of the screen to display notes that the user wants to keep in the forefront.
The user interface screen 1200 may display one or more recent activity cues (e.g., activity cues 1223a-1223c) to indicate that there are notes that are currently not visible in the user interface 1200 that contain recent activity. In this way, the user need not take any action to be directed to active notes. As shown, an activity cue (e.g., activity cues 1223a-1223c) is represented by an arrow with an exclamation point. The arrow points in the direction (e.g., either left or right) the user should scroll to view the corresponding note. The vertical position of the arrow indicates the corresponding vertical position of the note in the user interface 1200. In this example, there is one note in the past that has recent activity as indicated by activity cue 1223a, and two notes in the future that have recent activity as indicated respectively by activity cues 1223b and 1223c. In one embodiment, the items in the user interface screen 800 can be arranged as floating items. Then, the items can move in the user interface screen 800 at different speeds. IN certain embodiments, the floating items may be only those items which are otherwise not currently visible and outside the current display. In this case, the display is arranged in two or more layers so that user can grip to the floating items in the different layers. In one embodiment, the user can select one or more floating items to review more deeply.
In the notestream, clicking on a note that is not centered (e.g., a note other than note 1201) causes the notestream to track to the side and center on the clicked note. This scanning and centering behavior advantageously encourages the user to spend time in the notestream and view notes in the context in which they were created or are scheduled. On clicking the centered note, the user taken to a full view of the note to view additional details (see, e.g., FIG. 12 for an example of a full view of a polymorphic note).
FIGS. 13A and 13B are flowcharts of processes for generating a polymorphic note, according to various embodiments. FIG. 13A depicts a general process for generating the polymorphic note and FIG. 13B depicts an optional process for including predetermined actions in the polymorphic note. In one embodiment, the note manager 103 performs the process 1300 of FIG. 13A and the process 1320 of FIG. 13B and is implemented in, for instance, a chip set including a processor and a memory as shown in FIG. 19. In step 1301 of FIG. 13A, the note manager 103 receives a request from a device to generate a polymorphic note. The device may be associated with a user, a service provider, content provider, network provider, or any other entity authorized or capable of initiating the request. As discussed previously, the polymorphic note may include information traditionally associated with a plurality of application types (e.g., a calendar application, a task management application, a note application, an e-mail application, an instant messaging application, a text messaging application, a social networking application, a location application, or a combination thereof). The support for multiple application types in the polymorphic note enables note manager 103 to avoid imposing a strict data structure for input data. For example, to record an event in a traditional calendaring application, a user inputs a specific date, time, subject, etc. in the format required by the application. Instead, under the approach described herein, the user of the device can initiate the creation of a polymorphic note with just an idea or concept of an event (e.g., “I want to go hiking”), and the user need not know the specifics of the event (e.g., where, when, with whom, etc.). As the concept develops, the polymorphic note can record the evolution from concept to event.
The note manager 103 then parses any input provided as part of the request to determine as much information as possible to include in the polymorphic note (step 1303). For example, the parsing can be used to identify any phrases related to or specifying web links, phone numbers, locations, email addresses. The manager 103 can also parse the information to determine whether there are any referenced media content items or requested social tools (e.g., based phrases related to one or more of the social tools). The parsed information may also be used to identify any contextual information (e.g., time, place, location, etc.) or indicators of contextual information that can be retrieved from either one of the services 111 of the service platform 105 (e.g., a weather service to obtain a weather forecast for the place, date, and/or time described in the note) or from a sensor of the UE 101 associated with the device (steps 1305 and 1307). For example, the parsed information may include a phrase “dinner at Paul's house.” In this case, the note manager 103 identifies the phrase as a possible invitation and that the location is Paul's house. Accordingly, the note manager 103 searches the device's contact list (or other contact lists available via a contact service or another device) to identify Paul and retrieve a home address for Paul from the list or service. The manager 103 then obtains directions to Paul's home address from a mapping service of the service platform 105 and includes then address in the polymorphic note. The note manager 103 can even determine a location based on the time. For example, the manager 103 can determine (1) whether Paul has a summer cottage, and (2) the periods of time (e.g., the summer) when Paul can be found at the cottage. The manager can then suggest the location (e.g., either Paul's home or Paul's summer cottage) based on the time of year. Similarly, the manager 103 can determine a location based on a daily work schedule or routine (e.g., work location during the day and home location at night).
After obtaining available information (e.g., contextual associations, media content references, social tools, etc.) identified by the parsing, the note manager 103 generates the polymorphic note (step 1309) and stores the note for later access or sharing by the device (step 1311).
FIG. 13B depicts an optional process for including predetermined actions in the polymorphic note based on triggering items include in the note or the request to generate the polymorphic note. In step 1321, the note manager 103 parses the polymorphic note or the information received in the request to identify any triggering items. In one embodiment, a triggering item is information that is associated with an action or function of the note manager 103, the services 111, the service platform 105, or any similar component available over the communication network 107. This information is, for instance, related to time, people, location, tasks, and other PIM information.
On identifying one or more triggering items, the note manager 103 selects one or more predetermined actions that correspond to the identified triggering items (step 1323). For example, the triggering item is information specifying the user's friend Matt, along with a restaurant, and meeting time, the note manager 103 may select one or more actions to display the location of the restaurant on a map, create an online reservation at the determined time, etc. The note manager 103 then includes the selected actions in the polymorphic note. For example, the note may contain scripts or other commands to direct the performance of the actions (step 1325).
In one embodiment, the note manager 103 can operate in conjunction with or be embedded in an external application (e.g., a word processor) to monitor for triggering items that can be used to generate polymorphic notes. For example, as a user types information in the word processor application, the note manager 103 parses the typed information to identify triggering items according to the process 1320. If the triggering items are detected, then note manager 103 identifies the corresponding actions using the process 1320 and then generates the polymorphic note to include the actions as described with respect to the process 1300.
In one sample use case, one or more users may happen to be shopping in the same area of a city and have their location services configured to automatically share their locations. In this example, the triggering item includes information on at least location and people. Accordingly, the note manager 103 may interface with the location service to initiate a suggestion as a polymorphic note to the users that they can easily meet up a nearby location (e.g., a coffee shop on Main Street). In some embodiments, the note manager 103 may consult other polymorphic notes or PIM information (e.g., calendar and schedules) to automatically determine whether a meetup is possible and incorporate the scheduling information in the note. The note can also include, for instance, a voting social tool that asks the users to vote the place and time for meeting that the users can quickly respond. If the users accept the suggestion, the note manager 103 automatically records the information related to the selected meetup (e.g., location, people, time, etc.) in the note. T
It is also contemplated that the note manager 103 may convert an application type associated with another application into a polymorphic note. In this way, for instance, the external application file type may be used to suggest or create information that will be converted into a polymorphic at a later date.
FIG. 14 is a flowchart of a process for storing and sharing a polymorphic note in an electronic notebook, according to one embodiment. In one embodiment, the note manager 103 performs the process 1400 and is implemented in, for instance, a chip set including a processor and a memory as shown in FIG. 19. In step 1401, the note manager 103 stores previously generated polymorphic notes in one or more electronic notebooks. As discussed earlier, electronic notebooks provide a convenient way to shares notes by enabling the device to manipulate collections (e.g., notebooks) of notes rather than each individual note. As part of the sharing process, the note manager 103 assigns an attribute to the electronic notebook (step 1403). This attribute, for instance, specifies the category of the notebook and the polymorphic notes contained therein (e.g., work, home, personal, sports, etc.). Each attribute may also be associated with a list of users who will receive and share the notebook. For example, a notebook with the work attribute can provide for sharing of the notebook among a group of the user's coworkers. A notebook marked home can provide sharing among the user's immediate family. In addition, the level of access may vary by group. For example, the work notebook may specify sharing as read-only; while the home notebook may specify sharing with full read/write access.
It is also contemplated that a notebook may not enable sharing altogether. For example, a notebook with the attribute of personal may be designated as private and not allow sharing. Accordingly, at step 1405, the note manager 103 determines whether the notebook's attribute indicates that the notebook should be shared. If the attribute indicates no sharing, the note manager 103 maintains the privacy of the notebook and prevents the sharing of the notebook (step 1407). In certain embodiments, the identification of the notebook is also protected such that an unauthorized user is not able to view even the title of a protected notebook. If the attribute indicates that sharing is allowed, the note manager 103 identifies the users indicated by the attributed as authorized to access the notebook and enables access to the notebook for those authorized users (step 1409). It is contemplated that the note manager 103 may use any mechanism (e.g., user name/password, network address filtering, biometric security, etc.) to authenticate the users to ensure that only authorized can access the notebook.
In another embodiment, the polymorphic note may be shared between devices of differing capabilities (e.g., between a desktop computer and a mobile device). In this case, the note manager 103 may share or synchronize only those parts of the polymorphic note that is appropriate to the device. For example, due to limited device memory in a mobile device, the desktop computer may share only a subset of the media content included in a polymorphic note. In some embodiments, the desktop computer may then share the remaining media content as, for instance, a link. In addition, if the one of the devices is note compatible with the polymorphic note service (e.g., connect access polymorphic note file types), the polymorphic note may provide a summary of the polymorphic in a file format (e.g., e-mail, text message, etc.) that is compatible with the device.
In another embodiment, the note manager 103 may share individual polymorphic notes without first storing the note in an electronic notebook. In this case, the manager 103 applies the sharing attribute to the specific polymorphic note rather than the electronic notebook.
FIG. 15 is flowchart of a process for recording updates to the polymorphic note, according to one embodiment. In one embodiment, the note manager 103 performs the process 1500 and is implemented in, for instance, a chip set including a processor and a memory as shown in FIG. 19. The process 1500 assumes that a polymorphic note created by a first device has been shared successfully shared with at least another device. In step 1501, the note manager 103 receives additional information to add to the shared polymorphic note from the other device. By way of example, this additional information may include any information element related to either polymorphic note or a communication (e.g., e-mail, text message, instant message, etc.) about the polymorphic note. The information may also include responses or inputs to any the social tools included in the polymorphic note.
On receipt of the information, the note manager 103 determines whether the device is authorized to make the changes (e.g., have read/write access as opposed to read-only access) (step 1503). If the device is not authorized the process ends. Otherwise, the note manager 103 determines whether the additional information provided by the other device conflicts with any information currently in the polymorphic note (step 1505). If a conflict is detected (e.g., the same information has been changed by multiple devices), the note manager 103 initiates a process to resolve the discrepancy (step 1507). As discussed earlier, in a social setting, the note manager 103 attempts to resolve the conflict through negotiations between the devices causing the conflict or discrepancy. More specifically, the note manager 103 retrieves contact information from, for instance, a contact list of either one or the devices or a public directory and initiate a communication session between the two parties to resolve the conflict. If the conflict cannot be resolved through negotiation, then the note manager 103 can apply a predetermined conflict resolution rule (e.g., accept the latest update, accept the first update, etc.).
After resolving any discrepancy or if there were not discrepancies, the note manager 103 updates the polymorphic note to include the additional information (step 1509) and records the update in a log maintained with the polymorphic note (step 1511). The log, for instance, provides a history of updates and changes to the polymorphic note. In addition or alternatively, a history of updates and changes to the polymorphic note may be stored in the body of the note itself instead of the log. In another embodiment, the log is stored in the body of the polymorphic note.
FIG. 16 is a diagram of a user interface for interacting with a polymorphic note, according to one embodiment. As shown, the user interface 1600 depicts an example polymorphic note including a content region 1601, association modules 1603, ideas region 1605, and settings and actions toolbar 1607. The content region 1601 is an area where users input content and includes text, media, and social tools that have been included in the polymorphic note. The association modules 1603 display and enable users to input contextual associations such as time, people, location, and reminders to a polymorphic note. The ideas region 1605 displays suggestions for ideas based on the content of the polymorphic note. The settings and actions toolbar 1607 contain features that apply to the note as a whole, i.e., to the polymorphic note container and everything that belongs with it.
The content region 1601 further includes three components: (1) the content tool bar 1609, (2) the text and media region 1611, (3) and the coordination tools region 1613. The content tool bar 1609 provides touchpoints for inserting different media types, adding coordination tools (e.g., task list, comments), and applying standard or customized themes to a note. The text and media region 1611 is the main component of the polymorphic note user interface. For example, the text and media region 1611 can contain any combination of text, images, video, audio, and other documents. It is designed to provide maximum flexibility across the range from simple text-only notes to carefully crafted invitations and memories with multimedia elements. The coordination tools region 1613 supports the ability to share comments and carry on a conversation around a particular note. The region 1613 also supports the ability to share and/or assign tasks related to the note, and the ability to vote on different options when trying to coordinate a group of people.
FIGS. 17A and 17B are diagrams of user interfaces for entering information into a polymorphic note, according to various exemplary embodiments. FIG. 17A depicts a user interface 1700 of blank input screen for creating a polymorphic note. The user interface 1700 is similar to the user interface 1600 of FIG. 16 described above and includes a content region 1701, association modules 1703, and settings and actions toolbar 1705. To request creation of a polymorphic note, the user begins typing information in the content region 1701. In one embodiment, the user interface 1300 for entering information into a polymorphic note computer program code may have an interface for connectivity to different document or application types so that the polymorphic note can be generated from the different document or application types when inputting text into the different document or application type. The polymorphic note will capture the relevant information for creating a polymorphic note from the different document or application type. The note can remain part of the document or application type or can be detached from the document or application type. The polymorphic note may generate a link or equivalent connection to that document or application type, if needed. By way of example, a music file is an example of application type.
FIG. 17B depicts a user interface 1720 in which the user has started to type information in the content region 1701. As the user types, the note manager 103 parses the information to determine contextual associations. The underlined phrase 1721 (“Friday December 12th”) is parsed to indicate the date for a planned event. Although, the user has not input a year, the note manager 103 can infer the complete date based on analyzing when December 12th falls on a Friday and/or by assuming that the user is likely referring to the current year. Accordingly, the note manager 103 displays the date in the time context 1723 within the association modules region 1703. Similarly, the underlined phrase 1725 (“19:30”) is parsed to indicate the time for the planned event. The note manager 103 includes this time in the time context 1723 along with the date.
The underlined phrase 927 (“340 Moon Street”) is parsed to indicate an address of the planned event. The parsed address is incomplete. As a result, the note manager 103 can use a mapping service, a location sensor in the user's device, and/or calendars or contacts of users related to the note to determine the city information. In another embodiment, the note manager 103 may infer the city information to complete the address from, for instance, account information associated with the user. In this case, note manager 103 determines the complete address and displays this address in the location context area 1729 within the association modules region 1703.
In the examples of FIGS. 17A and 17B, the user may confirm the accuracy of the parsed information and make modifications accordingly.
The processes described herein for providing soft reminders may be advantageously implemented via software, hardware, firmware or a combination of software and/or firmware and/or hardware. For example, the processes described herein, including for providing user interface navigation information associated with the availability of services, may be advantageously implemented via processor(s), Digital Signal Processing (DSP) chip, an Application Specific Integrated Circuit (ASIC), Field Programmable Gate Arrays (FPGAs), etc. Such exemplary hardware for performing the described functions is detailed below.
FIG. 18 illustrates a computer system 1800 upon which an embodiment of the invention may be implemented. Although computer system 1800 is depicted with respect to a particular device or equipment, it is contemplated that other devices or equipment (e.g., network elements, servers, etc.) within FIG. 18 can deploy the illustrated hardware and components of system 1800. Computer system 1800 is programmed (e.g., via computer program code or instructions) to provide soft reminders as described herein and includes a communication mechanism such as a bus 1810 for passing information between other internal and external components of the computer system 1800. Information (also called data) is represented as a physical expression of a measurable phenomenon, typically electric voltages, but including, in other embodiments, such phenomena as magnetic, electromagnetic, pressure, chemical, biological, molecular, atomic, sub-atomic and quantum interactions. For example, north and south magnetic fields, or a zero and non-zero electric voltage, represent two states (0, 1) of a binary digit (bit). Other phenomena can represent digits of a higher base. A superposition of multiple simultaneous quantum states before measurement represents a quantum bit (qubit). A sequence of one or more digits constitutes digital data that is used to represent a number or code for a character. In some embodiments, information called analog data is represented by a near continuum of measurable values within a particular range. Computer system 1800, or a portion thereof, constitutes a means for performing one or more steps of providing soft reminders.
A bus 1810 includes one or more parallel conductors of information so that information is transferred quickly among devices coupled to the bus 1810. One or more processors 1802 for processing information are coupled with the bus 1810.
A processor (or multiple processors) 1802 performs a set of operations on information as specified by computer program code related to provide soft reminders. The computer program code is a set of instructions or statements providing instructions for the operation of the processor and/or the computer system to perform specified functions. The code, for example, may be written in a computer programming language that is compiled into a native instruction set of the processor. The code may also be written directly using the native instruction set (e.g., machine language). The set of operations include bringing information in from the bus 1810 and placing information on the bus 1810. The set of operations also typically include comparing two or more units of information, shifting positions of units of information, and combining two or more units of information, such as by addition or multiplication or logical operations like OR, exclusive OR (XOR), and AND. Each operation of the set of operations that can be performed by the processor is represented to the processor by information called instructions, such as an operation code of one or more digits. A sequence of operations to be executed by the processor 1802, such as a sequence of operation codes, constitute processor instructions, also called computer system instructions or, simply, computer instructions. Processors may be implemented as mechanical, electrical, magnetic, optical, chemical or quantum components, among others, alone or in combination.
Computer system 1800 also includes a memory 1804 coupled to bus 1810. The memory 1804, such as a random access memory (RAM) or other dynamic storage device, stores information including processor instructions for providing soft reminders. Dynamic memory allows information stored therein to be changed by the computer system 1800. RAM allows a unit of information stored at a location called a memory address to be stored and retrieved independently of information at neighboring addresses. The memory 1804 is also used by the processor 1802 to store temporary values during execution of processor instructions. The computer system 1800 also includes a read only memory (ROM) 1806 or other static storage device coupled to the bus 1810 for storing static information, including instructions, that is not changed by the computer system 1800. Some memory is composed of volatile storage that loses the information stored thereon when power is lost. Also coupled to bus 1810 is a non-volatile (persistent) storage device 1808, such as a magnetic disk, optical disk or flash card, for storing information, including instructions, that persists even when the computer system 1800 is turned off or otherwise loses power.
Information, including instructions for providing soft reminders, is provided to the bus 1810 for use by the processor from an external input device 1812, such as a keyboard containing alphanumeric keys operated by a human user, or a sensor. A sensor detects conditions in its vicinity and transforms those detections into physical expression compatible with the measurable phenomenon used to represent information in computer system 1800. Other external devices coupled to bus 1810, used primarily for interacting with humans, include a display device 1814, such as a cathode ray tube (CRT) or a liquid crystal display (LCD), or plasma screen or printer for presenting text or images, and a pointing device 1816, such as a mouse or a trackball or cursor direction keys, or motion sensor, for controlling a position of a small cursor image presented on the display 1814 and issuing commands associated with graphical elements presented on the display 1814. In some embodiments, for example, in embodiments in which the computer system 1800 performs all functions automatically without human input, one or more of external input device 1812, display device 1814 and pointing device 1816 is omitted.
In the illustrated embodiment, special purpose hardware, such as an application specific integrated circuit (ASIC) 1820, is coupled to bus 1810. The special purpose hardware is configured to perform operations not performed by processor 1802 quickly enough for special purposes. Examples of application specific ICs include graphics accelerator cards for generating images for display 1814, cryptographic boards for encrypting and decrypting messages sent over a network, speech recognition, and interfaces to special external devices, such as robotic arms and medical scanning equipment that repeatedly perform some complex sequence of operations that are more efficiently implemented in hardware.
Computer system 1800 also includes one or more instances of a communications interface 1870 coupled to bus 1810. Communication interface 1870 provides a one-way or two-way communication coupling to a variety of external devices that operate with their own processors, such as printers, scanners and external disks. In general the coupling is with a network link 1878 that is connected to a local network 1880 to which a variety of external devices with their own processors are connected. For example, communication interface 1870 may be a parallel port or a serial port or a universal serial bus (USB) port on a personal computer. In some embodiments, communications interface 1870 is an integrated services digital network (ISDN) card or a digital subscriber line (DSL) card or a telephone modem that provides an information communication connection to a corresponding type of telephone line. In some embodiments, a communication interface 1870 is a cable modem that converts signals on bus 1810 into signals for a communication connection over a coaxial cable or into optical signals for a communication connection over a fiber optic cable. As another example, communications interface 1870 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN, such as Ethernet. Wireless links may also be implemented. For wireless links, the communications interface 1870 sends or receives or both sends and receives electrical, acoustic or electromagnetic signals, including infrared and optical signals, that carry information streams, such as digital data. For example, in wireless handheld devices, such as mobile telephones like cell phones, the communications interface 1870 includes a radio band electromagnetic transmitter and receiver called a radio transceiver. In certain embodiments, the communications interface 1870 enables connection to the communication network 105 for providing soft reminders to the UE 101.
The term “computer-readable medium” as used herein refers to any medium that participates in providing information to processor 1802, including instructions for execution. Such a medium may take many forms, including, but not limited to computer-readable storage medium (e.g., non-volatile media, volatile media), and transmission media. Non-transitory media, such as non-volatile media, include, for example, optical or magnetic disks, such as storage device 1808. Volatile media include, for example, dynamic memory 1804. Transmission media include, for example, coaxial cables, copper wire, fiber optic cables, and carrier waves that travel through space without wires or cables, such as acoustic waves and electromagnetic waves, including radio, optical and infrared waves. Signals include man-made transient variations in amplitude, frequency, phase, polarization or other physical properties transmitted through the transmission media. Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, CDRW, DVD, any other optical medium, punch cards, paper tape, optical mark sheets, any other physical medium with patterns of holes or other optically recognizable indicia, a RAM, a PROM, an EPROM, a FLASH-EPROM, any other memory chip or cartridge, a carrier wave, or any other medium from which a computer can read. The term computer-readable storage medium is used herein to refer to any computer-readable medium except transmission media.
Logic encoded in one or more tangible media includes one or both of processor instructions on a computer-readable storage media and special purpose hardware, such as ASIC 1820.
Network link 1878 typically provides information communication using transmission media through one or more networks to other devices that use or process the information. For example, network link 1878 may provide a connection through local network 1880 to a host computer 1882 or to equipment 1884 operated by an Internet Service Provider (ISP). ISP equipment 1884 in turn provides data communication services through the public, world-wide packet-switching communication network of networks now commonly referred to as the Internet 1890.
A computer called a server host 1892 connected to the Internet hosts a process that provides a service in response to information received over the Internet. For example, server host 1892 hosts a process that provides information representing video data for presentation at display 1814. It is contemplated that the components of system 1800 can be deployed in various configurations within other computer systems, e.g., host 1882 and server 1892.
At least some embodiments of the invention are related to the use of computer system 1800 for implementing some or all of the techniques described herein. According to one embodiment of the invention, those techniques are performed by computer system 1800 in response to processor 1802 executing one or more sequences of one or more processor instructions contained in memory 1804. Such instructions, also called computer instructions, software and program code, may be read into memory 1804 from another computer-readable medium such as storage device 1808 or network link 1878. Execution of the sequences of instructions contained in memory 1804 causes processor 1802 to perform one or more of the method steps described herein. In alternative embodiments, hardware, such as ASIC 1820, may be used in place of or in combination with software to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware and software, unless otherwise explicitly stated herein.
The signals transmitted over network link 1878 and other networks through communications interface 1870, carry information to and from computer system 1800. Computer system 1800 can send and receive information, including program code, through the networks 1880, 1890 among others, through network link 1878 and communications interface 1870. In an example using the Internet 1890, a server host 1892 transmits program code for a particular application, requested by a message sent from computer 1800, through Internet 1890, ISP equipment 1884, local network 1880 and communications interface 1870. The received code may be executed by processor 1802 as it is received, or may be stored in memory 1804 or in storage device 1808 or other non-volatile storage for later execution, or both. In this manner, computer system 1800 may obtain application program code in the form of signals on a carrier wave.
Various forms of computer readable media may be involved in carrying one or more sequence of instructions or data or both to processor 1802 for execution. For example, instructions and data may initially be carried on a magnetic disk of a remote computer such as host 1882. The remote computer loads the instructions and data into its dynamic memory and sends the instructions and data over a telephone line using a modem. A modem local to the computer system 1800 receives the instructions and data on a telephone line and uses an infra-red transmitter to convert the instructions and data to a signal on an infra-red carrier wave serving as the network link 1878. An infrared detector serving as communications interface 1870 receives the instructions and data carried in the infrared signal and places information representing the instructions and data onto bus 1810. Bus 1810 carries the information to memory 1804 from which processor 1802 retrieves and executes the instructions using some of the data sent with the instructions. The instructions and data received in memory 1804 may optionally be stored on storage device 1808, either before or after execution by the processor 1802.
FIG. 19 illustrates a chip set or chip 1900 upon which an embodiment of the invention may be implemented. Chip set 1900 is programmed to provide soft reminders as described herein and includes, for instance, the processor and memory components described with respect to FIG. 18 incorporated in one or more physical packages (e.g., chips). By way of example, a physical package includes an arrangement of one or more materials, components, and/or wires on a structural assembly (e.g., a baseboard) to provide one or more characteristics such as physical strength, conservation of size, and/or limitation of electrical interaction. It is contemplated that in certain embodiments the chip set 1900 can be implemented in a single chip. It is further contemplated that in certain embodiments the chip set or chip 1900 can be implemented as a single “system on a chip.” It is further contemplated that in certain embodiments a separate ASIC would not be used, for example, and that all relevant functions as disclosed herein would be performed by a processor or processors. Chip set or chip 1900, or a portion thereof, constitutes a means for performing one or more steps of providing user interface navigation information associated with the availability of services. Chip set or chip 1900, or a portion thereof, constitutes a means for performing one or more steps of providing soft reminders.
In one embodiment, the chip set or chip 1900 includes a communication mechanism such as a bus 1901 for passing information among the components of the chip set 1900. A processor 1903 has connectivity to the bus 1901 to execute instructions and process information stored in, for example, a memory 1905. The processor 1903 may include one or more processing cores with each core configured to perform independently. A multi-core processor enables multiprocessing within a single physical package. Examples of a multi-core processor include two, four, eight, or greater numbers of processing cores. Alternatively or in addition, the processor 1903 may include one or more microprocessors configured in tandem via the bus 1901 to enable independent execution of instructions, pipelining, and multithreading. The processor 1903 may also be accompanied with one or more specialized components to perform certain processing functions and tasks such as one or more digital signal processors (DSP) 1907, or one or more application-specific integrated circuits (ASIC) 1909. A DSP 1907 typically is configured to process real-world signals (e.g., sound) in real time independently of the processor 1903. Similarly, an ASIC 1909 can be configured to performed specialized functions not easily performed by a more general purpose processor. Other specialized components to aid in performing the inventive functions described herein may include one or more field programmable gate arrays (FPGA) (not shown), one or more controllers (not shown), or one or more other special-purpose computer chips.
In one embodiment, the chip set or chip 1900 includes merely one or more processors and some software and/or firmware supporting and/or relating to and/or for the one or more processors.
The processor 1903 and accompanying components have connectivity to the memory 1905 via the bus 1901. The memory 1905 includes both dynamic memory (e.g., RAM, magnetic disk, writable optical disk, etc.) and static memory (e.g., ROM, CD-ROM, etc.) for storing executable instructions that when executed perform the inventive steps described herein to provide soft reminders. The memory 1905 also stores the data associated with or generated by the execution of the inventive steps.
FIG. 20 is a diagram of exemplary components of a mobile terminal (e.g., handset) for communications, which is capable of operating in the system of FIG. 1, according to one embodiment. In some embodiments, mobile terminal 2000, or a portion thereof, constitutes a means for performing one or more steps of providing soft reminders. Generally, a radio receiver is often defined in terms of front-end and back-end characteristics. The front-end of the receiver encompasses all of the Radio Frequency (RF) circuitry whereas the back-end encompasses all of the base-band processing circuitry. As used in this application, the term “circuitry” refers to both: (1) hardware-only implementations (such as implementations in only analog and/or digital circuitry), and (2) to combinations of circuitry and software (and/or firmware) (such as, if applicable to the particular context, to a combination of processor(s), including digital signal processor(s), software, and memory(ies) that work together to cause an apparatus, such as a mobile phone or server, to perform various functions). This definition of “circuitry” applies to all uses of this term in this application, including in any claims. As a further example, as used in this application and if applicable to the particular context, the term “circuitry” would also cover an implementation of merely a processor (or multiple processors) and its (or their) accompanying software/or firmware. The term “circuitry” would also cover if applicable to the particular context, for example, a baseband integrated circuit or applications processor integrated circuit in a mobile phone or a similar integrated circuit in a cellular network device or other network devices.
Pertinent internal components of the telephone include a Main Control Unit (MCU) 2003, a Digital Signal Processor (DSP) 2005, and a receiver/transmitter unit including a microphone gain control unit and a speaker gain control unit. A main display unit 2007 provides a display to the user in support of various applications and mobile terminal functions that perform or support the steps of providing soft reminders. The display 20 includes display circuitry configured to display at least a portion of a user interface of the mobile terminal (e.g., mobile telephone). Additionally, the display 2007 and display circuitry are configured to facilitate user control of at least some functions of the mobile terminal. An audio function circuitry 2009 includes a microphone 2011 and microphone amplifier that amplifies the speech signal output from the microphone 2011. The amplified speech signal output from the microphone 2011 is fed to a coder/decoder (CODEC) 2013.
A radio section 2015 amplifies power and converts frequency in order to communicate with a base station, which is included in a mobile communication system, via antenna 2017. The power amplifier (PA) 2019 and the transmitter/modulation circuitry are operationally responsive to the MCU 2003, with an output from the PA 2019 coupled to the duplexer 2021 or circulator or antenna switch, as known in the art. The PA 2019 also couples to a battery interface and power control unit 2020.
In use, a user of mobile terminal 2001 speaks into the microphone 2011 and his or her voice along with any detected background noise is converted into an analog voltage. The analog voltage is then converted into a digital signal through the Analog to Digital Converter (ADC) 2023. The control unit 2003 routes the digital signal into the DSP 2005 for processing therein, such as speech encoding, channel encoding, encrypting, and interleaving. In one embodiment, the processed voice signals are encoded, by units not separately shown, using a cellular transmission protocol such as global evolution (EDGE), general packet radio service (GPRS), global system for mobile communications (GSM), Internet protocol multimedia subsystem (IMS), universal mobile telecommunications system (UMTS), etc., as well as any other suitable wireless medium, e.g., microwave access (WiMAX), Long Term Evolution (LTE) networks, code division multiple access (CDMA), wideband code division multiple access (WCDMA), wireless fidelity (WiFi), satellite, and the like.
The encoded signals are then routed to an equalizer 2025 for compensation of any frequency-dependent impairments that occur during transmission though the air such as phase and amplitude distortion. After equalizing the bit stream, the modulator 2027 combines the signal with a RF signal generated in the RF interface 2029. The modulator 2027 generates a sine wave by way of frequency or phase modulation. In order to prepare the signal for transmission, an up-converter 2031 combines the sine wave output from the modulator 2027 with another sine wave generated by a synthesizer 2033 to achieve the desired frequency of transmission. The signal is then sent through a PA 2019 to increase the signal to an appropriate power level. In practical systems, the PA 2019 acts as a variable gain amplifier whose gain is controlled by the DSP 2005 from information received from a network base station. The signal is then filtered within the duplexer 2021 and optionally sent to an antenna coupler 2035 to match impedances to provide maximum power transfer. Finally, the signal is transmitted via antenna 2017 to a local base station. An automatic gain control (AGC) can be supplied to control the gain of the final stages of the receiver. The signals may be forwarded from there to a remote telephone which may be another cellular telephone, other mobile phone or a land-line connected to a Public Switched Telephone Network (PSTN), or other telephony networks.
Voice signals transmitted to the mobile terminal 2001 are received via antenna 2017 and immediately amplified by a low noise amplifier (LNA) 2037. A down-converter 2039 lowers the carrier frequency while the demodulator 2041 strips away the RF leaving only a digital bit stream. The signal then goes through the equalizer 2025 and is processed by the DSP 2005. A Digital to Analog Converter (DAC) 2043 converts the signal and the resulting output is transmitted to the user through the speaker 2045, all under control of a Main Control Unit (MCU) 2003—which can be implemented as a Central Processing Unit (CPU) (not shown).
The MCU 2003 receives various signals including input signals from the keyboard 2047. The keyboard 2047 and/or the MCU 2003 in combination with other user input components (e.g., the microphone 2011) comprise a user interface circuitry for managing user input. The MCU 2003 runs a user interface software to facilitate user control of at least some functions of the mobile terminal 2001 to provide soft reminders. The MCU 2003 also delivers a display command and a switch command to the display 2007 and to the speech output switching controller, respectively. Further, the MCU 2003 exchanges information with the DSP 2005 and can access an optionally incorporated SIM card 2049 and a memory 2051. In addition, the MCU 2003 executes various control functions required of the terminal. The DSP 2005 may, depending upon the implementation, perform any of a variety of conventional digital processing functions on the voice signals. Additionally, DSP 2005 determines the background noise level of the local environment from the signals detected by microphone 2011 and sets the gain of microphone 2011 to a level selected to compensate for the natural tendency of the user of the mobile terminal 2001.
The CODEC 2013 includes the ADC 2023 and DAC 2043. The memory 2051 stores various data including call incoming tone data and is capable of storing other data including music data received via, e.g., the global Internet. The software module could reside in RAM memory, flash memory, registers, or any other form of writable storage medium known in the art. The memory device 2051 may be, but not limited to, a single memory, CD, DVD, ROM, RAM, EEPROM, optical storage, or any other non-volatile storage medium capable of storing digital data.
An optionally incorporated SIM card 2049 carries, for instance, important information, such as the cellular phone number, the carrier supplying service, subscription details, and security information. The SIM card 2049 serves primarily to identify the mobile terminal 2001 on a radio network. The card 2049 also contains a memory for storing a personal telephone number registry, text messages, and user specific mobile terminal settings.
While the invention has been described in connection with a number of embodiments and implementations, the invention is not so limited but covers various obvious modifications and equivalent arrangements, which fall within the purview of the appended claims. Although features of the invention are expressed in certain combinations among the claims, it is contemplated that these features can be arranged in any combination and order.

## Claims

1. A method comprising:
retrieving a polymorphic note associated with a device, a user of the device, or a combination thereof, wherein the polymorphic note upon receipt is associated with no specific triggering criteria;
determining a subject associated with the polymorphic note and one or more triggering items;
retrieving contextual information from the device;
adding social tools to the polymorphic note, whereby the polymorphic note historically separates objects;
matching the contextual information that relates to the subject to further define the subject; and
generating a reminder of the polymorphic note based, at least in part, on the contextual information and the one or more triggering items
wherein a plurality of polymorphic notes are organized into electronic notebooks, and wherein the polymorphic notes are linked in an explicit relationship to facilitate navigation between them.

2. A method of claim 1, further comprising:
causing, at least in part, a modification of the polymorphic note based, at least in part, on the contextual information, one or more user inputs at the device, one or more communications associated with the device, or a combination thereof; and
causing, at least in part, an evolving of the polymorphic note into one or more objects of one or more different application types based, at least in part, on the modification,
wherein a presentation of the reminder is further based, at least in part, on the contextual information.

3. A method of claim 2, wherein the contextual information indicates a substantially dormant period of the device, the method further comprising:
selecting a random time within the dormant period,
wherein the presentation of the reminder occurs at the random time.

4. A method of claim 1, further comprising:
generating a recommendation of one or more activities based, at least in part, on the subject; and
causing, at least in part, presentation of the recommendation at the device.

5. A method of claim 1, wherein the polymorphic note is associated with a group of users, and wherein the reminder is presented to the group of users at approximately the same time.

6. A method of claim 1, further comprising:
causing, at least in part, an attachment of a media file, a document, or a combination thereof to the polymorphic note.

7. A method of claim 1, further comprising:
receiving an input, from the user, in response to the reminder, the input specifying the triggering criteria; and
scheduling the polymorphic note based, at least in part, on the triggering criteria.

8. A method of claim 1, further comprising:
sharing the polymorphic note with at least one other device;
receiving information from the at least one other device, the information including a communication regarding the polymorphic note; and
determining whether the at least one other device is authorized to modify the polymorphic note,
wherein the modification of the polymorphic note is based on the information.

9. A method of claim 1, wherein the matched contextual information is a current activity of the device.

10. A method of claim 1, wherein the polymorphic note includes no specific criteria associated with traditional reminders pertaining to time, location, and people.

11. A method of claim 1, further comprising users of the polymorphic note providing commentary on a topic supported by the polymorphic note.

12. A method of claim 11, further comprising causing the commentary to be viewed by one or more other users of the polymorphic note.

13. A method of claim 1, wherein the polymorphic note includes private attributes accessible by a creator of the polymorphic note, and public attributes at least viewable by users other than the creator of the polymorphic note.

14. A method of claim 1, further comprising:
selecting a random time within an active period or dormant period as determined by the contextual information,
wherein the presentation of the reminder occurs at the random time.

15. An apparatus comprising:
at least one processor; and
at least one memory including computer program code for one or more programs,
the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,
retrieve a polymorphic note associated with a device, a user of the device, or a combination thereof, wherein the polymorphic note upon receipt is associated with no specific triggering criteria;
determine a subject associated with the polymorphic note and one or more triggering items;
retrieve contextual information from the device;
add social tools to the polymorphic note, whereby the polymorphic note historically separates objects;
match the contextual information that relates to the subject to further define the subject; and
generate a reminder of the polymorphic note based, at least in part, on the contextual information and the one or more triggering items
wherein a plurality of polymorphic notes are organized into electronic notebooks, and wherein the polymorphic notes are linked in an explicit relationship to facilitate navigation between them.

16. An apparatus of claim 15, wherein the apparatus is further caused to:
cause, at least in part, a modification of the polymorphic note based, at least in part, on the contextual information, one or more user inputs at the device, one or more communications associated with the device, or a combination thereof; and
cause, at least in part, an evolving of the polymorphic note into one or more objects of one or more different application types based, at least in part, on the modification,
wherein a presentation of the reminder is further based, at least in part, on the contextual information.

17. An apparatus of claim 16, wherein the contextual information indicates a substantially dormant period of the device, and wherein the apparatus is further caused to:
select a random time within the dormant period,
wherein the presentation of the reminder occurs at the random time.

18. An apparatus of claim 15, wherein the apparatus is further caused to:
generate a recommendation of one or more activities based, at least in part, on the subject; and
cause, at least in part, presentation of the recommendation at the device.

19. An apparatus of claim 15, wherein the polymorphic note is associated with a group of users, and wherein the reminder is presented to the group of users at approximately the same time.

20. An apparatus of claim 15, wherein the apparatus is further caused to:
cause, at least in part, an attachment of a media file, a document, or a combination thereof to the polymorphic note.

21. An apparatus of claim 15, wherein the apparatus is further caused to:
receive an input, from the user, in response to the reminder, the input specifying the triggering criteria; and
schedule the polymorphic note based, at least in part, on the triggering criteria.

22. A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following steps:
retrieving a polymorphic note associated with a device, a user of the device, or a combination thereof, wherein the polymorphic note upon receipt is associated with no specific triggering criteria;
determining a subject associated with the polymorphic note and one or more triggering items;
retrieving contextual information from the device;
adding social tools to the polymorphic note, whereby the polymorphic note historically separates objects;
matching the contextual information that relates to the subject to further define the subject; and
generating a reminder of the polymorphic note based, at least in part, on the contextual information and the one or more triggering items
wherein a plurality of polymorphic notes are organized into electronic notebooks, and wherein the polymorphic notes are linked in an explicit relationship to facilitate navigation between them.

23. A non-transitory computer-readable storage medium of claim 22, wherein the apparatus is caused to further perform:
causing, at least in part, a modification of the polymorphic note based, at least in part, on the contextual information, one or more user inputs at the device, one or more communications associated with the device, or a combination thereof; and
causing, at least in part, an evolving of the polymorphic note into one or more objects of one or more different application types based, at least in part, on the modification,
wherein a presentation of the reminder is further based, at least in part, on the contextual information.

24. A non-transitory computer-readable storage medium of claim 23, wherein the contextual information includes a device activity, and wherein the apparatus is caused to further perform:
selecting a random time during the device activity,
wherein the presentation of the reminder occurs at the random time.

25. A non-transitory computer-readable storage medium of claim 23, wherein the contextual information indicates a substantially dormant period of the device, and wherein the apparatus is caused to further perform:
selecting a random time within the dormant period,
wherein the presentation of the reminder occurs at the random time.