Abstract:
A visual display for an electronic device is partitioned into regions. Each of the regions is associated with a key on a keypad. One exemplary implementation is a 3×3 grid of regions corresponding to nine keys numbered 1-9 on a numbered keypad. A visual correspondence is provided for the user to associate choices illustrated in the regions with the numbered keys. The regions display visual information such as graphics and/or text to identify a selection option. The keys are associated with the regions such that when a key is selected the selection option associated with the region is chosen. In this fashion, a user may navigate through content, such as content from the Internet, to gain accesses to service, to obtain information and to purchase items.

Description:
RELATED APPLICATION  
       [0001]    This application claims the benefit of and is a continuation application of U.S. application Ser. No. 09/513,831 entitled entitled “Keypad Driven Graphical User Interface for a Portable Device”(as amended), filed on May 23, 2003, which claimed the benefit of and is a Continuing Prosecution Application (CPA) of a U.S. application Ser. No. 09/513,831 entitled “Graphical Layout and Keypad Response to Visually Depict and Implement Device Functionality for Interactivity With a Numbered Keypad”, filed on Feb. 25, 2000. Each of the aforementioned applications are hereby incorporated herein by reference in their entirety. 
     
    
     
       TECHNICAL FIELD  
         [0002]    The present invention relates generally to communication devices and more particularly to a graphical layout and keypad response to visually depict and implement device functionality for interactivity with a numbered keypad on an electronic device.  
         BACKGROUND OF THE INVENTION  
         [0003]    Internet access has traditionally been realized through computer systems, such as personal computer (PC) systems that include a video display, a full keyboard and a mouse. With such computer systems, users may navigate the Internet by entering text with the keyboard or by manipulating the mouse. As a result, users have become accustomed to navigating the net using a keyboard and a mouse. Unfortunately, full keyboards and mouse are not found on many of the newly emerging devices for accessing the Internet. For example, mobile phones typically have a small screen displays (such as an LCD display), rather than a full keyboard. Other devices that may be used to access the Internet also have such limitations. These limitations make it difficult for users to access content on the Internet with these devices and to navigate through content that is available on the Internet.  
         SUMMARY OF THE INVENTION  
         [0004]    The present invention addresses the limitations of the prior art by providing a paradigm for more easily navigating content, such as with the Internet and more generally for use with wireless applications. This paradigm is especially well adapted for use with mobile phones. In one embodiment of the present invention, visual information is displayed on the display of an electronic device, such as a mobile phone. The display is logically partitioned into distinct regions. These regions may have borders that visually delimit the regions from each other. Each of the regions is associated with one of the keys on the keypad of the device. The visual information represents a selection option that a user may select by pressing the key that is associated with the region. Once the key is selected, an event may be triggered that is appropriate for the chosen option. The layout of the regions may correspond with the geometric layout of the keys. Alternatively, the regions may contain visual cues (e.g. numbers) of the associated keys.  
           [0005]    In one application of the present invention, a map is displayed on the display of the electronic device. The map is partitioned into nine regions corresponding with nine numbered keys on the keypad of the device. When a user selects one of the numbered keys, the user requests more detail regarding the region on the map that is associated with the numbered key. After the user selects the numbered key, a more detailed map of the associated region is displayed on the display. This more detailed map may also be partitioned into regions associated with keys on the keypad. Selection of one of the keys produces an even more detailed map of the associated region. In this fashion, a user may iteratively locate particular sites, such as a purveyor of services, a seller of goods, an automatic teller machine, or other type of facility.  
           [0006]    It should be appreciated that the above example of the map is only one of many possible applications of the present invention. As will be described in more detail below, the present invention may also be applied to obtain information, obtain services, purchase goods, etc. Moreover, it should be appreciated that the present invention is not limited to application to mobile phones but rather is more generally applicable to devices that have a limited set of keys on a keypad and a display.  
           [0007]    In accordance with one aspect of the present invention, a method is practiced in an electronic apparatus having a display and a numbered keypad with keys. Visual information is displayed on the display in sections. Each section is associated with a respective one of the keys on the numbered keypad. Each section provides a visual indication of the selection associated with selecting the key on the numbered keypad. An event is triggered in response to the selection of one of the keys in the numbered keypad. The sections may contain text, graphical information and/or a combination thereof. The electronic apparatus may take many forms including but not limited to a telephone, a mobile phone, a pager, a personal digital assistant (PDA), interactive television system or an Internet appliance. The event that is triggered may include the display of additional information on the display, the placing of a telephone call or other activities.  
           [0008]    In accordance with another aspect of the present invention, information is displayed on the display of a mobile telephone having a numbered keypad containing keys. The display is visually partitioned into at least two regions wherein each region is associated with a respective one of the keys on the number keypad and each section represents a choice of an option that may be selected by selecting the associated key. The regions are organized on the display in a configuration that corresponds to a configuration of the keys on the numbered keypad. Thus, there is a visually intuitive correspondence between the regions and the keys on the keypad. An action is taken in response to the selection of a selected one of the keys on the number keypad. Each region may be associated with a service option, such as the selection of the key results in a request for the service.  
           [0009]    In accordance with a further aspect of the present invention, navigation options are output on an output device to generate a first output. Each output option occupies a portion of the output that correlates to one of the numbered buttons on the electronic device. The output options are patterned on the first output to correspond to a physical layout of the numbered buttons. When a user of the electronic device selects one of the numbered buttons, a new set of navigation options are output on the output device. These new navigation options are associated with a selected button. The new navigation options are pattered to correspond with the physical layout of the numbered buttons and each option is correlated with one of the numbered buttons.  
           [0010]    In accordance with an additional aspect of the present invention, a first map of a geographic area is displayed on a display of an electronic device. The first map contains a site that a party wishes to locate. The map is partitioned into visually delimited regions and each region corresponds to a respective one of the numbered keys. Upon a user selecting a selected one of the numbered keys, a second map is displayed on the display. The second map depicts the region of the first map that corresponds to the selected one of the numbered keys. The second map contains more detail on the region.  
           [0011]    In accordance with yet another aspect of the present invention, visual representations of services are displayed in respective regions of a display on electronic device. Each of the regions corresponds to the respective key on a numbered keypad in the electronic device. The regions are patterned in a geometric configuration corresponding to the geometric configuration of the keys on the numbered keypad. In response to a user of the electronic device selecting a selected one of the keys, information is displayed on the display to enable the user to request a given service that is visually represented by the region that corresponds with the selected key. 
       
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0012]    An illustrative embodiment consistent with the principles of the present invention will be described below relative to the following drawings.  
         [0013]    [0013]FIG. 1 depicts a number of different options for an electronic device to be used in the illustrative embodiment of the present invention.  
         [0014]    [0014]FIG. 2A depicts an example of an application of the illustrative embodiment for navigation of a map on a mobile phone.  
         [0015]    [0015]FIG. 2B illustrates an example wherein a keypad is not numbered but rather is sequenced with letters.  
         [0016]    [0016]FIG. 2A shows an example wherein only a subset of the keys in the keypad are associated with regions  
         [0017]    [0017]FIG. 3 is a flow chart illustrating the steps that are performed when a user selects a key in accordance with the illustrative embodiment.  
         [0018]    [0018]FIGS. 4A-4D illustrate an example of Internet navigation through successively more detailed maps in accordance with the illustrative embodiment.  
         [0019]    [0019]FIG. 5 is a flow chart illustrating the steps that are performed to perform such iterative navigation of a map.  
         [0020]    [0020]FIG. 6 illustrates components that may be employed in practicing the illustrative embodiment when the electronic device is a mobile phone.  
         [0021]    [0021]FIG. 7 is a block diagram illustrating components of a mobile phone that are used in the illustrative embodiment.  
         [0022]    [0022]FIG. 8 illustrates an example wherein a display shows service choices.  
         [0023]    [0023]FIG. 9 is a flow chart illustrating the steps that are performed for a user to choose a service option.  
         [0024]    [0024]FIG. 10 illustrates an example of the appearance of the display on a mobile phone for purchasing a soft drink.  
         [0025]    [0025]FIGS. 11A and 11B illustrate examples of displays that are shown when a user requests to purchase a pizza.  
         [0026]    [0026]FIG. 12 illustrates components used when the illustrative embodiment is practiced on a television system. 
     
    
     DETAILED DESCRIPTION OF THE INVENTION  
       [0027]    The illustrative embodiment of the present invention provides an approach for organizing visual information for display on electronic devices so as to provide a visually intuitive interface for assisting a user in interacting with the device. The visual display is configured to be especially useful in assisting a user in navigating through hierarchical layers of content. The illustrative embodiment may be used in a number of different types of electronic devices, as will be described in more detail below. The illustrative embodiment provides a mechanism for easing access to content, such as that available over the Internet.  
         [0028]    The illustrative embodiment logically partitions a display into visually delimited regions. The regions may be separated by explicit borders or by delimiting space. Each region is associated with keys or buttons on the associated electronic device. Each region may represent a selection choice and may provide information regarding the selection choice. When a user selects the key or button that is associated with a given selection choice, events may be triggered so as to take actions associated with the choice. For example, the selection of a choice may cause a new display to be shown on the display where the new display contains additional information or choices regarding the selected choice.  
         [0029]    The illustrative embodiment has applicability to a number of different applications. Some example applications will be described in more detail below. For example, the illustrative embodiment may be employed to locate goods, services or other desired sites by iteratively stepping through successively more detailed maps to locate the desired entity. Furthermore, the illustrative embodiment may be used to gain access to goods or services.  
         [0030]    As was mentioned above, the illustrative embodiment is practiced with a number of different types of electronic devices. FIG. 1 depicts a number of the different options that are available for practicing the illustrative embodiment. As is shown in FIG. 1, the electronic device may be a mobile phone  12 , such as a cellular phone. The electronic device  10  may also be a conventional telephone  14  that communicates over land lines. The electronic device  10  may be a pager  16 . The electronic device  10  may be a television system  18  such as the combination of a remote control with a settop box and television. The electronic device  10  may be a computer system  20 , such as a network computer, personal computer or other type of device. The electronic device  10  may be an Internet appliance  22 , an electronic book  24  or other device type  26 . The depiction of examples of electronic devices in FIG. 1 is intended to be merely illustrative and not limiting of the present invention. The present invention may more generally be practiced with instances where there is a visual output device and an associated subset of keys or buttons.  
         [0031]    [0031]FIG. 2A shows an example of a mobile phone  12  for practicing the illustrative embodiment of the present invention. The mobile phone  12  includes a display  30  and a keypad  32 . The keys on the keypad  32  are numbered 1-9. The display  30  shows visual information that is logically partitioned into regions or sections  36 ,  38 ,  40 ,  42 ,  44 ,  46 ,  48 ,  50  and  52 . Each of the regions or sections is correlated or associated with one of the keys on the keypad  32 . For example, region  38  is associated with key  34 . The geometric configuration or physical layout of the regions  36 - 52  corresponds to the geometric configuration and physical layout of the keys on the keypad  32 . In the example depicted in FIG. 2A, each of the regions is visually delimited from the other by a border. Those skilled in the art will appreciate that there also may be instances where the regions are not visually delimited by borders but rather are delimited by space or by other delimiting mechanisms.  
         [0032]    In the example depicted in FIG. 2A, each region displays graphical information without displaying text. Those skilled in the art will appreciate that text may also be displayed in the regions. This text may include numbers that directly associate the regions with the associated numbered keys on the keypad  32 .  
         [0033]    As shown in FIG. 2B, the present invention is not limited to instances where a numbered keypad is utilized. The keypads may also associated with other varieties of characters, such a letters as depicted in FIG. 2B. Those skilled in the art will appreciate that the characters may include punctuation marks or other varieties of characters. Still further, the keys on the keypad may not be associated with characters per se but rather may include functional keys (e.g. ctrl, alt, shift, F1, etc.).  
         [0034]    It should be appreciated that there may be fewer regions than keys in the keypad. In the example depicted in FIG. 2C, the display  30  for the mobile phone is partitioned solely into three regions  38 ,  46  and  52  which are associated with the keys  2 ,  8  and  5 , respectively. The remaining keys are not depicted in FIG. 2C but may be present on the keypad  32 . The active subset of key  32 ′ is shown in FIG. 2C.  
         [0035]    [0035]FIG. 3 is a flow chart that provides an overview of the steps performed in a single iteration of operation in the illustrative embodiment. In general, visual information is displayed in sections on a display on an electronic device where the sections are associated with keys (step  60  in FIG. 3). The visual information may provide a visual indication of the event or activity associated with selection on the key. The user then selects a key (step  62  in FIG. 3). The electronic device contains hardware or software logic for triggering an associated event when the key is depressed (step  64  in FIG. 3). The triggering of the event may include multiple types of events such as the display of additional information. For the example case of a mobile phone, the event may include the placing of a telephone call, submitting a form or a request to a remote computing resource, etc. The illustrative embodiment is not intended to be limited to a particular event or subset of events that are triggered. The events are largely dependent upon the application.  
         [0036]    An example is helpful to illustrate operation of the illustrative embodiment. FIG. 2A shows an initial map  70  on the display  30  of a mobile phone  12 . An example of the use of the cellular phone  12  for the case shown in FIG. 2A will be described below relative to the flow chart of FIG. 5. Initially, the location of the user must be determined (step  100  in FIG. 5). The location of the user may be determined in multiple ways. In a first case, the mobile phone service provider knows the cell in which the user is currently present in this information may be used to determine a geographic location. Appropriate information may be gathered from the database at a server and forwarded to the cellular phone  12  so that the proper map  70  is initially displayed. In addition, another alternative is to gather the ANI (automatic number identification) for a call originating from the mobile phone  12  to initiate Internet access. The ANI will contain an area code and the area code can be mapped to a given geographic location. A third alternative is to use a global positioning (GPS) mechanism that is built into the mobile phone  12  to locate the user and the mobile phone  12 . The configuration of other components employed with the mobile phone  12  will be described in more detail below. Once the location of the user is determined images may be retrieved for the geographic location associated with the user and forwarded to the mobile phone  12  (step  102  in FIG. 5). This high level map is displayed on the display  30  of the mobile phone  12  (step  104  in FIG. 5).  
         [0037]    Suppose in the example case depicted in FIG. 2A that the user selects the two button  34 . The two button  34  is associated with region  38  which represents a northern portion of Manhattan in the map  70  shown in FIG. 2A. The mobile phone  12  receives the user selection (step  106  in FIG. 5) and then must take steps to display the next level of the map (step  108  in FIG. 5). The mobile phone  12  may have cached the next level of the map and may retrieve the next level of the map from local memory or may submit a request out over the wireless network to a server that contains the map. FIG. 4A shows an example of the next level map  72  that result from depressing the two button  34  of FIG. 2A. As can be seen, the map  72  has more detail and shows the region  38  with a finer resolution so that streets are visible and street names are contained in the display. It is also noteworthy that this additional display is also partitioned into 9 regions that correspond with the 9 keys on the keypad  32 .  
         [0038]    Depending on the application, the display of the next level map  72  may be the last map. Thus, a check is made to see whether the lowest level has been reached or not (see step  110  in FIG. 5). Otherwise, if the application is not done, the application waits for user selection. In the example case depicted in FIG. 4A, suppose that user selects the seven button  76  to obtain a more detailed map of region  74 . This more detailed map  78  is depicted in FIG. 4B. The user then next selects the eight button  80  to obtain more detail for the region  82 . This results in a still more detailed map  84  as shown in FIG. 4C. As can be seen, steps  106 ,  108  and  110  of FIG. 5 are repeated in such instances. For example depicted FIG. 4C, the supposed user selects the nine button  88  to obtain a more detailed view of region  86 . This results in the bottom level map  90  being displayed (see FIG. 4D). Hence, the application is “done”, as checked in step  110  of FIG. 5. The bottom level map  90  depicts sites of interest  92  and  94 . These sites may have a visual indication of the map  90  (e.g., see the circles in FIG. 5). The sites of interest  92  and  94  for this example case represent automatic teller machines. The sites may also be sellers of goods, services, landmarks or other types of facilities. The nature of the sites is dependent on the application.  
         [0039]    [0039]FIG. 6 depicts components that may be employed in a system  120  for practicing the illustrative embodiment on the electronic device of the mobile phone  12 . The mobile phone  12  is connected to a wireless network  122 . For illustrative purposes, it is presumed that content is provided by a web server  126  that is connected to the internet or another computer network that complies with the TCP/IP protocol suite. The web server  126  communicates with a proxy  124  that is connected to the wireless network  122 . It is presumed for illustrative purposes that the wireless access protocol (WAP) is used in this system  120 . WAP specifies an application framework and network protocols for wireless devices, such as mobile telephones, pagers and PDA&#39;s. The web proxy  124  may be a computing resource that allows the WAP client (i.e., the mobile phone  12 ) to gain access to services provided by web server  126 . The web server  126  includes a processor  132  for executing instructions. The web proxy  124  translates WAP requests to Internet requests. The web proxy  124  also encodes responses from the web server  126  into a format that is understood by the mobile phone  12 .  
         [0040]    The content that is provided by the web server  126  may be encoded in different formats. For example, the content may be encoded in hypertext mark-up language (HTML) or in the wireless mark-up language (WML). The content may also be encoded in extensible mark-up language (XML) or in other mark-up languages. Still further, the content may be encoded in a format other than a mark-up language that is suitable for passing content over the wireless network  122  to the mobile phone  12 . A filter  130  may be provided for converting HTML content into WML and a filter  131  may be provided for converting XML content into WML. The WML content may be forwarded by the WAP proxy  124  over the wireless network  122  to the mobile phone  12 . WML employs the notion of a “card,” which is a single unit of navigation in user interface. For purposes of the present applications, each card is associated with a single display instance for the display on the electronic device. Hence, the map  70  depicted at FIG. 2A is encoded in a single card. Each card may contain information to present to the user, instructions for gathering user input and mechanism for triggering events. WML also employs the notion of a “deck.” A deck is a logical collection of WML cards. Sequences of maps may be partitioned into decks as needed.  
         [0041]    The web server  126  may have a database  128  that contains cards and decks. These may be forwarded to the mobile phone  12  as needed. When the mobile phone  12  begins an application that requires cards or decks, the information may be forwarded from the database  128  by the web server  126  to be sent to the mobile phone  12  for caching therein. Other content may need to be presented on demand. FIG. 7 provides a high-level block diagram illustrating components for the mobile phone  12 . The mobile phone  12  may contain a processor  40  for executing instructions and generally directing activity within the mobile phone  12 . As has been mentioned above, the mobile phone  12  includes a display  30  and keypad  32 . The mobile phone may contain various telephony logic  142  for providing functionality for the mobile phone  12 , such as placing calls and the like. The mobile phone  12  may include a storage  144  for holding programs and data. The programs may include application programs  146  and a web browser  148 . The web browser  148  may be a WML browser that enables the user to gain access from the Internet for display on the display  30  on the mobile phone  12 . The web browser  148  may contain a WML interpreter and other suitable mechanisms including a cache. The storage  144  may hold buffered decks  150  or cards  152 .  
         [0042]    It should be appreciated that the illustrative embodiment need not be implemented in software but rather may also be implemented in hardware, firmware or a combination of software, firmware and hardware. In an example depicted in FIG. 7, the mobile phone  12  may include logic circuitry  154  for implementing the functionality described for the illustrative embodiment of the present invention.  
         [0043]    The illustrative embodiment may also be employed to display service options to a user of an electronic device, such as a mobile phone  12 . FIG. 8 depicts an example of a screen display  160  that is shown on display  30  of a mobile phone  12  where each of the regions is associated with a given service option. The service options are identified by graphics. The highlighted region  162  is associated with a film option for locating a nearest movie theater and presenting move times and the like. Option  164  is associated with a service for ordering a pizza. To select the option associated with region  162 , the user would select the 3 button  166  shown at FIG. 8.  
         [0044]    [0044]FIG. 9 is a flow chart illustrating the steps that are performed for use to gain access to services in the illustrative embodiment. Initially, the service options are displayed on the display (step  180  in FIG. 9). For an example case, depicted FIG. 8, screen  160  is shown on display  30  to itemize the service options. The user then chooses one of the options by selecting an associated key or button (step  182  in FIG. 9). For example, in FIG. 8, the user may press 3 mbutton  166  to select the option associated with region  162 . The display of a sequence associated with the option is then initiated (step  184  in FIG. 9). This sequence may vary depending upon the nature of the service that is selected and the nature of the application.  
         [0045]    [0045]FIG. 10 serves an example screen  190  that may be displayed when the user selects an option to purchase some soda. The user may be presented with a number of different types of soda to purchase and different sizes ranging from a 12 oz. can to a 2-liter bottle. FIG. 11A shows an example of a screen  192  that may be displayed when the user selects the option associated with region  164  of FIG. 8 to order a pizza. The user may be asked by the screen  192  to select the size of the pizza. It is worth noting that there are only 4 options in this case and that the identity of the associated button is shown in phantom form as part of the background of the region on the screen  192 . The application may also contain intelligence or simplifying the task of ordering a pizza. As shown in FIG. 11B, the user may be prompted to request “the usual,” which refers to what the user typically orders. It is noteworthy that the region  196  is associated with buttons 1, 2 and 3 on the keypad  32 . Region  198  prompts the user to order the same pizza as was most recently ordered. This region is associated with button 4, 5 and 6. Lastly region  200  may be selected for the user to order an entirely new pizza. Region  200  is associated with buttons 7, 8 and 9.  
         [0046]    While this discussion has focused primarily on example instances wherein the electronic device is a mobile telephone  12 . FIG. 12 depicts an example wherein the electronic device is a television system  18 . The television system  18 , may be an interactive television system that facilitates access to the Internet. The television system  18  includes a remote control  201  that may communicate with a settop box  204  by way of a wireless communication path. The remote control  201  may, for example, communicate with a settop box  204  by way of infra-red communications. Remote control  201  includes a keypad  202 . For example depicted in FIG. 12, the keypad  202  contains keys numbered 1 through 9. The keypad may also contain additional keys and those skilled in the art will appreciate the keypad need not be numbered but rather may contain another sequence of characters or keys. The settop box  204  contains a processor  212  upon which a web browser  214  may operate to render web pages  216  on a television  206 . The display in the television  206  is presumed in the illustrative embodiment to be partitioned into logical regions, as has been discussed above. For the example depicted in FIG. 12, the television  206  has a display that is partitioned into nine regions associated with the nine buttons. This is intended to be merely illustrative and not limiting of the present invention. The processor  212  may also have access to pages of content  216 . These may be HTML pages, XML pages or pages in a suitable content for rendering on the television  206  by the settop box  204 . Various application programs  218  may also be operative on the processor  212 . The settop box  204  communicates over a network  208 , such as a cable network or a combination of a cable network and a computer network to gain access to a server  210 . The server  210  may, for example, be resident at a cable station. The server  210  includes a processor  220  that executes programs  222  for interacting with a settop box  204 . The server  210  may also have access to content  224  such as the pages  216  that are rendered by the television  206  in other varieties of content.  
         [0047]    An instance of a television system  18  is shown in FIG. 12. The display is on the television  206  and the keypad  202  is on the remote control  200 . Those skilled in the art will also appreciate there may be instances where the keypad is on the settop box  204 . The display shown on the television  206  is logically partitioned into regions that are associated with the keys in the keypad  202  of the remote control  201  so as to provide the behavior such as has been described above.  
         [0048]    While the present invention has been described with reference to an illustrative embodiment thereof, those skilled in the art will appreciate that various changes in form and detail may be made without departing from the intended scope of the present invention as defined in the appended claims.