Source: http://www.google.com/patents/US20060265653?ie=ISO-8859-1&dq=6,600,481
Timestamp: 2014-07-31 07:26:31
Document Index: 142050936

Matched Legal Cases: ['art 62', 'art 62', 'arts 510', 'art 510', 'art 520', 'art 530']

Patent US20060265653 - Pocket computer and associated methods - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign in<nobr>Advanced Patent Search</nobr>PatentsA pocket computer is presented having an apparatus housing and a user interface with a touch-sensitive display provided at a first side surface of said apparatus housing, at least one key for navigation among content shown on said display, and at least one key for performing zooming on content shown...http://www.google.com/patents/US20060265653?utm_source=gb-gplus-sharePatent US20060265653 - Pocket computer and associated methodsAdvanced Patent SearchPublication numberUS20060265653 A1Publication typeApplicationApplication numberUS 11/135,624Publication dateNov 23, 2006Filing dateMay 23, 2005Priority dateMay 23, 2005Also published asUS20060262136, US20060262146, US20070120832Publication number11135624, 135624, US 2006/0265653 A1, US 2006/265653 A1, US 20060265653 A1, US 20060265653A1, US 2006265653 A1, US 2006265653A1, US-A1-20060265653, US-A1-2006265653, US2006/0265653A1, US2006/265653A1, US20060265653 A1, US20060265653A1, US2006265653 A1, US2006265653A1InventorsJuho Paasonen, Henri Melaanvuo, Roope Rainisto, Petri Tolppanen, Hannu Pirskanen, Kalle Saarinen, Matti Vaisanen, Virpi Roto, Panu Johansson, Eero Tamminen, Simo Sade, Jussi-Pekka KekkiOriginal AssigneeJuho Paasonen, Henri Melaanvuo, Roope Rainisto, Petri Tolppanen, Hannu Pirskanen, Kalle Saarinen, Matti Vaisanen, Virpi Roto, Panu Johansson, Eero Tamminen, Simo Sade, Jussi-Pekka KekkiExport CitationBiBTeX, EndNote, RefManPatent Citations (3), Referenced by (24), Classifications (9), Legal Events (1) External Links: USPTO, USPTO Assignment, EspacenetPocket computer and associated methodsUS 20060265653 A1Abstract A pocket computer is presented having an apparatus housing and a user interface with a touch-sensitive display provided at a first side surface of said apparatus housing, at least one key for navigation among content shown on said display, and at least one key for performing zooming on content shown on said display. Various methods of operating this user interface are also presented. Images(27) Claims(56)
DETAILED DESCRIPTION OF THE INVENTION The pocket computer 1 of the illustrated embodiment comprises an apparatus housing 2 and a large touch-sensitive display 3 provided at the surface of a front side 2 f of the apparatus housing 2. Next to the display 3 a plurality of hardware keys 5 a-d are provided, as well as a speaker 6. More particularly, key 5 a is a five-way navigation key, i.e. a key which is depressible at four different peripheral positions to command navigation in respective orthogonal directions (�up�, �down�, �left�, �right�) among information shown on the display 3, as well as depressible at a center position to command selection among information shown on the display 3. Key 5 b is a cancel key, key 5 c is a menu or options key, and key 5 d is a home key. In addition, a second plurality of hardware keys 4 a-cis provided at the surface of a first short side 2 u of the apparatus housing 2. Key 4 a is a power on/off key, key 4 b is an increase/decrease key, and key 4 c is for toggling between full-screen and normal presentation on the display 3. At the surface of a second short side 2 1 of the apparatus housing 2, opposite to said first short side 2 u, there are provided an earphone audio terminal 7 a, a mains power terminal 7 b and a wire-based data interface 7 c in the form of a serial USB port. Being touch-sensitive, the display 3 will act both as a visual output device 52 and as an input device 53, both of which are included in a user interface 51 to a user 9 (see FIG. 5). More specifically, as seen in FIG. 1, the user 9 may operate the pocket computer 1 by pointing/tapping/dragging with a stylus 9 c, held in one hand 9 a, on the surface of the touch-sensitive display 3 and/or by actuating any of the hardware keys 4 a-c, 5 a-d (which also are included as input devices in the user interface 51) with the thumb and index finger of the other hand 9 b. As seen in FIG. 5, the pocket computer 1 also has a controller 50 with associated memory 54. The controller is responsible for the overall operation of the pocket computer 1 and may be implemented by any commercially available CPU (Central Processing Unit), DSP (Digital Signal Processor) or any other electronic programmable logic device. The associated memory may be internal and/or external to the controller 50 and may be RAM memory, ROM memory, EEPROM memory, flash memory, hard disk, or any combination thereof. The memory 54 is used for various purposes by the controller 50, one of them being for storing data and program instructions for various pieces of software in the pocket computer 1. The software may include a real-time operating system, drivers e.g. for the user interface 51, as well as various applications 57. Many if not all of these applications will interact with the user 9 both by receiving data input from him, such as text input through the input device 53, and by providing data output to him, such as visual output in the form of e.g. text and graphical information presented on the display 52. Non-limiting examples of applications are an Internet/WWW/WAP browser application, a contacts application, a messaging application (email, SMS, MMS), a calendar application, an organizer application, a video game application, a calculator application, a voice memo application, an alarm clock application, a word processing application, a spreadsheet application, a code memory application, a music player application, a media streaming application, and a control panel application. Some applications will be described in more detail later. GUI (graphical user interface) functionality 56 in the user interface 51 controls the interaction between the applications 57, the user 9 and the elements 52, 53 of the user interface. Text input to the pocket computer 1 may be performed in different ways. One way is to use a virtual keyboard presented on the display. By tapping with the stylus 9 c on individual buttons or keys of the virtual keyboard, the user 9 may input successive characters which aggregate to a text input shown in a text input field on the display. Another way to input text is by performing handwriting on the touch-sensitive using the stylus 9 c and involving handwriting recognition. Word prediction/completion functionality may be provided. To allow portable use, the pocket computer 1 has a rechargeable battery. The pocket computer also has at least one interface 55 for wireless access to network resources on at least one digital network. More detailed examples of this are given in FIG. 4. Here, the pocket computer 1 may connect to a data communications network 32 by establishing a wireless link via a network access point 30, such as a WLAN (Wireless Local Area Network) router. The data communications network 32 may be a wide area network (WAN), such as Internet or some part thereof, a local area network (LAN), etc. A plurality of network resources 40-44 may be connected to the data communications network 32 and are thus made available to the user 9 through the pocket computer 1. For instance, the network resources may include servers 40 with associated contents 42 such as www data, wap data, ftp data, email data, audio data, video data, etc. The network resources may also include other end-user devices 44, such as personal computers. A second digital network 26 is shown in FIG. 4 in the form of a mobile telecommunications network, compliant with any available mobile telecommunications standard such as GSM, UMTS, D-AMPS or CDMA2000. In the illustrated exemplifying embodiment, the user 9 may access network resources 28 on the mobile telecommunications network 26 through the pocket computer 1 by establishing a wireless link lob to a mobile terminal 20, which in turn has operative access to the mobile telecommunications network 26 over a wireless link 22 to a base station 24, as is well known per se. The wireless links 10 a, 10 b may for instance be in compliance with Bluetooth�, WLAN (Wireless Local Area Network, e.g. as specified in IEEE 802.11), HomeRF or HIPERLAN. Thus, the interface(s) 55 will contain all the necessary hardware and software required for establishing such links, as is readily realized by a man skilled in the art. FIG. 6 shows a front view of the pocket computer and indicates a typical display screen layout of its user interface. A typical disposition of the display screen layout, presenting a view of a home application (i.e., a start or base view that the user may return to whenever he likes), is shown in more detail in FIG. 7. In FIG. 6, the hardware keys 5 a-d are shown at their actual location to the left of the display 3 on the front side surface 2 f of the apparatus housing 2, whereas, for clarity reasons, the hardware keys 4 a-c are illustrated as being located above the display 3 on the front side surface 2 f even while they actually are located at aforesaid first short side surface 2 u(FIG. 2). With reference to FIG. 7, the display screen layout of the display 3 is divided into four main areas: a task navigator 60, a title area 70, a status indicator area 74 and an application area 80. The application area 80 is used by a currently active application to present whatever information (content) is relevant and also to provide user interface controls such as click buttons, scrollable list, check boxes, radio buttons, hyper links, etc, which allow the user to interact with the currently active application by way of the stylus 9 c. One example of how a currently active application, in the form of a web browser, uses the application area 80 in this manner is shown in FIG. 9. A name or other brief description of the currently active application (e.g. the web browser) and a current file or data item (e.g. the current web page) is given at 72 in the title area 70 (e.g. �Web�Nokia�). In addition, as seen in FIG. 10, by tapping in the title area 70, the user may access an application menu 73 of the currently active application. The status indicator area 74 contains a plurality of icons 76 that provide information about system events and status, typically not associated with any particular active application. As seen in FIG. 7, the icons 76 may include a battery charge indicator, a display brightness control, a volume control as well as icons that pertain to the network interface(s) 55 and the ways in which the pocket computer connects to the network(s) 32, 26. The task navigator 60, title area 70 and status indicator area 74 always remain on screen at their respective locations, unless full screen mode is commanded by depressing the hardware key 4 c. In such a case, the currently active application will use all of the display 3 in an expansion of the application area 80, and the areas 60, 70 and 74 will thus be hidden. The task navigator 60 has an upper portion 62 and a lower portion 66. The upper portion 62 contains icons 63-65 which when selected will open a task-oriented, context-specific menu 90 to the right of the selected icon (see FIG. 8, FIG. 11). The context-specific menu 90 will contain a plurality of task-oriented menu items 91, and the user may navigate among these menu items and select a desired one either by the navigation key 5 a or by pointing at the display 3. The menu 90 may be hierarchical. The lower portion 66 represents an application switcher panel with respective icons 67 for each of a plurality of launched applications. The upper portion 62 of the task navigator 60 will now be described in more detail. The topmost icon 63 is used for accessing tasks related to information browsing. The available tasks are presented as menu items 91 in menu 90, as seen in FIG. 8. More particularly, the user 9 may choose between opening a new browser window (FIG. 9), or managing bookmarks. Selecting of any of these menu items 91 will cause launching of the associated application (a browser application as seen in FIG. 9 or a bookmark manager as seen in FIGS. 13-14), or switching to such application if it is already included among the active ones, and also invocation of the appropriate functionality therein. In addition, the menu 90 contains a set of direct links 92 to certain web pages. In the disclosed embodiment, this set includes bookmarks previously defined by the user 9, but in other embodiments it may include the most recently visited web sites. The second icon 64 is used for accessing tasks related to electronic messaging, as is seen in FIGS. 11 and 12. Thus, the icons 63 and 64 allow the user 9 to operate his pocket computer in a task-oriented manner. By simply clicking on the desired icon which represents a common use aspect, the user will be presented with a list of various tasks that can be undertaken for that use aspect, instead of a conventional list of the available applications as such. This will make it easier to operate the pocket computer 1, since a typical user 9 is most often task-driven rather than application-driven. For instance, if the user realizes that he needs to exchange information with someone, it is more intuitive to click on an icon 64 that represents this use aspect (namely electronic messaging) and have the various available tasks 91 presented in a selectable menu 90 (FIG. 11), than to navigate in a conventional application-oriented menu (or click among a group of shortcut desktop icons representing respective applications), decide which application that is the appropriate one, select this application to launch it, then invoke the application menu of the launched application and navigate in this application menu so as to finally arrive at the appropriate menu item that will perform what the user needed in the first place. If for instance a new email message is what the user needs, he may conveniently click on icon 64, as seen in FIG. 11, and directly select the second menu item 93 shown in the task-oriented menu 90, whereupon the email messaging application will be automatically launched/switched to and the appropriate functionality will be invoked by presenting a create new email dialog 72, as seen in FIG. 12. Selection of the third icon 65 will cause presentation of a menu 90 with links to other tasks that are available, e.g. the various ones among the applications 57 that are not related to information browsing or electronic messaging. Since the icons 63-65 represent use aspects that are likely to be frequently needed by the user 9, they remain static in the upper part 62 of the task navigator 60 and are thus constantly accessible. The lower portion 66 of the task navigator 60 will now be described in more detail. As already mentioned, it represents an application switcher panel with respective icons 67 for each of a plurality of launched applications, i.e. running applications that are executed by the controller 50. Among such running applications, one will be active in the sense that it has control over the application area 80 on the display 3. The user 9 may conveniently use the application switcher panel 66 for switching to a desired application by tapping with the stylus 9 c on the corresponding icon 67. A help text, preferably containing the application's title and a current file name, etc, if applicable, may conveniently be presented on the display 3 next to the icon pointed at, so as to guide the user further. When the user lifts the stylus 9 c, the application corresponding to the icon pointed at will be switched to. In contrast to the icons 63-65 in the upper portion 62, the icons 67 in the application switcher panel 66 have a dynamic appearance; icons may change order, appear and disappear over time. More specifically, in the disclosed embodiment a maximum of four different running applications will be represented by respective icons 67 in the application switcher panel 66. The order among the icons 67 is such that the icon for the most recently active application will be shown at the topmost position, whereas the icon for the application that was active before the most recently active application will be shown immediately below, etc. Often, the one most recently active application, represented by the topmost icon, will be the one that has current control over the application area 80. This is seen for instance in FIG. 11 (the topmost icon being labeled 67 a and containing a browser symbol that represents the currently active web browser application). In such a case, the topmost icon 67 a is shown with a �depressed� appearance, again as seen in FIG. 11. However, when the home application is the currently active one, as seen in FIG. 6, none of the icons 67 represents the currently active home application, and therefore no icon is shown depressed. As appears from the above, the vertical order of the application switcher icons from top to bottom represents a historical order in which the four most recently used applications have been active. When a switch is done from a currently active application to another one, the order of the icons will be updated accordingly. This is shown in FIGS. 11 and 12. In FIG. 11, the web browser application is active and is thus represented by the topmost icon 67 a. The second icon 67 b represents an audio player application that was active before the web browser application was launched, whereas the third and fourth icons 67 c and 67 d represent a file manager application and an image viewer application, respectively, that were active before that. Now, when the user 9 invokes the messaging application by selecting the menu item 93 in the afore-described task-oriented menu 90, the messaging application becomes active and its icon takes the topmost position 67 a, as seen in FIG. 12. At the same time, the existing icons 67 a-c of FIG. 11 are shifted one vertical position downwards, so that the web browser icon (formerly at 67 a) takes the second position at 67 b, the audio player icon moves to the third position 67 c, and the file manager icon goes to the lowermost position 67 d. The formerly shown image viewer icon disappears from the application switcher panel 66, but the image viewer application is still running. By tapping an application switcher menu button (or �more� button) 68, an application switcher menu will be presented in a popup window on the display 3. This application switcher menu will contain menu items for all running applications, including the four most recent ones which are also represented by icons 67 a-d in the application switcher panel 66, as well as those less recent applications the icons of which have been moved out from the application switcher panel 66 (such as the image viewer icon in the example described above). By selecting any desired menu item in the application switcher menu, the user 9 will cause a switch to the corresponding application. The application switcher menu may also include a menu item for the home application, as well as certain handy application control commands, such as �Close all applications�. If the user closes the active application, the topmost icon 67 a will be removed from the application switcher panel 66, and the rest of the icons 67 b-d will be shifted one position upwards in the panel. The application for the icon that now has become the topmost one will be switched to. Certain inventive aspects relate to drag and drop functionality, as will be described in more detail in later sections of this document. It is to be noticed already here that the application switcher panel 66 is particularly well suited for use together with drag and drop functionality. Thus, using the stylus 9 c, the user 9 may make a selection of content presented in the application area 80 for a first application, which is currently active, and drag the selected content to a desired one of the icons 67 in the application switcher panel 66. This will cause activation of an associated second application which will take control over the application area 80 and replace the first application as the currently active one. Then, the user may proceed and drag the stylus to a desired input field of this second application in the application area 80, and finally lift the stylus 9 c, wherein the selected content from the first application will be pasted into the second application. The particulars and functionality of the above-described application switcher panel 66 make switching between applications both fast and intuitive, and also clearly inform the user of the applications which are currently running as well as the order between them. The home application 72 of FIG. 7 will now be described in more detail. Typically, the home application will be activated at start-up of the pocket computer 1. During ongoing use of the pocket computer 1, irrespective of whatever other application that is currently active, the user 9 may always return to the home application by pressing the home key 5 d on the front surface 2 f of the apparatus housing 2. Another way of invoking the home application is through the application switcher menu button 68, as has been described above. As seen in FIG. 7, in this embodiment the home application contains three application views 82, 83 and 84 on the display 3. Each application view is a downscaled version of the application view of another application 57. Thus, among all the functionality nominally provided by such another application 57, the application view in the home application will only provide access to limited parts thereof. For instance, application view 82 in FIG. 7 represents a news application (e.g. Usenet news) and provides a limited view of this application by displaying the number of unread posts together with a few of the latest posts. Tapping on any of these latest posts will cause presentation of the contents of the post in question. If the user wants to access the complete functionality of the news application, he may switch to this application through e.g. the application switcher menu button 68 (as described above), or the �Others� icon 65 in the upper part 62 of the task navigator 60. In another embodiment, tapping on a post in the application view 82 may directly cause launching (if not already running) of or switching to the news application. The application view 83 represents an Internet radio application and gives a limited view of its functionality. By tapping on a �Manage� button therein, the user may invoke the actual Internet radio application to access its entire functionality. The application view 84 represents a Clock application. The interaction between such a limited application view 82, 83, 84 and the actual application it represents may be implemented using push technique, as is readily realized by a skilled person. In one embodiment, the user may configure which application views to include in the home application, and some particulars of them. Using only limited resources in terms of memory, CPU load and display screen space, the home application gives the user 9 a very convenient overlook view of certain applications that he probably likes to access frequently. The bookmark manager 72 previously mentioned will now be described in more detail. As seen in FIGS. 13 and 14, the bookmark manager divides the application area into three parts 510, 520 and 530. Part 510 is a storage hierarchy view, showing a current structure of folders 512 for bookmarks in the pocket computer 1. The user 9 may select any of these folders by tapping on it with the stylus 9 c, wherein the contents of this folder will open up into the second part 520, which lists all bookmarks 522 in the present folder 512. The user 9 may also create or delete such folders by tapping on a respective icon 532 b, 532 e in the third part 530. By tapping on a desired bookmark 522 the web browser application will be invoked, and the web page defined by the bookmark in question will be visited. Moreover, by tapping in a check box 524 provided to the right of each bookmark 522, the user may select one or more of the bookmarks 522. For such selected bookmark(s), further operations may be commanded by tapping on for instance an edit bookmark icon 532 a, a delete bookmark icon 532 e or a move bookmark icon 532 c. If the move bookmark icon 532 c is tapped on, a Move to folder dialog 540 will be shown, as is seen in FIG. 14. Thus, the bookmark manager provides many ways for the user 9 c to manage his selection of bookmarks in a convenient manner. Whenever the terms press and lift are used in this document, it is to be understood that this may be implemented using the stylus 9 c on the touch sensitive display 3, a mouse, a trackball or any other suitable pointer input technology. FIGS. 15A and 15B illustrate how the user may pan content in an embodiment of an inventive aspect. Content 302, or data, available for display is larger than what a display view 301 of the pocket computer 1 can physically render. As known in the art, the display view 301 then shows a subset of the content 302 that can fit into the space defined by the display view 301. As shown in FIG. 15A, to pan content, the user presses the stylus 9 c in a first position 303 and, while holding the stylus 9 c pressed, moves the stylus 9 c to a second position 304, where the stylus 9 c is lifted. This effects a movement of the content according to the movement of the stylus 9 c. So in this example, as the stylus is moved to the left, the underlying available content is moved to the left, creating a resulting view 301 as can be seen in FIG. 15B. In other words, panning may be performed with a tap and drag. FIGS. 16A and 16B illustrate how the user may select text in an embodiment of an inventive aspect. Like for the situation explained in conjunction with FIGS. 15A and 15B, content 302, or data, available for display is larger than what the display view 301 of the pocket computer 1 can physically render. As is known in the art, the display view 301 then shows part of the content 302 that can fit into the space defined by the display view 301. To select part of the data displayed, the user double-taps in a first position 305 and, while holding the stylus 9 c pressed after the second tap, moves the stylus 9 c to a second position 306, where the stylus 9 c is lifted. In other words, the user depresses the stylus 9 c, lifts the stylus 9 c, depresses the stylus 9 c a second time, moves the stylus 9 c and finally lifts the stylus 9 c. As is known in the art, a threshold time may be used for double-tapping such that a difference in time between the first pressing down and the second pressing down must be less than the threshold time for it to be considered a double-tap. Also as known in the art, a displacement in position between the first depression and the second depression must be less than a specific threshold distance for it to be considered a double-tap. In summary, selection of data is performed with a double-tap and drag. The above described method to select data is different from conventional methods to select data. The most common method to select data is to press the stylus 9 c down, move the stylus 9 c and lift the stylus 9 c. However, as explained in conjunction with FIGS. 15A and 15B above, this method is used to pan through content. Consequently, with the novel and inventive way to select data in the inventive aspect, text selection or panning may be performed at will by the user without requiring the user to switch to a specific text selection or panning mode. It is also to be noted that it is also in scope of the inventive aspect to perform panning with a double-tap and drag, and data selection with a tap and drag. FIGS. 17A and 17B illustrate how the user may zoom in or out on text in an embodiment of an inventive aspect. FIG. 17A displays an initial state where the display view 301 displays content being a subset of the available content 302. The user presses a zoom in button 4 b, after which the display is updated to zoom in on the available content as is shown in FIG. 17B. Due to the enlargement of displayed data items, such as text, once zoomed in, the display displays less content than before. Analogously, if the initial state is as shown in FIG. 16B and the user presses a zoom out button 4 b, the display is updated to zoom out on the available content such as is shown in FIG. 17A. Consequently, more data items, such as text, will be displayed once the display is zoomed out. The zooming functionality as explained above is particularly useful in conjunction with the panning functionality described in conjunction with FIG. 15 above. This combination provides an exceptionally efficient manner for the user to navigate through content being larger than the physical display, which for example often is the case while using a web browser application. FIG. 18 is a flow chart illustrating a method for allowing data selection in an embodiment of an inventive aspect. The method in this embodiment is implemented as software code instructions executing in the pocket computer 1. In this method, the display view 301 shows a number of data items of available content 302, where the data items are for example text and/or images. However the display may show any data item representable on a display. In a detect first tap step 331, the pocket computer 1 detects a tap by the stylus 9 c on the touch sensitive display of the pocket computer 1. In a conditional commence data selection step 332, it is determined whether data selection should be commenced. If a second tap of the stylus 9 c is detected, which in conjunction with the tap in the detect first tap step 331 makes up a double tap, it is determined that data selection is to be commenced. However, the time difference between the first and the second tap must be less than a predetermined time. This predetermined time is preferably configurable by the user. Additionally, the second tap position must be in a position less than a threshold distance from said first position. This threshold relative distance, rather than requiring identical positions, is preferably used as it is rather likely that the second tap of an intended double tap by the user is in fact not in the exact same position as the first tap. If it is determined to commence selection of data in the previous step, execution of the method proceeds to a select data items corresponding to movement step 333. Here any movement after the second tap, while the stylus 9 c is still pressed, is detected, giving a current position of the stylus 9 c. It can then be determined that all data items between the first tap position and the current position of the stylus 9 c are selected by the user. This information is updated in the memory 54 in the pocket computer 1 for further processing and is also displayed on the display 3. Once the user lifts the stylus 9 c from the display, the selection has been made and this method ends. If it is not determined in the commence data selection step 332 that data selection is to be commenced, execution of the method ends. With a selection of data items made, the user may, as is known in the art, perform various tasks associated with the selected data items. For example the user may copy the selected data items into a buffer and paste these data items into the same or another document. Alternatively, if the selected data items are text, the selected text could be formatted in various ways. FIG. 19 is a flow chart illustrating a method for allowing both data selection and panning in an embodiment of an inventive aspect. The method in this embodiment is implemented as software code instructions executing in the pocket computer 1. In this method, the display view 301 shows a number of data items of available content 302, where the data items are for example text and/or images. This method is essentially an extension of the method shown in FIG. 18. The detect first tap step 331, the commence data selection step 332 and the select data items corresponding to movement step 333 are in the present embodiment identical to the embodiment shown in FIG. 18. However, in this embodiment, if in the commence data selection step 332 it is determined that data selection is not to be commenced, execution proceeds to a conditional commence panning step 334. In the commence panning step 334, it is determined whether panning is to be commenced. If it is detected that the stylus 9 c used in the detect first tap step 331 is still being pressed and has moved in position from a first position detected in the detect first tap step 331, it is determined that panning is to be commenced. The movement relative to the first position may need to be more than a threshold distance to avoid unintentional panning. If in the commence panning step 334 it is determined that panning is to be commenced, execution of the method proceeds to a pan content corresponding to movement step 335. While the stylus 9 c is still pressed, in this step the content in the display is moved according to the movement of the stylus 9 c. For example, if the stylus 9 c is moved to the left, the underlying available content is moved to the left, such as can be seen in FIG. 15A and 15B, where FIG. 15A shows a display view 301 before the move of the stylus 9 c to the left and FIG. 15B shows a display view 301 after the stylus 9 c is moved to the left. This is the classical way to perform panning. However, as it may be preferred that the display, rather than the content, is moved in the same direction as the stylus 9 c movement, in an alternative embodiment, the display view may move to the left if the stylus 9 c is moved to the left. This alternative type of behavior is more often referred to scrolling, rather than panning. Once it is detected that the user has lifted the stylus 9 c, panning ends and the execution of this method ends. If it is not determined in the commence panning step 334 that panning is to be commenced, execution of the method ends. FIG. 20 is a state diagram for an embodiment of an inventive aspect, allowing both data selection and panning. This diagram illustrates the different states and transition actions between the states in an embodiment allowing the user to select data and to pan without expressively changing modes. This embodiment is implemented as software code instructions executing in the pocket computer 1. A ready state 350 represents a mode when the pocket computer 1 is ready to accept input from the user to either start panning or start selecting text. From the ready state 350, if the user performs a tap action 371 with the stylus 9 c in a first position, the computer transitions to a first tap state 351. From the first tap state 351, if the user performs a lift action 372 with the stylus 9 c, the computer transitions to a first lift state 352. On the other hand, from the first tap state 351, if the user with the stylus 9 c still pressed performs a move action 380 with the stylus 9 c, the computer transitions to a panning state 355. From the first lift state 352, if the user performs a tap new position action 379 with the stylus 9 c, the computer returns to a first tap state 351. The new position may need to be more than a threshold distance from the first position, as the user may tap a second tap of a double tap not in the identical position as the original tap. If instead in the first lift state 352, a timeout action 377 is triggered by the computer, the computer returns to the ready state 350. If in the first lift state 352, the user instead performs a tap same position action 373 with the stylus 9 c, the computer transitions to a second tap state 353. From the second tap state 353, if the user performs a lift action 378 with the stylus 9 c, the computer transitions to the ready state 350. On the other hand, from the second tap state 353, if the user with the stylus 9 c still pressed performs a move action 374 with the stylus 9 c, the computer transitions to a selecting data state 354. Upon entering the selecting data state 354 the computer updates the display to indicate the data on the display between the first position and the current position as selected. The memory 54 is also updated to indicate what data items are currently selected. From the selecting data state 354, if the user performs a move action 375 with the stylus 9 c, the computer reenters the selecting data state 354 with a new current position of the stylus 9 c. On the other hand, from the selecting data state 354, if the user performs a lift action 376 with the stylus 9 c, the computer transitions to the ready state 350, while retaining the current selected data items in the memory 54 for further processing. Also, any indication on the display of the selection is retained. When the computer enters the panning state 355 after the user performs a move action 380 from the first tap state 351, the computer updates the display, moving the available content corresponding to the distance between the current position and the first position. From the panning state 355, if the user performs a move action 381 with the stylus 9 c, the computer reenters the panning state 355 with a new current position. On the other hand, from the panning state 355, if the user performs a lift action 382 with the stylus 9 c, the computer transitions to the ready state 350. FIG. 21 illustrates a web browser showing content with hyperlinks. In this example, the web browser application executing in the pocket computer 1 renders a text on a display view 301 including a number of hyperlinks 310-313. As is known in the art, if the user taps on one of the links using the stylus 9 c on the touch sensitive display 3, the web browser application will in stead display a new web page, referred to by the hyperlink. Alternatively, hardware buttons, such as a right button and a left button of navigation key 5 a, may be used to browse through available hyperlinks 310-313, with at most one hyperlink being selected at any one time, such as hyperlink 311. In the prior art, a tab key on a computer keyboard is used to browse through the available hyperlinks. A web page author may add information about relative the order of the hyperlinks using what is called tab order. This tab order is usually determined by the web page author in order to maximize usability when the web page is displayed on a full size computer display. Thus, when the web page is displayed on a display of the pocket computer, where the pixel resolution is often significantly less than on a full size computer, the original tab order may not be optimal. In an embodiment of an inventive aspect, the tab order indicated by the web author is ignored. Instead, the relative order of the hyperlinks is determined by the geometrical layout on the display. Again with reference to FIG. 21, there may be an example where hyperlink 310 has a tab order of 3, hyperlink 311 has a tab order of 2, hyperlink 312 has a tab order of 5 and hyperlink 313 has a tab order of 4. If the user now indicates a desire to navigate to the subsequent hyperlink after a currently selected hyperlink 311, in the prior art, hyperlink 310 would be determined to be the subsequent hyperlink after hyperlink 311 as hyperlink 310 has the tab order of 3, and the hyperlink 311 has the tab order of 2. However, in this embodiment of an inventive aspect, as the geometrical position takes precedence over the tab order of the hyperlinks, the subsequent hyperlink after hyperlink 311 would be determined as hyperlink 312. This method works in two directions, so if hyperlink 311 is selected and the user indicates a desire to select the subsequent hyperlink before hyperlink 311, hyperlink 310 would be selected. FIGS. 22A and 22B illustrate an embodiment of an inventive aspect before and after a positioned zoom. In FIG. 22A, the display view 301 of the touch sensitive display 3 of the pocket computer 1 shows content with a zoom factor of 100%. In this example, the content is a web page rendered by a web browser application executing in the pocket computer 1. However, any application where the user may benefit from a zoom function could be executing. In this example, the user has held the stylus 9 c on the touch sensitive display 3 in a position 314 during a time period longer than a predetermined time, which has the effect of a context menu 315 showing. In this example, the menu only shows different zoom factors, but any relevant menu items, such as navigation forward and backwards, properties, etc. may be presented in this menu. Additionally, while this example only shows menu items in one level, the menu items may be organized in a hierarchical manner to provide a structured menu, in the case where there are more menu items available which may be grouped in logical subgroups. In this example, the user selects to zoom to 200% by selecting menu item 316. After the user selects the zoom factor, the application proceeds to re-render the same content but now with the new zoom factor, in this case 200%, as can be seen in FIG. 22B. The position relative to the content 314 in FIG. 22A is now a center position in the content re-rendered by the web browser application. FIG. 23 illustrate new content loaded in a web browser. FIGS. 22A and 22B can also be used in conjunction with FIG. 23 to illustrate an embodiment of an inventive aspect where zoom factor information is retained. An example of such a method will now be disclosed. As shown in FIG. 22A, the user may navigate to a first page containing content displayed in the display view 301 with an initial zoom factor of 100%. The user may, for example, change the zoom factor to a new zoom factor of 200% for the first page, by using a context sensitive menu 315 as explained above. The web browser re-renders the content with the new zoom factor of 200% for the first page as can be seen in FIG. 22B. The user may then navigate to a second page, using a link on the first page, by entering a uniform resource locator (URL), or by any other means. As shown in FIG. 23, the second page is then rendered with an initial zoom factor of 100%. The user may then wish to return to the first page, for example using a back button 317 in the web browser application. Upon the user pressing the back button 317, the web browser then re-renders the first page, using the new zoom factor of 200% for the first page. In other words, the browser keeps zoom factor information in memory 54 as part of the browser history, benefiting the browsing experience for the user. This information is stored so it can be used when revisiting already visited pages, either using the back or a forward functionality by means of a back button 317 or a forward button 318, respectively, commonly provided by web browsers in the art. FIG. 24 is a flow chart illustrating a method of an embodiment of a list element according to an inventive aspect. Refer to FIG. 26A-C for an illustrative graphical representation of the list element. The method provides the user with a user interface element representing a list, henceforth called a list element 420, having several ways in which its list items 421 a-d may be selected. In this example, the list element 420 is operable in three modes: a single selection mode, a multiple distinct selection mode and a range selection mode. The flow chart illustrates the way in which selections may be made in the different list element modes. The method in this example is executing in the pocket computer 1 with its touch sensitive display 3. In a detect first tap step 401, a first tap is detected from the stylus 9 c being tapped on the touch sensitive display in a first position. In a select first list item step 402 a first list item corresponding to the first position is selected in the list element 420. The selection may for example be indicated on the display by changing the background color of the selected item and/or rendering a border around the selected item. Additionally, information about the selected item is stored in memory 54 to be available for later processing. In a detect first lift step 403, a first lift of the stylus 9 c is detected in a second position. This second position may be the same or different from the first position detected in the detect first tap step 401 above. In other words, the user may have moved the stylus 9 c between the first tap and the first lift. In a conditional range selection mode & different positions step 404, it is firstly determined if the list element 420 is configured to be in a range selection mode. Secondly, it is determined which first list item corresponds to the first position, when the tap was detected, and which second list item corresponds to the second position, when the lift was detected. If the first list item and the second list item are the same, and the list element 420 is determined to be in a range selection mode, this conditional step is affirmative and execution proceeds to a select list items between first tap and first lift step 405. Otherwise, execution proceeds to a detect second tap step 406. In the select list items between first tap and first lift step 405, all items between the first list item and the second list item are selected. Preferably, the first and the second list items are also selected. What this entails for the user, is that upon dragging over several list items, all of these are selected, provided that the list element 420 is in range selection mode. In the detect second tap step 406, a second tap is detected in a position on the touch sensitive display. In a conditional single selection/range mode step 407, it is determined if the list element 420 is in a single selection or range mode. If this is affirmative, execution proceeds to a deselect any previously selected list items step 408. Otherwise execution proceeds to a select second list item step 409. In the deselect any selected list item step 408, any previously selected list items are deselected. In the select second list item step 409, a list item corresponding to the position detected in the detect second tap step 406 above is selected. Due to the effect of the deselect any selected list item step 408 above, multiple distinct selections are only possible if the list element 420 is in a multiple distinct selection mode. FIG. 25 is a flow chart illustrating drag and drop functionality in an embodiment of a list element according to an inventive aspect. The figure illustrates how a selection made in a list element 420 may be dragged and dropped to another user interface element. In a detect selection step 410, a selection of one or more list elements 420 is detected. The details of how the selection may be made are disclosed in conjunction with FIG. 24 above. In a detect tap on selection step 411 a tap is detected on the touch sensitive display. The position of this tap corresponds to a list item that is currently selected, as a result of the detect selection step 410 above. In a detect a lift on second element step 412, a lift of the stylus 9 c is detected in a position corresponding to a second user interface element. This corresponds to the behavior called drag and drop, which is well known per se in the art. In a conditional range selection/single selection mode step 413, it is determined if the list element 420 is in a range selection or a single selection mode. If this is affirmative, execution proceeds to a provide selection data to second element step 414. Otherwise, execution of this method ends. In the provide selection data to second element step 414, data corresponding to the list item or list items that are currently selected is provided to the second user interface element. If, for example, the second user interface element is a text area 426, the text data corresponding to the list item/items that are selected, may added to the text field. FIGS. 26A-C illustrate the list element in an embodiment of the in the context of other user interface elements, where the list element 420 is in a single selection mode, multiple distinct selection mode and a range selection mode, respectively. Firstly, FIG. 26A, where the list element 420 is in a single selection mode, will be explained. On the touch sensitive display 3 of the pocket computer 1, a number of user interface elements are shown on a display view 301. The list element 420 has four list items 421 a-d. A text area 426 is also displayed. Firstly, the user presses the stylus 9 c in a position 423, corresponding to a specific list item 421 b, activating a selection of the list element 421 b. Secondly, the user presses the stylus 9 c in a position 424, activating a selection of a second list item 421 d. When the second list item 421 d is selected, the first list item 421 b is deselected. Finally, the user performs a drag and drop operation, by tapping the stylus 9 c in a position corresponding to the second list item 421 d and, while holding the stylus 9 c pressed, moving the stylus 9 c to a position 427 in the text area 426 and lifting the stylus 9 c. As this is a single selection list element 420, drag and drop is possible, and information about the selected list item 421 d in the list element 420 is provided to the text area 426, whereby the text corresponding to the selected list item 421 d may be added to the text area 426. It is to be noted that the text area 426 may be of the same application of the list element 420 or a totally separate application 57. Secondly, FIG. 26B, where the list element 420 is in a multiple distinct selection mode, will be explained. Firstly, the user presses the stylus 9 c in a position 423, corresponding to a specific list item 421 b, activating a selection of the list element 421 b. In this type of list element 420, a selected list item is indicated with a check box 422 next to the list item. Secondly, the user presses the stylus 9 c in a position 424, activating a selection of a second list item 421 d. When the second list item 421 d is selected, the first list item 421 b is still selected. Finally, the user attempts to perform a drag and drop operation, by tapping the stylus 9 c in a position corresponding to the second list item 421 d and, while holding the stylus 9 c pressed, moving the stylus 9 c to a position 427 in the text area 426 and lifting the stylus 9 c. As this is a multiple distinct selection list element 420, drag and drop is not possible, and no information may be provided to the text area 426. Instead, from the second tap in the position 424, the second list item 421 d is deselected. Thirdly, FIG. 26C, where the list element 420 is in a range selection mode, will be explained. The user presses the stylus 9 c in a position 423, corresponding to a specific list item 421 b, activating a selection of the list element 421 b. While still keeping the stylus 9 c pressed, the user then moves the stylus 9 c to a position and lifts the stylus 9 c. This dragging selects list items 421 b to 421 d. The user then performs a drag and drop operation, by tapping the stylus 9 c in a position 424 corresponding to the second list item 421 d and, while holding the stylus 9 c pressed, moving the stylus 9 c to a position 427 in the text area 426 and lifting the stylus 9 c. As this is a range selection list element 420, drag and drop is possible, and information about the selected list item 421 d in the list element 420 is provided to the text area 426, whereby the text corresponding to the selected list items 421 b-d may be added to the text area 426. FIGS. 27A and 27B illustrate how a window hiding method works in an embodiment of an inventive aspect. Beginning with FIG. 27A, on the pocket computer 1, there is the touch sensitive display 3, showing a display view 301. A window 450 is displayed on a layer in front of any other windows currently displayed. The window may be a full window, or a dialog, such as is shown here. The window comprises a head area 451. The user taps the stylus 9 c in a position 452 on the touch sensitive display 3, corresponding to the head area 451 of the window 450. As a result, the window 450 and its contents are hidden, as can be seen in FIG. 27B, thereby exposing any content previously covered by the window 450. Preferably, a box outline 453 is displayed, showing the location of the hidden window. Once the user lifts the stylus 9 c, the window 450 is displayed again, effecting a view 301 as seen in FIG. 27A. FIG. 28A is a diagram illustrating a remote scrolling element 463 in an embodiment of an inventive aspect. The pocket computer comprises the display 3 with a visible area 460. A web browser 461 currently uses all available space of the view 461 available to an application, leaving space for a remote scroll element 463. The web browser has a vertical scrollbar 462 comprising a scroll thumb 464. As the scrollbar 462 is vertical, the remote scroll element 463 is also vertical. If the scrollbar 462 would have been horizontal, the remote scroll element 463 would have been placed along the bottom of the display 460, assuming a predominately horizontal shape. If the user presses the stylus 9 c in a position on the remote scroll element 463, the application responds in the same way as if the user would have pressed on the scrollbar 462 with a same vertical co-ordinate. For example, if the user presses in a position 465 on the remote scroll element 463, which has the same vertical co-ordinate as a up arrow 466 of the scrollbar 462, it has the same effect as if the user would have pressed on the up arrow 466 immediately, i.e. scrolling the screen upwards. All actions that can be performed on the scrollbar 463 itself, such as scrolling up and down using the arrow buttons, scrolling by dragging the scroll thumb 464, or pressing in the area below or above the scroll thumb to scroll a page at a time, can in this way be performed by a corresponding press on the remote scroll element 463. FIG. 28B is a diagram illustrating a disjunctive remote scrolling element 463 in an embodiment of an inventive aspect. The pocket computer 1 comprises the display 3 with a visible area 460. The web browser 461, comprising a scrollbar 462, is not occupying all available space of the view 461, and is only partly covering another application 468. The remote scroll element 463 is here located along the right side of the screen, not in direct contact with the web browser 461. Still, if the user presses the stylus 9 c in a position on the remote scroll element 463, the application responds in the same way as if the user would have pressed on the scrollbar 462 with a same vertical co-ordinate. The remote scroll element 463 is located along the right side of the view 460 for convenience, and may be used for the currently active application, regardless of the position of the application on the view 460. In one embodiment, the location of the remote scroll element 463 is visually indicated by e.g. including a bitmap image in the remote scroll element 463. In another embodiment, the remote scroll element 463 is partly or fully transparent, wherein the area on the display that underlies the remote scroll element 463 may be used for presentation of information such as non-selectable indicators (for instance a battery charge indicator or other status indicator). FIG. 28A may also be used to explain another inventive aspect related to the scrollbar, wherein the scrollbar further comprises an upper part of a trough 467 a and a lower part of the trough 467 b. When the user presses the stylus 9 c in the trough, for example in the lower part of the trough 467 b, the content starts scrolling. The content continues to scroll, until either the end of the content is reached or the user lifts the stylus 9 c. Thus, the content may continue to a position past the position where the user tapped the stylus. This makes the exact position of the stylus less important when scrolling, thereby significantly simplifying the scrolling procedure when the user is in a moving environment, such as a bus or train or while the user is walking. The scrolling is made up of scrolling steps, where each step scrolls one page of content. Preferably there is a pause after the first step of scrolling, allowing the user to stop the scrolling after the first page of scrolling. The inventive aspects have mainly been described above with reference to a number of embodiments. However, as is readily appreciated by a person skilled in the art, other embodiments than the ones disclosed above are equally possible within the scope of the inventive aspects, as defined by the appended patent claims. Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS20020186257 *Jun 8, 2001Dec 12, 2002Cadiz Jonathan J.System and process for providing dynamic communication access and information awareness in an interactive peripheral displayUS20030193524 *May 8, 2003Oct 16, 2003International Business Machines CorporationWindow scroll barUS20040061716 *Sep 30, 2002Apr 1, 2004Cheung Dennis T.Centralized alert and notifications repository, manager, and viewer* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS7461349 *Feb 28, 2006Dec 2, 2008Adobe Systems IncorporatedMethods and apparatus for applying functions to contentUS7472168 *Oct 10, 2003Dec 30, 2008Mobui Inc.Method for dynamically assigning and displaying character shortcuts on a computing device displayUS7705861 *Jan 19, 2006Apr 27, 2010Microsoft CorporationSnap to element analytical toolUS7925986Sep 27, 2007Apr 12, 2011Veveo, Inc.Methods and systems for a linear character selection display interface for ambiguous text inputUS7973807Mar 1, 2010Jul 5, 2011Microsoft CorporationSnap to element analytical toolUS8074178 *Jun 12, 2007Dec 6, 2011Microsoft CorporationVisual feedback displayUS8572489 *Dec 16, 2010Oct 29, 2013Harman International Industries, IncorporatedHandlebar audio controlsUS8650508 *Sep 17, 2010Feb 11, 2014Lg Electronics Inc.Mobile terminal and operating method thereofUS8689138 *Dec 29, 2006Apr 1, 2014Blackberry LimitedMethod and arrangment for a primary actions menu for applications with sequentially linked pages on a handheld electronic deviceUS8698845May 27, 2010Apr 15, 2014Apple Inc.Device, method, and graphical user interface with interactive popup viewsUS8756534 *Sep 24, 2009Jun 17, 2014Apple Inc.Methods and graphical user interfaces for editing on a multifunction device with a touch screen displayUS20090018690 *Jan 30, 2007Jan 15, 2009Abb FranceMethod of controlling a robotic work station and a corresponding robotic work stationUS20090135147 *May 30, 2008May 28, 2009Wistron CorporationInput method and content displaying method for an electronic device, and applications thereofUS20100146456 *Jan 8, 2008Jun 10, 2010Hideaki TanakaPortable communication terminal, browsing method, and browsing programUS20100235783 *Sep 24, 2009Sep 16, 2010Bas OrdingMethods and Graphical User Interfaces for Editing on a Multifunction Device with a Touch Screen DisplayUS20100281409 *Apr 30, 2009Nov 4, 2010Nokia CorporationApparatus and method for handling notifications within a communications deviceUS20110072345 *Sep 17, 2010Mar 24, 2011Lg Electronics Inc.Mobile terminal and operating method thereofUS20110157053 *Dec 23, 2010Jun 30, 2011Sony Computer Entertainment Europe LimitedDevice and method of controlUS20120089928 *Oct 12, 2010Apr 12, 2012International Business Machines CorporationIndependent viewing of web conference content by participantsUS20120098850 *Aug 31, 2011Apr 26, 2012Tomoya NaritaInformation processing apparatus, information processing method and programUS20120159328 *Dec 16, 2010Jun 21, 2012Harman International Industries, IncorporatedHandlebar audio controlsUS20120159380 *Mar 31, 2011Jun 21, 2012Kocienda Kenneth LDevice, Method, and Graphical User Interface for Navigation of Concurrently Open Software ApplicationsUS20130055164 *Aug 24, 2011Feb 28, 2013Sony Ericsson Mobile Communications AbSystem and Method for Selecting Objects on a Touch-Sensitive Display of a Mobile Communications DeviceWO2008147813A1 *May 21, 2008Dec 4, 2008Murali AravamudanSystem and method for search with reduced physical interaction requirements* Cited by examinerClassifications U.S. Classification715/704, 715/864, 715/779, 715/771International ClassificationG06F9/00Cooperative ClassificationG06F3/0485, G06F17/30905European ClassificationG06F3/0485, G06F17/30W9VLegal EventsDateCodeEventDescriptionDec 15, 2005ASAssignmentOwner name: NOKIA CORPORATION, FINLANDFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:PAASONEN, JUHO;MELAANVUO, HENRI;RAINISTO, ROOPE;AND OTHERS;REEL/FRAME:017355/0062;SIGNING DATES FROM 20051130 TO 20051207RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services©2012 Google