Source: http://patents.com/us-9785329.html
Timestamp: 2017-10-23 17:27:41
Document Index: 53505408

Matched Legal Cases: ['Application No. 200780024811', 'Application No. 2008', 'Application No. 2007143132', 'Application No. 201003586', 'Application No. 06755899', 'Application No. 06755899', 'art 62', 'arts 510', 'art 510', 'art 520', 'art 530']

US Patent # 9,785,329. Pocket computer and associated methods - Patents.com
United States Patent 9,785,329
Paasonen , et al. October 10, 2017
Paasonen; Juho (Espoo, FI), Melaanvuo; Henri (Karjaa, FI), Rainisto; Roope (Helsinki, FI), Tolppanen; Petri (Kauniainen, FI), Pirskanen; Hannu (Oulu, FI), Saarinen; Kalle (Tampere, FI), Vaisanen; Matti (Helsinki, FI), Roto; Virpi (Espoo, FI), Johansson; Panu (Tampere, FI), Tamminen; Eero (Vantaa, FI), Sade; Simo (Helsinki, FI), Kekki; Jussi-Pekka (Tampere, FI)
Paasonen; Juho
Melaanvuo; Henri
Rainisto; Roope
Tolppanen; Petri
Pirskanen; Hannu
Saarinen; Kalle
Vaisanen; Matti
Roto; Virpi
Johansson; Panu
Tamminen; Eero
Sade; Simo
Kekki; Jussi-Pekka
Family ID: 1000002879252
11/135,624
US 20060265653 A1 Nov 23, 2006
Current CPC Class: G06F 3/0485 (20130101); G06F 17/30905 (20130101); G06F 9/00 (20130101)
Current International Class: G06F 3/14 (20060101); G06F 17/30 (20060101); G06F 9/00 (20060101); G06F 3/0485 (20130101); G06F 3/0362 (20130101)
Field of Search: ;715/716,843,864,838 ;725/37 ;710/30 ;348/552
5801771 September 1998 Ohwaki et al.
5995084 November 1999 Chan et al.
5999176 December 1999 Kamper
6008817 December 1999 Gilmore, Jr.
6173297 January 2001 Moon et al.
6278465 August 2001 Nielsen
6570583 May 2003 Kung et al.
6640185 October 2003 Yokota et al.
6862712 March 2005 Nakagawa et al.
7006074 February 2006 Chesters
7009599 March 2006 Pihlaja
7171353 January 2007 Trower et al.
7194404 March 2007 Babst et al.
7228268 June 2007 Xun
7327349 February 2008 Robbins et al.
8015259 September 2011 Swahn
2002/0052900 May 2002 Freeman
2002/0156864 October 2002 Kniest
2003/0043114 March 2003 Silfverberg et al.
2003/0045331 March 2003 Montebovi
2003/0098891 May 2003 Molander
2003/0193524 October 2003 Bates et al.
2004/0046732 March 2004 Chesters
2004/0178997 September 2004 Gillespie et al.
2005/0044506 February 2005 Makela
2005/0223308 October 2005 Gunn et al.
2006/0095842 May 2006 Lehto
2006/0112346 May 2006 Miksovsky et al.
2006/0267967 November 2006 Hinckley et al.
0 632 637 Jan 1995 EP
0 671 682 Mar 1995 EP
1 517 228 Mar 2005 EP
1 574 971 Sep 2005 EP
10-340178 Dec 1998 JP
2000163444 Jun 2000 JP
2002-323850 Nov 2002 JP
2003-282922 Oct 2003 JP
2004-206300 Jul 2004 JP
2004-265142 Sep 2004 JP
2019980009337 Apr 1998 KR
2005-0027892 Mar 2005 KR
02/08881 Jan 2002 WO
WO 02/08881 Jan 2002 WO
"Glimpse: A Novel Input Model for Multi-Level Devices", Clifton Forlines, et al., Mitsubishi Electric Research Laboratories, Dec. 2005, pp. 1-5. cited by applicant .
"Roll Up Window with Your Middle Mouse Button and Wheel Button Click", www.shelltoys.com/mouse.sub.--software/rollup.sub.--window.html, Jun. 15, 2005, p. 1. cited by applicant .
"Matchbox X11", Open Source, http://freshmeat.net/projects/matchbox/, Jun. 15, 2005, pp. 1-2. cited by applicant .
Acrobat Reader.RTM. 7.0, Adobe Systems Inc., Public product. cited by applicant .
OS X, Apple Computer Inc., Public product. cited by applicant .
Windows, Microsoft Corporation, Public product. cited by applicant .
Series 90, Nokia, Public product. cited by applicant .
7710 Communicator, Nokia, Public product. cited by applicant .
Symbian OS, Symbian Ltd., Public product. cited by applicant .
Palm OS, PalmSource Inc., Public product. cited by applicant .
Photoshop, Adobe Systems Inc., Public product. cited by applicant .
Imageready, Adobe System Inc., Public product. cited by applicant .
Picsel web browser, Picsel Technologies Ltd., Public product. cited by applicant .
Opera Browser, Opera Software AFA, Public product. cited by applicant .
Windows mobile, Microsoft Corporation, Public product. cited by applicant .
Embedded Linux, Embedded Linux Consortium, Public product. cited by applicant .
Internet explorer, Microsoft Corporation, Public product. cited by applicant .
Netscape browser, Netscape Communications Corp., Public product. cited by applicant .
Firebird/Firefox, Mozilla, Public Product. cited by applicant .
Pocket PC OS, Microsoft Corporation, Public Product. cited by applicant .
Series 60, Nokia, Public Product. cited by applicant .
Palm Inc., "Handbook for the Palm Zire 71 Handheld." 2003 <http://www.palm.com/us/support/handbooks/zire71/zire71.sub.--hb.sub.-- -ENG.pdf>. cited by applicant .
Palm Inc., "using your Treo." 2007 <http://www.palm.com/us/support/handbooks/treo/treo600gsm.sub.--UG.pdf- >. cited by applicant .
Textware Solutions, "Fitaly Virtual Options and Advanced Features." Mar. 13, 2004 <http://webarchive.org/web/20040313051005/http://fitaly.com/f- italyvirtual3/fitalysetup.htm#mru>. cited by applicant .
Apple Computer Inc. "Dashboard--Handy widgets at your command." May 7, 2005 <http://webarchive.org/web/2005050720223/http://www.apple.com/mac- osx/features/dashboard/>. cited by applicant .
Nintendo. "Nintendo DS Technical Specs." Nov. 12, 2004 <http:web.archive.org/web/20041112133534/http://www.nintendo.com/techs- pecds>. cited by applicant .
Amazon.com: Palm Zire 71 Handheld: Electronics. <http://www.amazon.com/PALM-P80720US-PalmOne-Zire-Handheld/dp/B00008WF- VI> 2007. cited by applicant .
Red Hat. "Red Hat Linux 6.1: The Official Red Hat Linux Getting Started Guide, Chapter 11. The Enlightenment Window Manager." Oct. 18, 2003. <http://web.archive.org/web/20031018155954/http://www.redhat.com/docs/- manuals/linux/RHL-6.1-Manual/getting-started-guide/ecapplet.html>. cited by applicant .
Apple Computer Inc. "Apple Unleashes "Tiger" Friday at 6:00 p.m." Apr. 28, 2005 <www. apple.com/pr/library/2005/apr/28tiger.html>. cited by applicant .
International Search Report, PCT/IB2006/001330, mailed Jul. 9, 2007. cited by applicant .
Korean Office Action dated Sep. 16, 2010. cited by applicant .
Japanese Office Action dated Nov. 16, 2010. cited by applicant .
Kazumi Takei, Manual on How to Make Thorough Use of Visor Deluxe, First Edition, Media Tech Publishing, Inc., Kazuo Sato, Oct. 18, 2000, vol. 1, pp. 30-31, 44, ISBN: 4-89627-090-8. cited by applicant .
English Translation of Korean Office Action dated May 31, 2011. cited by applicant .
freshmeat.net: Project details for Matchbox Window Manager [online] [retrieved Jan. 2, 2013]. Retrieved from the Internet: <URL: http://web.archive.org/web/20040504183514/http://freshmeat.net/projects/m- atchbox/>. 2 pages. cited by applicant .
International Search Report and Written Opinion for Application No. PCT/IB2007/001304 dated Jun. 26, 2008. cited by applicant .
Office Action for U.S. Appl. No. 11/249,156 dated May 24, 2012. cited by applicant .
Office Action for U.S. Appl. No. 11/249,156 dated Jun. 21, 2011. cited by applicant .
Office Action for Chinese Application No. 200780024811.3 dated Nov. 3, 2011. cited by applicant .
Office Action for Japanese Application No. 2008-512937 dated Aug. 16, 2011. cited by applicant .
Office Action for Russian Application No. 2007143132/09 dated Jan. 22, 2010. cited by applicant .
Office Action for Singapore Application No. 201003586-3 dated Mar. 8, 2011. cited by applicant .
Definition of "Orthogonal". Google Search [online]. Google, 2010 [retrieved on Jan. 16, 2010]. Retrieved from the Internet: <URL:http://www.google.com/search?hl=en&rls=GGLD,GGLD:2004-30,GGLD:en&- ei=Du5RS7.sub.--AGtK2IAeh4pWtCg&sa=X&oi=spell&resnum=0&ct=result&cd=1&ved=- 0CBQQBSgA&q=define%3A+orthogonal&spell=1>. cited by applicant .
International Preliminary Report on Patentability (Chapter II) for Application No. PCT/IB2007/001304 dated Feb. 6, 2009. cited by applicant .
International Preliminary Report on Patentability and Written Opinion for Application No. PCT/IB2006/001330 dated Nov. 23, 2007. cited by applicant .
Office Action--Advisory Action for U.S. Appl. No. 11/249,156 dated Mar. 29, 2013. cited by applicant .
Office Action--Advisory Action for U.S. Appl. No. 11/249,156 dated May 21, 2010. cited by applicant .
Office Action--Advisory Action from U.S. Appl. No. 11/158,921 dated Apr. 2, 2010. cited by applicant .
Office Action--Advisory Action from U.S. Appl. No. 11/158,921 dated Feb. 18, 2009. cited by applicant .
Office Action--Advisory Action from U.S. Appl. No. 11/438,900 dated Jan. 6, 2010. cited by applicant .
Office Action--Final Rejection for U.S. Appl. No. 11/249,156 dated Apr. 13, 2009. cited by applicant .
Office Action--Final Rejection for U.S. Appl. No. 11/249,156 dated Dec. 8, 2010. cited by applicant .
Office Action--Final Rejection for U.S. Appl. No. 11/249,156 dated Jan. 16, 2013. cited by applicant .
Office Action--Final Rejection for U.S. Appl. No. 11/249,156 dated Jul. 2, 2014. cited by applicant .
Office Action--Final Rejection for U.S. Appl. No. 11/249,156 dated Mar. 4, 2010. cited by applicant .
Office Action--Final Rejection for U.S. Appl. No. 11/249,156 dated Oct. 28, 2008. cited by applicant .
Office Action--Notice of Allowance from U.S. Appl. No. 11/249,156 dated Jun. 1, 2016. cited by applicant .
Office Action--Notice of Allowance from U.S. Appl. No. 11/249,156 dated Nov. 9, 2015. cited by applicant .
Office Action--Pre-Brief Appeal Conference Decision from U.S. Appl. No. 11/249,156 dated Oct. 25, 2013. cited by applicant .
Office Action--Pre-Brief Appeal Conference Decision from U.S. Appl. No. 11/249,156 dated Oct. 30, 2014. cited by applicant .
Office Action for U.S. Appl. No. 11/249,156 dated Dec. 19, 2013. cited by applicant .
Office Action for U.S. Appl. No. 11/249,156 dated Feb. 21, 2008. cited by applicant .
Office Action for U.S. Appl. No. 11/249,156 dated Jun. 17, 2013. cited by applicant .
Office Action for U.S. Appl. No. 11/249,156 dated Jun. 22, 2010. cited by applicant .
Office Action for U.S. Appl. No. 11/249,156 dated Sep. 2, 2009. cited by applicant .
Office Action for U.S. Appl. No. 11/439,530 dated Jul. 21, 2009. cited by applicant .
Office Action from corresponding European Patent Application No. 06755899.9 dated Mar. 18, 2009. cited by applicant .
Office Action from corresponding European Patent Application No. 06755899.9 dated May 12, 2015. cited by applicant .
Office Action from U.S. Appl. No. 11/158,921 dated Apr. 2, 2008. cited by applicant .
Office Action from U.S. Appl. No. 11/158,921 dated Jan. 21, 2010. cited by applicant .
Office Action from U.S. Appl. No. 11/158,921 dated May 12, 2009. cited by applicant .
Office Action from U.S. Appl. No. 11/158,921 dated Sep. 30, 2010. cited by applicant .
Office Action from U.S. Appl. No. 11/438,900 dated Apr. 28, 2009. cited by applicant .
Office Action from U.S. Appl. No. 11/438,900 dated Oct. 28, 2009. cited by applicant .
Office Action from U.S. Appl. No. 11/439,530 dated Jan. 5, 2010. cited by applicant .
Office Action from U.S. Appl. No. 11/439,530 dated Jan. 6, 2011. cited by applicant .
Office Action from U.S. Appl. No. 11/439,530 dated Jul. 20, 2010. cited by applicant .
Sigmarion III instruction manual, Nippon Electric Company Limited, Apr. 2003, pp. 36-37. cited by applicant.
1. A method for scrolling content in a window displayed on a touch sensitive display of a pocket computer, comprising: enabling displaying of a scrollbar comprising a scroll thumb movable in a trough, enabling detecting of a stationary tap of a pointing tool in a stationary tapping position in said trough, enabling scrolling of said content during a period when said pointing tool is detected to be pressed down in the stationary tapping position, such that during said scrolling: the position of said scroll thumb is updated in said trough accordingly by moving said scroll thumb in said trough; and scrolling is allowed to continue, during the detected stationary tap, such that said position of said scroll thumb moves past said stationary tapping position in said trough, enabling detecting of a lift of said pointing tool, and once lift of said pointing tool is detected, enabling stopping said scrolling of content.
6. An apparatus comprising; a controller; and a memory comprising one or more software code portions; the controller, with the memory and software code portions, being configured to: enable displaying of a scrollbar comprising a scroll thumb movable in a trough, enable detecting of a stationary tap of a pointing tool in a stationary tapping position in said trough, enable scrolling of said content during a period when said pointing tool is detected to be pressed down in the tapping position, such that during said scrolling: the position of said scroll thumb is updated in said trough accordingly by moving said scroll thumb in said trough; and scrolling is allowed to continue, during the detected stationary tap, such that said position of said scroll thumb moves past said stationary tapping position in said trough, enable detecting of a lift of said pointing tool, and once lift of said pointing tool is detected, enable stopping of said scrolling of content.
7. A computer program product comprising software code portions stored on a non-transitory medium, the software code portions being configured to, when loaded onto a computer: enable displaying of a scrollbar comprising a scroll thumb movable in a trough, enable detecting of a stationary tap of a pointing tool in a stationary tapping position in said trough, enable scrolling of said content during a period when said pointing tool is detected to be pressed down in the tapping position, such that during said scrolling: the position of said scroll thumb is updated in said trough accordingly by moving said scroll thumb in said trough; and scrolling is allowed to continue, during the detected stationary tap, such that said position of said scroll thumb moves past said stationary tapping position in said trough, enable detecting of a lift of said pointing tool, and once lift of said pointing tool is detected, enable stopping of said scrolling of content.
A more intuitive way to navigate through large content is to use what is called panning, a method which for example is used in Adobe Acrobat Reader.RTM. 7.0. This works in a similar way to when a user moves a paper with his/her hand on a desk in front of him/her. The user simply `drags` the content by depressing a mouse button and moving the mouse while the mouse button is still depressed, and releasing the mouse button when the content is in the desired position.
A manner known in the art to perform data selection is to `drag` over the text to be selected by depressing a mouse button, moving the mouse while pressing the mouse button over the text to be selected, and releasing the mouse button once the desired text is selected.
A conventional solution to this problem is to have different modes--one pan mode and one text selection mode. This is a solution available in Adobe Acrobat Reader.RTM. 7.0. Here, in an application area on the display, there are buttons available, allowing the user to switch between the different modes. However, this method is cumbersome and inconvenient, forcing the user to know or recognize which mode is currently active each time the user wishes to perform either a text selection operation or a panning operation.
In handheld devices usable with stylus, the conventional interaction required for scrolling content, i.e. press stylus down on the scroll bar and drag horizontally or vertically, is very tiring for the hand, as the scroll bars may be positioned anywhere on the display, providing no physical support to alleviate scrolling. Moreover, in a handheld device, because of limited display space, the scroll bars are typically quite small (thin) and may therefore be difficult to hit with a stylus--particularly if the handheld device is used in a moving environment.
Throughout this document, a "writing tool" is an object used for providing input on a touch-sensitive display, not only in the form of writing (e.g. characters and text) but also in the form of control actions such as pointing, tapping ("clicking"), pressing and dragging. Thus, a "writing tool" may be a stylus, pen, a user's finger or any other physical object suitable for interaction with the touch-sensitive display.
As used herein, a "pocket computer" is a small portable device with limited resources in terms of e.g. display size, data processing power and input means. In one embodiment, the pocket computer is a mobile terminal accessory particularly designed for electronic browsing and messaging.
The pocket computer 1 of the illustrated embodiment comprises an apparatus housing 2 and a large touch-sensitive display 3 provided at the surface of a front side 2.sub.f of the apparatus housing 2. Next to the display 3 a plurality of hardware keys 5a-d are provided, as well as a speaker 6.
More particularly, key 5a is a five-way navigation key, i.e. a key which is depressible at four different peripheral positions to command navigation in respective orthogonal directions ("up", "down", "left", "right") among information shown on the display 3, as well as depressible at a center position to command selection among information shown on the display 3. Key 5b is a cancel key, key 5c is a menu or options key, and key 5d is a home key.
In addition, a second plurality of hardware keys 4a-cis provided at the surface of a first short side 2.sub.u of the apparatus housing 2. Key 4a is a power on/off key, key 4b is an increase/decrease key, and key 4c is for toggling between full-screen and normal presentation on the display 3.
At the surface of a second short side 2.sub.1 of the apparatus housing 2, opposite to said first short side 2.sub.u, there are provided an earphone audio terminal 7a, a mains power terminal 7b and a wire-based data interface 7c in the form of a serial USB port.
Being touch-sensitive, the display 3 will act both as a visual output device 52 and as an input device 53, both of which are included in a user interface 51 to a user 9 (see FIG. 5). More specifically, as seen in FIG. 1, the user 9 may operate the pocket computer 1 by pointing/tapping/dragging with a stylus 9c, held in one hand 9a, on the surface of the touch-sensitive display 3 and/or by actuating any of the hardware keys 4a-c, 5a-d (which also are included as input devices in the user interface 51) with the thumb and index finger of the other hand 9b.
Text input to the pocket computer 1 may be performed in different ways. One way is to use a virtual keyboard presented on the display. By tapping with the stylus 9c on individual buttons or keys of the virtual keyboard, the user 9 may input successive characters which aggregate to a text input shown in a text input field on the display. Another way to input text is by performing handwriting on the touch-sensitive using the stylus 9c and involving handwriting recognition. Word prediction/completion functionality may be provided.
A second digital network 26 is shown in FIG. 4 in the form of a mobile telecommunications network, compliant with any available mobile telecommunications standard such as GSM, UMTS, D-AMPS or CDMA2000. In the illustrated exemplifying embodiment, the user 9 may access network resources 28 on the mobile telecommunications network 26 through the pocket computer 1 by establishing a wireless link lob to a mobile terminal 20, which in turn has operative access to the mobile telecommunications network 26 over a wireless link 22 to a base station 24, as is well known per se. The wireless links 10a, 10b may for instance be in compliance with Bluetooth.TM., WLAN (Wireless Local Area Network, e.g. as specified in IEEE 802.11), HomeRF or HIPERLAN. Thus, the interface(s) 55 will contain all the necessary hardware and software required for establishing such links, as is readily realized by a man skilled in the art.
FIG. 6 shows a front view of the pocket computer and indicates a typical display screen layout of its user interface. A typical disposition of the display screen layout, presenting a view of a home application (i.e., a start or base view that the user may return to whenever he likes), is shown in more detail in FIG. 7. In FIG. 6, the hardware keys 5a-d are shown at their actual location to the left of the display 3 on the front side surface 2.sub.f of the apparatus housing 2, whereas, for clarity reasons, the hardware keys 4a-c are illustrated as being located above the display 3 on the front side surface 2.sub.f even while they actually are located at aforesaid first short side surface 2.sub.u(FIG. 2).
The application area 80 is used by a currently active application to present whatever information (content) is relevant and also to provide user interface controls such as click buttons, scrollable list, check boxes, radio buttons, hyper links, etc, which allow the user to interact with the currently active application by way of the stylus 9c. One example of how a currently active application, in the form of a web browser, uses the application area 80 in this manner is shown in FIG. 9. A name or other brief description of the currently active application (e.g. the web browser) and a current file or data item (e.g. the current web page) is given at 72 in the title area 70 (e.g. "Web--Nokia"). In addition, as seen in FIG. 10, by tapping in the title area 70, the user may access an application menu 73 of the currently active application.
The task navigator 60, title area 70 and status indicator area 74 always remain on screen at their respective locations, unless full screen mode is commanded by depressing the hardware key 4c. In such a case, the currently active application will use all of the display 3 in an expansion of the application area 80, and the areas 60, 70 and 74 will thus be hidden.
The task navigator 60 has an upper portion 62 and a lower portion 66. The upper portion 62 contains icons 63-65 which when selected will open a task-oriented, context-specific menu 90 to the right of the selected icon (see FIG. 8, FIG. 11). The context-specific menu 90 will contain a plurality of task-oriented menu items 91, and the user may navigate among these menu items and select a desired one either by the navigation key 5a or by pointing at the display 3. The menu 90 may be hierarchical. The lower portion 66 represents an application switcher panel with respective icons 67 for each of a plurality of launched applications.
The user 9 may conveniently use the application switcher panel 66 for switching to a desired application by tapping with the stylus 9c on the corresponding icon 67. A help text, preferably containing the application's title and a current file name, etc, if applicable, may conveniently be presented on the display 3 next to the icon pointed at, so as to guide the user further. When the user lifts the stylus 9c, the application corresponding to the icon pointed at will be switched to.
Often, the one most recently active application, represented by the topmost icon, will be the one that has current control over the application area 80. This is seen for instance in FIG. 11 (the topmost icon being labeled 67a and containing a browser symbol that represents the currently active web browser application). In such a case, the topmost icon 67a is shown with a "depressed" appearance, again as seen in FIG. 11. However, when the home application is the currently active one, as seen in FIG. 6, none of the icons 67 represents the currently active home application, and therefore no icon is shown depressed.
As appears from the above, the vertical order of the application switcher icons from top to bottom represents a historical order in which the four most recently used applications have been active. When a switch is done from a currently active application to another one, the order of the icons will be updated accordingly. This is shown in FIGS. 11 and 12. In FIG. 11, the web browser application is active and is thus represented by the topmost icon 67a. The second icon 67b represents an audio player application that was active before the web browser application was launched, whereas the third and fourth icons 67c and 67d represent a file manager application and an image viewer application, respectively, that were active before that.
Now, when the user 9 invokes the messaging application by selecting the menu item 93 in the afore-described task-oriented menu 90, the messaging application becomes active and its icon takes the topmost position 67a, as seen in FIG. 12. At the same time, the existing icons 67a-c of FIG. 11 are shifted one vertical position downwards, so that the web browser icon (formerly at 67a) takes the second position at 67b, the audio player icon moves to the third position 67c, and the file manager icon goes to the lowermost position 67d. The formerly shown image viewer icon disappears from the application switcher panel 66, but the image viewer application is still running.
By tapping an application switcher menu button (or "more" button) 68, an application switcher menu will be presented in a popup window on the display 3. This application switcher menu will contain menu items for all running applications, including the four most recent ones which are also represented by icons 67a-d in the application switcher panel 66, as well as those less recent applications the icons of which have been moved out from the application switcher panel 66 (such as the image viewer icon in the example described above). By selecting any desired menu item in the application switcher menu, the user 9 will cause a switch to the corresponding application. The application switcher menu may also include a menu item for the home application, as well as certain handy application control commands, such as "Close all applications".
If the user closes the active application, the topmost icon 67a will be removed from the application switcher panel 66, and the rest of the icons 67b-d will be shifted one position upwards in the panel. The application for the icon that now has become the topmost one will be switched to.
Certain inventive aspects relate to drag and drop functionality, as will be described in more detail in later sections of this document. It is to be noticed already here that the application switcher panel 66 is particularly well suited for use together with drag and drop functionality. Thus, using the stylus 9c, the user 9 may make a selection of content presented in the application area 80 for a first application, which is currently active, and drag the selected content to a desired one of the icons 67 in the application switcher panel 66. This will cause activation of an associated second application which will take control over the application area 80 and replace the first application as the currently active one. Then, the user may proceed and drag the stylus to a desired input field of this second application in the application area 80, and finally lift the stylus 9c, wherein the selected content from the first application will be pasted into the second application.
The home application 72 of FIG. 7 will now be described in more detail. Typically, the home application will be activated at start-up of the pocket computer 1. During ongoing use of the pocket computer 1, irrespective of whatever other application that is currently active, the user 9 may always return to the home application by pressing the home key 5d on the front surface 2f of the apparatus housing 2. Another way of invoking the home application is through the application switcher menu button 68, as has been described above.
As seen in FIG. 7, in this embodiment the home application contains three application views 82, 83 and 84 on the display 3. Each application view is a downscaled version of the application view of another application 57. Thus, among all the functionality nominally provided by such another application 57, the application view in the home application will only provide access to limited parts thereof. For instance, application view 82 in FIG. 7 represents a news application (e.g. Usenet news) and provides a limited view of this application by displaying the number of unread posts together with a few of the latest posts. Tapping on any of these latest posts will cause presentation of the contents of the post in question. If the user wants to access the complete functionality of the news application, he may switch to this application through e.g. the application switcher menu button 68 (as described above), or the "Others" icon 65 in the upper part 62 of the task navigator 60. In another embodiment, tapping on a post in the application view 82 may directly cause launching (if not already running) of or switching to the news application.
The application view 83 represents an Internet radio application and gives a limited view of its functionality. By tapping on a "Manage" button therein, the user may invoke the actual Internet radio application to access its entire functionality. The application view 84 represents a Clock application.
The bookmark manager 72 previously mentioned will now be described in more detail. As seen in FIGS. 13 and 14, the bookmark manager divides the application area into three parts 510, 520 and 530. Part 510 is a storage hierarchy view, showing a current structure of folders 512 for bookmarks in the pocket computer 1. The user 9 may select any of these folders by tapping on it with the stylus 9c, wherein the contents of this folder will open up into the second part 520, which lists all bookmarks 522 in the present folder 512. The user 9 may also create or delete such folders by tapping on a respective icon 532b, 532e in the third part 530.
By tapping on a desired bookmark 522 the web browser application will be invoked, and the web page defined by the bookmark in question will be visited. Moreover, by tapping in a check box 524 provided to the right of each bookmark 522, the user may select one or more of the bookmarks 522. For such selected bookmark(s), further operations may be commanded by tapping on for instance an edit bookmark icon 532a, a delete bookmark icon 532e or a move bookmark icon 532c. If the move bookmark icon 532c is tapped on, a Move to folder dialog 540 will be shown, as is seen in FIG. 14.
Thus, the bookmark manager provides many ways for the user 9c to manage his selection of bookmarks in a convenient manner.
Whenever the terms press and lift are used in this document, it is to be understood that this may be implemented using the stylus 9c on the touch sensitive display 3, a mouse, a trackball or any other suitable pointer input technology.
As shown in FIG. 15A, to pan content, the user presses the stylus 9c in a first position 303 and, while holding the stylus 9c pressed, moves the stylus 9c to a second position 304, where the stylus 9c is lifted. This effects a movement of the content according to the movement of the stylus 9c. So in this example, as the stylus is moved to the left, the underlying available content is moved to the left, creating a resulting view 301 as can be seen in FIG. 15B. In other words, panning may be performed with a tap and drag.
To select part of the data displayed, the user double-taps in a first position 305 and, while holding the stylus 9c pressed after the second tap, moves the stylus 9c to a second position 306, where the stylus 9c is lifted. In other words, the user depresses the stylus 9c, lifts the stylus 9c, depresses the stylus 9c a second time, moves the stylus 9c and finally lifts the stylus 9c.
The above described method to select data is different from conventional methods to select data. The most common method to select data is to press the stylus 9c down, move the stylus 9c and lift the stylus 9c. However, as explained in conjunction with FIGS. 15A and 15B above, this method is used to pan through content.
FIG. 17A displays an initial state where the display view 301 displays content being a subset of the available content 302. The user presses a zoom in button 4b, after which the display is updated to zoom in on the available content as is shown in FIG. 17B. Due to the enlargement of displayed data items, such as text, once zoomed in, the display displays less content than before.
Analogously, if the initial state is as shown in FIG. 16B and the user presses a zoom out button 4b, the display is updated to zoom out on the available content such as is shown in FIG. 17A. Consequently, more data items, such as text, will be displayed once the display is zoomed out.
In a detect first tap step 331, the pocket computer 1 detects a tap by the stylus 9c on the touch sensitive display of the pocket computer 1.
In a conditional commence data selection step 332, it is determined whether data selection should be commenced. If a second tap of the stylus 9c is detected, which in conjunction with the tap in the detect first tap step 331 makes up a double tap, it is determined that data selection is to be commenced. However, the time difference between the first and the second tap must be less than a predetermined time. This predetermined time is preferably configurable by the user. Additionally, the second tap position must be in a position less than a threshold distance from said first position. This threshold relative distance, rather than requiring identical positions, is preferably used as it is rather likely that the second tap of an intended double tap by the user is in fact not in the exact same position as the first tap.
If it is determined to commence selection of data in the previous step, execution of the method proceeds to a select data items corresponding to movement step 333. Here any movement after the second tap, while the stylus 9c is still pressed, is detected, giving a current position of the stylus 9c. It can then be determined that all data items between the first tap position and the current position of the stylus 9c are selected by the user. This information is updated in the memory 54 in the pocket computer 1 for further processing and is also displayed on the display 3. Once the user lifts the stylus 9c from the display, the selection has been made and this method ends.
However, in this embodiment, if in the commence data selection step 332 it is determined that data selection is not to be commenced, execution proceeds to a conditional commence panning step 334. In the commence panning step 334, it is determined whether panning is to be commenced. If it is detected that the stylus 9c used in the detect first tap step 331 is still being pressed and has moved in position from a first position detected in the detect first tap step 331, it is determined that panning is to be commenced. The movement relative to the first position may need to be more than a threshold distance to avoid unintentional panning.
If in the commence panning step 334 it is determined that panning is to be commenced, execution of the method proceeds to a pan content corresponding to movement step 335. While the stylus 9c is still pressed, in this step the content in the display is moved according to the movement of the stylus 9c. For example, if the stylus 9c is moved to the left, the underlying available content is moved to the left, such as can be seen in FIG. 15A and 15B, where FIG. 15A shows a display view 301 before the move of the stylus 9c to the left and FIG. 15B shows a display view 301 after the stylus 9c is moved to the left. This is the classical way to perform panning. However, as it may be preferred that the display, rather than the content, is moved in the same direction as the stylus 9c movement, in an alternative embodiment, the display view may move to the left if the stylus 9c is moved to the left. This alternative type of behavior is more often referred to scrolling, rather than panning. Once it is detected that the user has lifted the stylus 9c, panning ends and the execution of this method ends.
From the ready state 350, if the user performs a tap action 371 with the stylus 9c in a first position, the computer transitions to a first tap state 351.
From the first tap state 351, if the user performs a lift action 372 with the stylus 9c, the computer transitions to a first lift state 352. On the other hand, from the first tap state 351, if the user with the stylus 9c still pressed performs a move action 380 with the stylus 9c, the computer transitions to a panning state 355.
From the first lift state 352, if the user performs a tap new position action 379 with the stylus 9c, the computer returns to a first tap state 351. The new position may need to be more than a threshold distance from the first position, as the user may tap a second tap of a double tap not in the identical position as the original tap. If instead in the first lift state 352, a timeout action 377 is triggered by the computer, the computer returns to the ready state 350. If in the first lift state 352, the user instead performs a tap same position action 373 with the stylus 9c, the computer transitions to a second tap state 353.
From the second tap state 353, if the user performs a lift action 378 with the stylus 9c, the computer transitions to the ready state 350. On the other hand, from the second tap state 353, if the user with the stylus 9c still pressed performs a move action 374 with the stylus 9c, the computer transitions to a selecting data state 354.
Upon entering the selecting data state 354 the computer updates the display to indicate the data on the display between the first position and the current position as selected. The memory 54 is also updated to indicate what data items are currently selected. From the selecting data state 354, if the user performs a move action 375 with the stylus 9c, the computer reenters the selecting data state 354 with a new current position of the stylus 9c. On the other hand, from the selecting data state 354, if the user performs a lift action 376 with the stylus 9c, the computer transitions to the ready state 350, while retaining the current selected data items in the memory 54 for further processing. Also, any indication on the display of the selection is retained.
When the computer enters the panning state 355 after the user performs a move action 380 from the first tap state 351, the computer updates the display, moving the available content corresponding to the distance between the current position and the first position. From the panning state 355, if the user performs a move action 381 with the stylus 9c, the computer reenters the panning state 355 with a new current position. On the other hand, from the panning state 355, if the user performs a lift action 382 with the stylus 9c, the computer transitions to the ready state 350.
FIG. 21 illustrates a web browser showing content with hyperlinks. In this example, the web browser application executing in the pocket computer 1 renders a text on a display view 301 including a number of hyperlinks 310-313. As is known in the art, if the user taps on one of the links using the stylus 9c on the touch sensitive display 3, the web browser application will in stead display a new web page, referred to by the hyperlink.
Alternatively, hardware buttons, such as a right button and a left button of navigation key 5a, may be used to browse through available hyperlinks 310-313, with at most one hyperlink being selected at any one time, such as hyperlink 311. In the prior art, a tab key on a computer keyboard is used to browse through the available hyperlinks. A web page author may add information about relative the order of the hyperlinks using what is called tab order. This tab order is usually determined by the web page author in order to maximize usability when the web page is displayed on a full size computer display. Thus, when the web page is displayed on a display of the pocket computer, where the pixel resolution is often significantly less than on a full size computer, the original tab order may not be optimal.
In FIG. 22A, the display view 301 of the touch sensitive display 3 of the pocket computer 1 shows content with a zoom factor of 100%. In this example, the content is a web page rendered by a web browser application executing in the pocket computer 1. However, any application where the user may benefit from a zoom function could be executing. In this example, the user has held the stylus 9c on the touch sensitive display 3 in a position 314 during a time period longer than a predetermined time, which has the effect of a context menu 315 showing. In this example, the menu only shows different zoom factors, but any relevant menu items, such as navigation forward and backwards, properties, etc. may be presented in this menu. Additionally, while this example only shows menu items in one level, the menu items may be organized in a hierarchical manner to provide a structured menu, in the case where there are more menu items available which may be grouped in logical subgroups.
FIG. 24 is a flow chart illustrating a method of an embodiment of a list element according to an inventive aspect. Refer to FIG. 26A-C for an illustrative graphical representation of the list element. The method provides the user with a user interface element representing a list, henceforth called a list element 420, having several ways in which its list items 421a-d may be selected. In this example, the list element 420 is operable in three modes: a single selection mode, a multiple distinct selection mode and a range selection mode. The flow chart illustrates the way in which selections may be made in the different list element modes. The method in this example is executing in the pocket computer 1 with its touch sensitive display 3.
In a detect first tap step 401, a first tap is detected from the stylus 9c being tapped on the touch sensitive display in a first position.
In a detect first lift step 403, a first lift of the stylus 9c is detected in a second position. This second position may be the same or different from the first position detected in the detect first tap step 401 above. In other words, the user may have moved the stylus 9c between the first tap and the first lift.
In a detect a lift on second element step 412, a lift of the stylus 9c is detected in a position corresponding to a second user interface element. This corresponds to the behavior called drag and drop, which is well known per se in the art.
The list element 420 has four list items 421a-d. A text area 426 is also displayed. Firstly, the user presses the stylus 9c in a position 423, corresponding to a specific list item 421b, activating a selection of the list element 421b. Secondly, the user presses the stylus 9c in a position 424, activating a selection of a second list item 421d. When the second list item 421d is selected, the first list item 421b is deselected. Finally, the user performs a drag and drop operation, by tapping the stylus 9c in a position corresponding to the second list item 421d and, while holding the stylus 9c pressed, moving the stylus 9c to a position 427 in the text area 426 and lifting the stylus 9c. As this is a single selection list element 420, drag and drop is possible, and information about the selected list item 421d in the list element 420 is provided to the text area 426, whereby the text corresponding to the selected list item 421d may be added to the text area 426. It is to be noted that the text area 426 may be of the same application of the list element 420 or a totally separate application 57.
Secondly, FIG. 26B, where the list element 420 is in a multiple distinct selection mode, will be explained. Firstly, the user presses the stylus 9c in a position 423, corresponding to a specific list item 421b, activating a selection of the list element 421b. In this type of list element 420, a selected list item is indicated with a check box 422 next to the list item. Secondly, the user presses the stylus 9c in a position 424, activating a selection of a second list item 421d. When the second list item 421d is selected, the first list item 421b is still selected. Finally, the user attempts to perform a drag and drop operation, by tapping the stylus 9c in a position corresponding to the second list item 421d and, while holding the stylus 9c pressed, moving the stylus 9c to a position 427 in the text area 426 and lifting the stylus 9c. As this is a multiple distinct selection list element 420, drag and drop is not possible, and no information may be provided to the text area 426. Instead, from the second tap in the position 424, the second list item 421d is deselected.
Thirdly, FIG. 26C, where the list element 420 is in a range selection mode, will be explained. The user presses the stylus 9c in a position 423, corresponding to a specific list item 421b, activating a selection of the list element 421b. While still keeping the stylus 9c pressed, the user then moves the stylus 9c to a position and lifts the stylus 9c. This dragging selects list items 421b to 421d. The user then performs a drag and drop operation, by tapping the stylus 9c in a position 424 corresponding to the second list item 421d and, while holding the stylus 9c pressed, moving the stylus 9c to a position 427 in the text area 426 and lifting the stylus 9c. As this is a range selection list element 420, drag and drop is possible, and information about the selected list item 421d in the list element 420 is provided to the text area 426, whereby the text corresponding to the selected list items 421b-d may be added to the text area 426.
Beginning with FIG. 27A, on the pocket computer 1, there is the touch sensitive display 3, showing a display view 301. A window 450 is displayed on a layer in front of any other windows currently displayed. The window may be a full window, or a dialog, such as is shown here. The window comprises a head area 451. The user taps the stylus 9c in a position 452 on the touch sensitive display 3, corresponding to the head area 451 of the window 450.
Once the user lifts the stylus 9c, the window 450 is displayed again, effecting a view 301 as seen in FIG. 27A.
FIG. 28A is a diagram illustrating a remote scrolling element 463 in an embodiment of an inventive aspect. The pocket computer comprises the display 3 with a visible area 460. A web browser 461 currently uses all available space of the view 461 available to an application, leaving space for a remote scroll element 463. The web browser has a vertical scrollbar 462 comprising a scroll thumb 464. As the scrollbar 462 is vertical, the remote scroll element 463 is also vertical. If the scrollbar 462 would have been horizontal, the remote scroll element 463 would have been placed along the bottom of the display 460, assuming a predominately horizontal shape. If the user presses the stylus 9c in a position on the remote scroll element 463, the application responds in the same way as if the user would have pressed on the scrollbar 462 with a same vertical co-ordinate. For example, if the user presses in a position 465 on the remote scroll element 463, which has the same vertical co-ordinate as a up arrow 466 of the scrollbar 462, it has the same effect as if the user would have pressed on the up arrow 466 immediately, i.e. scrolling the screen upwards. All actions that can be performed on the scrollbar 463 itself, such as scrolling up and down using the arrow buttons, scrolling by dragging the scroll thumb 464, or pressing in the area below or above the scroll thumb to scroll a page at a time, can in this way be performed by a corresponding press on the remote scroll element 463.
FIG. 28B is a diagram illustrating a disjunctive remote scrolling element 463 in an embodiment of an inventive aspect. The pocket computer 1 comprises the display 3 with a visible area 460. The web browser 461, comprising a scrollbar 462, is not occupying all available space of the view 461, and is only partly covering another application 468. The remote scroll element 463 is here located along the right side of the screen, not in direct contact with the web browser 461. Still, if the user presses the stylus 9c in a position on the remote scroll element 463, the application responds in the same way as if the user would have pressed on the scrollbar 462 with a same vertical co-ordinate. The remote scroll element 463 is located along the right side of the view 460 for convenience, and may be used for the currently active application, regardless of the position of the application on the view 460.
FIG. 28A may also be used to explain another inventive aspect related to the scrollbar, wherein the scrollbar further comprises an upper part of a trough 467a and a lower part of the trough 467b. When the user presses the stylus 9c in the trough, for example in the lower part of the trough 467b, the content starts scrolling. The content continues to scroll, until either the end of the content is reached or the user lifts the stylus 9c. Thus, the content may continue to a position past the position where the user tapped the stylus. This makes the exact position of the stylus less important when scrolling, thereby significantly simplifying the scrolling procedure when the user is in a moving environment, such as a bus or train or while the user is walking.
Previous Patent US 9,785,328 | Next Patent US 9,785,330