Source: https://patents.justia.com/patent/8239784
Timestamp: 2019-05-19 18:40:50
Document Index: 364292201

Matched Legal Cases: ['art\n20050005241', 'Application No. 05772892', 'Application No. 08016449', 'Application No. 08016450', 'Application No. 2007', 'Application No. 06016830', 'Application No. 06016856', 'Application No. 99904228', 'Application No. 99904228', 'Application No. 06016830', 'Application No. 06016855', 'Application No. 06016831', 'Application No. 06016832', 'Application No. 99904228', 'Application No. 06016858', 'Application No. 06016856', 'Application No. 2008', 'Application No. 12166818', 'Application No. 12166820']

US Patent for Mode-based graphical user interfaces for touch sensitive input devices Patent (Patent # 8,239,784 issued August 7, 2012) - Justia Patents Search
Justia Patents Scrolling (e.g., Spin Dial)US Patent for Mode-based graphical user interfaces for touch sensitive input devices Patent (Patent # 8,239,784)
Jan 18, 2005 - Apple
This application is also related to: (i) U.S. patent application Ser. No. 10/256,716 filed, on Sep. 26, 2002 and entitled “METHOD AND APPARATUS FOR ACCELERATED SCROLLING”; (ii) U.S. patent application Ser. No. 10/259,159, filed on Sep. 26, 2002 and entitled “METHOD AND APPARATUS FOR USE OF ROTATIONAL USER INPUT”; (iii) U.S. patent application Ser. No. 10/072,765, filed on Feb. 7, 2002 and entitled “MOUSE HAVING A ROTARY DIAL”; and (iv) U.S. patent application Ser. No. 10/840,862, filed on May 6, 2004 and entitled “MULTIPOINT TOUCH SCREEN”. Each of these related application are hereby incorporated herein by reference
The invention can be implemented in numerous ways, including as a method, graphical user interface, computing device, or a computer readable medium. Several embodiments of the invention are discussed below.
The invention relates, in one embodiment, to a user interface method. The method includes detecting a touch. The method also includes determining a user interface mode when a touch is detected. The method further includes activating one or more GUI elements based on the user interface mode and in response to the detected touch.
The invention relates, in one embodiment, to a user interface method. The method includes displaying a group of media items. The method also includes detecting a touch over the group of media items that are displayed. The method further includes activating a virtual scroll wheel when a touch is detected over the displayed media items. The activation of the virtual scroll wheel includes displaying and enabling the functionality of the virtual scroll wheel, the virtual scroll wheel providing a touch region where a user swirls their finger in order to traverse through the group of media items. The method additionally includes determining if a touch event is performed relative to the touch region of the virtual scroll wheel. Moreover, the method includes scrolling through the group of media items when a scrolling touch event is performed.
The invention relates, in one embodiment, to a method performed on a user operated electronic device having a display and a touch screen. The method includes determining if a touch is detected. The method also includes monitoring and analyzing the current operating conditions when a touch is detected. The method also includes activating a first GUI element for a first set of operating conditions. The method additionally includes activating a second GUI element for a second set of operating conditions.
The invention relates, in one embodiment, to a method performed on a computing device having a display and a touch sensing input device. The method includes sensing touches. The method also includes displaying and enabling a GUI element when a touch is detected. The GUI element is based on at least one of the following: (a) the application currently running on the computing device; (b) the current state of the application; and/or (c) one or more characteristics of the touch. The characteristics include, for example, touch location, touch ID, number of touches, and touch motion. The method further includes disabling and removing the GUI element from display when one of the following events occurs: (a) the touch is no longer detected, (b) a touch has not been detected for a preset amount of time, (c) a certain amount of time has gone by since the step of displaying and enabling, (d) a user selection.
The invention relates, in another embodiment, to a computing system. The computing system includes a display device configured to display a graphical user interface. The system also includes a touch screen positioned over the display device. The touch screen is configured to detect touches that occur over the display device. The system further includes a processor operatively coupled to the display device and the touch screen. The processor instructs the display device to display one or more GUI elements in response to a touch, and performs actions associated with the GUI element when touch events are detected relative to the displayed GUI elements.
The invention relates, in another embodiment, to a computing device. The computing device includes a processor. The computing device also includes a touch screen capable of sensing touch events. The computing device further includes a display configured to simultaneously display a plurality of media items and a virtual scroll wheel. The virtual scroll wheel provides a region where touch events are performed in order to implement a scrolling action. The scrolling action allows a user to traverse through the plurality of media items.
FIGS. 3A and 3B illustrate an image, in accordance with one embodiment of the present invention.
FIG. 28 is user interface method, in accordance with one embodiment of the present invention.
FIGS. 29A-29D illustrate a transition effect, in accordance with one embodiment of the present invention.
FIGS. 30A-30D illustrate a transition effect, in accordance with another embodiment of the present invention.
FIGS. 31A-31D illustrate a transition effect, in accordance with another embodiment of the present invention.
FIG. 32 is a determination method, in accordance with one embodiment of the present invention.
FIG. 33 is a user interface method, in accordance with one embodiment of the present invention.
FIG. 34A-34F illustrates a sequence associated with the method shown in FIG. 33, in accordance with one embodiment of the present invention.
FIG. 35A-35F illustrates a sequence associated with the method shown in FIG. 33, in accordance with one embodiment of the present invention.
FIGS. 36A-36C illustrate a user interface sequence, in accordance with one embodiment of the present invention.
FIG. 37 is a user interface method, in accordance with one embodiment of the present invention FIGS. 38A-38J illustrate a user interface sequence, in accordance with one embodiment of the present invention.
The invention pertains to gestures and methods of implementing gestures with touch sensitive devices. Examples of touch sensitive devices include touch screens and touch pads. The invention also pertains to user interfaces and methods of implementing user interfaces with displays. One aspect of the invention relates to determining a user interface mode based on one or more conditions. Another aspect of the invention relates to activating one or more GUI elements based on the user interface mode (e.g., displaying a GUI element). Another aspect of the invention relates to a virtual scroll wheel.
These and other aspects of the invention are discussed below with reference to FIGS. 1-38J. However, those skilled in the art will readily appreciate that the detailed description given herein with respect to these figures is for explanatory purposes as the invention extends beyond these limited embodiments.
It should also be noted that although the embodiment is described using a virtual control knob, in another embodiment, the UI element can be a virtual scroll wheel. As an example, the virtual scroll wheel can mimic an actual scroll wheel such as those described in U.S. Patent Publication Nos.: 2003/0076303A1, 2003/0076301A1, 2003/0095096A1, which are all herein incorporated by reference. For example, when the user places their finger on the surface of the virtual scroll wheel and makes a swirling, rotational or tangential gesture motion, a scrolling action can be performed with respect to a list of items displayed in a window.
FIG. 7 is a diagram of a touch-based method 200 in accordance with one embodiment of the present invention. The method generally begins at block 202 where a user input that occurs over a multipoint sensing device is detected. The user input includes one or more touch inputs, with each touch input having a unique identifier. Following block 202, the touch-based method 200 proceeds to block 204 where the user input is classified as a tracking or selection input when the user input includes a single unique identifier (one touch input), or is classified as a gesture input when the user input includes at least two unique identifiers (more than one touch input). If the user input is classified as a tracking input, the touch-based method 200 proceeds to block 206 where tracking is performed corresponding to the user input. If the user input is classified as a gesture input, the touch-based method 200 proceeds to block 208 where one or more gesture control actions are performed corresponding the user input. The gesture control actions are based at least in part on changes that occur with or between the at least two unique identifiers.
Following block 304 the touch-based method 300 proceeds to block 306 where the GUI object is modified based on and in unison with the gesture input. By modified, it is meant that the GUI object changes according to the particular gesture gestures being performed. By in unison, it is meant that the changes occur approximately while the gesture or gestures are being performed. In most cases, there is a one to one relationship between the gesture(s) and the changes occurring at the GUI object and they occur substantially simultaneously. In essence, the GUI object follows the motion of the fingers. For example, spreading of the fingers may simultaneously enlarge the object, closing of the fingers may simultaneously reduce the GUI object, rotating the fingers may simultaneously rotate the object, translating the fingers may allow simultaneous panning or scrolling of the GUI object.
FIGS. 23A-23D illustrate an inertia sequence using the method described above. FIG. 23A illustrates a display presenting a GUI 678 including a window 679 having a list 680 of media items 681. The window 679 and list 680 may for example correspond to a control window and music list found in iTunes® manufactured by Apple Computer, Inc of Cupertino, Calif. As shown in FIG. 23B, when the user slides their finger or fingers 576 over the touch screen 520, vertical scrolling, which moves media items up or down through the window, is implemented. The direction of scrolling may follow the same direction as finger movement (as shown), or it may go in the reverse direction. In one particular embodiment, a single finger is used for selecting the media items from the list, and two fingers are used to scroll through the list.
FIG. 26 is a diagram of a GUI operational method 750, in accordance with one embodiment of the present invention. The method 750 is configured for simulating a scroll wheel such as those described in U.S. Patent Publication Nos.: 2003/0076303A1, 2003/0076301A1, 2003/0095096A1, all of which are herein incorporated by reference. The method generally begins at block 752 where a virtual scroll wheel is presented on the display. In some cases, the virtual scroll wheel may include a virtual button at its center. The virtual scroll wheel is configured to implement scrolling as for example through a list and the button is configured to implement selections as for example items stored in the list. Following block 752, the method proceeds to block 754 where the presence of at least one finger and in some cases more than one finger, such as first and second fingers, over the virtual scroll wheel is detected on a touch screen. The touch screen is positioned over or in front of the display. By way of example, the display may be an LCD and the touch screen may be a multipoint touch screen. Following block 754, the method proceeds to block 756 where the initial position of the fingers on the virtual scroll wheel is set. By way of example, the angle of the fingers relative to a reference point may be determined (e.g., 12 o clock, 6 o clock, etc.). In most cases, the set down of the finger(s) associate, link or lock the fingers (or finger) to the virtual scroll wheel when the fingers are positioned over the virtual scroll wheel.
Following block 756, the method 750 proceeds to block 758 where a rotate signal is generated when the angle of the fingers change relative to the reference point. The rotate signal can be used to perform several actions including for example scrolling through a plurality of media items, and possibly moving the virtual scroll wheel with the finger(s). By way of example, the combination and frequency of the signals may be converted into distance, direction and speed necessary for moving a selector through the media items as well for moving the virtual scroll wheel around its axis. In most cases, the amount of scrolling and wheel rotation varies according to the amount of finger rotation. By way of example, if the fingers move 5 degrees then so will the wheel. Furthermore, the scrolling and rotation of the wheel typically occurs substantially simultaneously with the motion of the fingers. For instance, as the fingers rotate, both scrolling and rotation of the wheel are performed at the same time. Moreover, although not a requirement, the direction of scrolling and rotation of the wheel is generally the same as the direction of the finger motion. For example, the virtual scroll wheel rotates in the direction of finger rotation (e.g., clockwise, counterclockwise, etc.)
It should be pointed out that a rotating virtual scroll wheel is not a limitation, and in some cases, the virtual scroll wheel may remain stationary (e.g., does not rotate with the fingers) so as to simulate a touch surface rather than a mechanical rotating wheel.
FIGS. 27A-27D illustrates a scroll wheel sequence using the method described above. FIG. 27A illustrates a display presenting a scroll wheel. The scroll wheel may be displayed automatically as part of a program or it may be displayed when a particular gesture is performed. By way of example, during the operation of a music program (such as iTunes® manufactured by Apple Computer Inc., of Cupertino, Calif.), the virtual scroll wheel may appear on the GUI of the music program when two fingers are placed on the touch screen rather than one finger which is typically used for tracking in the music program. In some cases, the virtual scroll wheel only appears when two fingers are placed on a predetermined area of the GUI. Alternatively, the appearance of the virtual scroll wheel may be based on something other than or in addition to the number of fingers. For example, the virtual scroll wheel may appear in response to any touch that occurs when the music program is running.
As shown in FIG. 27B, a user positions their fingers over the multipoint touch screen 520 over the scroll wheel. At some point, the fingers are locked to the scroll wheel. This can occur at set down for example. As shown in FIG. 27C, when the fingers are rotated in a clockwise direction, the scroll wheel is rotated in the clockwise direction in accordance with the rotating fingers. As shown in FIG. 27D, when the fingers are rotated in a counterclockwise direction, the virtual scroll wheel is rotated in the counter clockwise direction in accordance with the rotating fingers. Alternatively, rotation of the virtual scroll wheel may also be rotated with linear motion of the fingers in a tangential manner.
FIG. 28 is user interface method 800, in accordance with one embodiment of the present invention. The user interface method 800 may for example be performed on a computing device having a display and a touch sensitive input device such as a touch screen. The user interface method 800 begins at block 802 where a touch is detected. This may be accomplished with the touch sensitive input device when an object such as a stylus or one or more fingers, is placed on the touch sensitive surface of the touch sensitive input device.
Once a touch is detected, the user interface method 800 proceeds to block 804 where a user interface (UI) mode is determined in response to the touch. The user interface mode may be widely varied. The user interface mode may include navigation modes, scroll modes, data entry modes, edit modes, control modes, information modes, display modes, etc. Each mode typically has one or more GUI interface elements associated therewith. By way of example, a virtual scroll wheel (e.g., FIG. 27) or slider bar may be associated with a scroll mode, a keyboard (e.g., FIG. 25) or keypad may be associated with data entry mode, a tool bar such as a formatting tool bar or drawing tool bar may be associated with an edit mode, a control panel including buttons may be associated with a control mode, a window may be associated with an information mode, etc.
The user interface mode may be determined at block 804 based on one or more conditions including for example, one or more applications currently running on the computing device, the current state or mode of the one or more applications and/or the touch characteristics associated with the touch. In fact, determining the user interface mode at block 804 may involve monitoring and analyzing one or more conditions.
The touch characteristics on the other hand may, for example, correspond to touch location, touch ID, number of touches, etc, as described in many of the embodiments mentioned above.
With regards to applications, different applications may indicate different UI modes. For example, a word processing or spreadsheet application may indicate a data entry mode, while a music management program may indicate a control or scrolling mode. With regards to the current state of an application, different modes of the application may indicate different UI modes. For example, in a music management program, a menu window may indicate one UI mode, while a playlist window may indicate another UI mode.
With regards to the touch, the number of fingers may indicate different UI modes. For example, one finger may indicate a first mode while two fingers may indicate a second mode. In addition, the identity of the touch may indicate different UI modes. For example, a thumb may indicate a first UI mode and an index finger may indicate a second UI mode. Moreover, the location of the touch may indicate different UI modes. For example, a first touch location may indicate a first UI mode, while a second touch location may indicate a second UI mode (if the touch is located over a border of a music program a first UI mode may be implemented, and if the touch is located over a playlist or list of songs in the music program a second UI mode may be implemented.
In one embodiment, the user interface mode is based on only one of the conditions. For example, the user interface mode is only based on the application, the current state of the application or one of the various touch characteristics as described above. In another embodiment, the user interface mode is based on multiple conditions. For example, the user interface mode may be based on a combination of at least two selected from the application, the current state of the application and the various touch characteristics. By way of example, the application combined with a first touch characteristic may indicate a first UI mode and the same application combined with a second touch characteristic may indicate a second UI mode.
After determining the user interface mode 804, the user interface method 800 proceeds to block 806 where one or more GUI elements are displayed based on the user interface mode and in response to the touch(s). In some cases, only one GUI element is displayed and in other cases multiple GUI elements are displayed. The GUI element is typically associated with a particular mode. For example, a slider bar or scroll wheel may be displayed in a scroll mode, a keyboard or keypad may be displayed in a data entry mode, a tool bar may be displayed in an edit mode, various buttons or a control panel may be displayed in a control mode, and information windows may be displayed in an information mode.
In addition to the above, the GUI element may be displayed using a transition effect such as growing, fading in, popping up, and in some cases may even pulsate, throb, etc. If the effect is popping up, the GUI element is immediately brought into view. If the effect is growing, as shown in FIGS. 29A-29D, a small GUI element 820A (scroll wheel) is initially displayed, and thereafter the GUI element 820A continuously enlarges through various sizes 820B and 820 C until it reaches its desired size 820D. The speed of growth may be based on the pressure of the touch. For example, if the touch pressure is low, the GUI element may grow slowly and if the touch pressure is high, the GUI element may grow more rapidly. In addition, the final size of the GUI element may be based on the length of the touch. For example, the GUI element stops growing when the touch is no longer detected. Alternatively, the speed and size may be user adjustable as for example through a control panel. If the effect is fading, as shown in FIGS. 30A-30D, the GUI element 822 is slowly brought into view from nothing, through various levels of distortion or transparency 822A-822C, to a final complete image 822D. The fading can be controlled similarly to growth. For example, the speed and level of fade may be controlled by the pressure and length of touch.
The transition effect may even carry over to the currently displayed images, i.e., the images currently displayed before the touch was detected. In one embodiment, the opposite effect happens to the currently displayed images. For example, as shown in FIGS. 31A-31D, the currently displayed graphical images 826 are minimized smaller and smaller as the GUI element 820 grows larger and larger. Alternatively, if the GUI element immediately pops in, the currently displayed graphical images can immediately pop out or be immediately minimized.
Once the GUI element is displayed (806), the user interface method 800 proceeds to block 808 where the functionality of the GUI element is enabled. For example, touch event is monitored relative to the GUI element and actions associated with the touch event are performed. The enablement of the GUI element may occur simultaneously with the display of the GUI element so that a user can immediately start using the GUI element once displayed. By way of example, in a scroll mode, a virtual scroll wheel may be displayed and when enabled, the touch events are monitored relative to the scroll wheel. During monitoring, control signals associated with the position of the finger on the scroll wheel are generated as the finger swirls around the virtual scroll wheel. These signals can be used to perform scrolling. For example, the number, combination and frequency of the signals may be converted into distance, direction and speed necessary for moving a selection bar through a list. By way of example, see FIGS. 6, 26 and 27 for more detailed descriptions of virtual scroll wheels and how they function.
At some point after enabling and displaying the GUI element, a determination 812 is made as to whether or not to deactivate the GUI element. The determination 812 can be made in a variety of ways including, for example: 1) the touch is no longer detected, 2) a touch has not been detected for a preset amount of time, 3) a time out occurs (a preset amount of time has gone by since the GUI element was first displayed/enabled), or 4) a user selection (e.g., a user selects a button that closes the GUI element).
If the determination indicates deactivation, then the method proceeds to block 814 where the GUI element is disabled and removed from display. Once disabled, actions will no longer be performed when a touch event occurs. The removal of the GUI element from display may function similar to displaying the GUI element in that it can be removed using a transition effect such as slowly fading out, shrinking or immediately disappearing (popping out). The removal transition effect may work opposite the displaying transitioning effect. For example, the GUI element fades out similarly to fading in, shrinks similarly to growth or pops out similarly to popping in. Further, the GUI element can slowly recess and disappear from view while the displaced or shrunken current graphical images can slowly grow back to their original size and shape. If the determination does not indicate deactivation, then the method maintains the display of the GUI element as well as the enablement thereof.
FIG. 32 is a determination method 850 in accordance with one embodiment of the present invention. The determination method may, for example, correspond to the block 804 in FIG. 28. The determination method begins at block 852 where the current application is determined. The determination method proceeds to block 854 where the current state of the application is determined. Following block 854, the determination method proceeds to block 856 where the touch characteristics associated with the touch are determined. The determination method proceeds to block 860 where a UI mode is selected based on the results from blocks 852-858. By way of example, a set of rules may indicate appropriate UI modes for a particular set of conditions.
FIG. 33 is a user interface method 900 in accordance with one embodiment of the present invention. The method may, for example, be performed on a computing device having a display and a touch sensitive input device such as a touch screen. The interface method 900 begins at block 902 where a list of songs are displayed. FIG. 34A shows one example of a window 930A including a list of songs 932A, and FIG. 35A shows another example of a window 930B including a list of songs 932B. FIG. 34A may, for example, be a graphical user interface displayed on an iPod® manufactured by Apple Computer of Cupertino, Calif., and FIG. 35A may for example be a graphical user interface associated with a music management program, such as iTunes® manufactured by Apple Computer of Cupertino, Calif.
Following block 902, the user interface method 900 proceeds to block 904 where a touch is detected over the displayed list of songs (or window or entire GUI). This may be accomplished with the touch sensitive input device when an object such as a stylus or one or more fingers is placed on the touch sensitive surface of the touch sensitive input device such as a touch screen. FIGS. 34B and 35B show a finger 925 placed over the window 930 including the list of songs 932.
Once a touch is detected, the user interface method 900 proceeds to block 906 where a virtual scroll wheel is activated. That is, a virtual scroll wheel is displayed in addition to the list of songs and its functionality is enabled. In essence, because the song list was touched, a scroll wheel that allows a user to traverse through the songs in the list of songs is provided. In some cases, the virtual scroll wheel displaces the media items, i.e., the media items are minimized or shifted to make room for the virtual scroll wheel. In other cases, the virtual scroll wheel is positioned or laid over the media items (the media items keep their current size, shape and position). The virtual scroll wheel can be made semi-transparent so that the media items can be viewed through the virtual scroll wheel. FIGS. 34C and 35C show a transparent virtual scroll 936 wheel laid over the window 930 including the list of songs 932. Alternatively, a virtual slider bar may be displayed.
Once displayed, a determination 908 is made as to whether or not a scrolling touch event (or gesture) is performed relative to the virtual scroll wheel. For example, whether or not a finger is positioned over the scroll wheel and whether or not the finger is moved around the scroll wheel in a swirling fashion.
If a scrolling touch event is performed by the user, the user interface method 900 proceeds to block 910 where scrolling is implemented through the list of songs in accordance with the scrolling touch event. By way of example, a selector bar may be moved from one song to another as the finger is swirled around the virtual scroll wheel. FIGS. 34D and 35D show the finger 925 swirling around the virtual scroll wheel 936, and a selector bar 938 moving linearly through the list of songs 932 in accordance with the swirling finger 925. In the illustrated embodiments, the selector bar is moved linearly up when the finger is swirled in a clockwise fashion and linearly down when the finger is swirled in a counterclockwise fashion. It should be noted, however, that this is not a limitation. For example, the selector bar may moved linearly down when the finger is swirled in a clockwise fashion and linearly up when the finger is swirled in a counterclockwise fashion.
If a scrolling or select touch event is not performed, the user interface method 900 proceeds to block 916 where the virtual scroll wheel is deactivated. That is, the virtual scroll wheel is disabled and removed from the display. FIGS. 34E and 35E show the display 928 without the virtual scroll wheel 936. Although the virtual scroll wheel 936 is removed, changes made to the list of songs, i.e., the position of the selector bar 938, typically remain.
In some cases, the virtual scroll wheel may include button zones across its surface or a virtual button at its center or around its sides. The buttons and button zones may for example correspond to menu, play, seek, pause, and/or the like. In this particular embodiment, the method described above may include additional steps that occur before block 416. For example, if a scrolling touch event is not performed, the user interface method 900 may include an additional block where a determination is made as to whether or not a selection touch event (or gesture) is performed relative to the virtual scroll wheel. The selection touch event may be implemented by tapping the button or by exerting increased or decreased pressure on the button rather than swirling around the surface of the virtual scroll wheel (see FIGS. 34F and 35F). If the button is a song select or enter button, the method include another block where the song with the selector bar disposed thereover is selected. That is, when the virtual button is tapped, or otherwise selected, the song currently covered by the selector bar is played and outputted for the user's enjoyment.
It should be noted that the methods described above are not limited to scrolling through a list of songs. Any media item as well as any group of elements can be scrolled through using the aforementioned technique. For example, in photo layout 942 as shown in FIGS. 36A-36C, the virtual scroll wheel 936 may appear when the user places their finger 925 over the photo layout 942 (or grouping), and thereafter it can be used to move a highlighter 944 through the various photos 943 in the layout 942. By way of example, the photos may be thumbnails images that make traversing through a large number of images easier.
FIG. 37 is a method 950, in accordance with one embodiment of the present invention. The method begins at block 952 where it is determined if a touch is detected. If a touch is detected, the method proceeds to block 954 where the current operating conditions are monitored and analyzed. The conditions may for example correspond to the current application, the state of the application and/or the touch characteristics associated with the touch.
If a first set of conditions are implemented, the method proceeds to block 956 where a first GUI element is activated. For example, as shown in FIGS. 38A-B, in an active window 960 of a music management program, a scroll wheel 962 may be activated when a user touches a playlist portion 964 of the active window 960.
If a second set of conditions are implemented, the method proceeds to block 958 where a second GUI element is activated. For example, as shown in FIGS. 38B-C, in the active window 960 of a music management program, a music control panel 966 may be activated when a user also touches a border 968 of the active window 960. Although they work independent of one another, the first and second GUI elements may be activated at the same time if the first and second conditions occur simultaneously (FIG. 34C).
Following block 956, the method proceeds to block 960 where it is determined if the first GUI element should be deactivated. If so, the method proceeds to block 962 where the GUI element is deactivated. For example, as shown in FIG. 38D, the first GUI element (scroll wheel 962) is disabled and removed from display when the finger 925 is no longer detected over the playlist 962. If not, the method maintains block 956.
Similarly but independently, following block 958, the method proceeds to block 964 where it is determined if the second GUI element should be deactivated. If so, the method proceeds to block 966 where the GUI element is deactivated. For example, as shown in FIG. 38E, the second GUI element (control panel 966) is disabled and removed from display when the finger 925 is no longer detected over the border 968. If not, the method maintains block 958.
It should be noted that the method is not limited to only two GUI elements and that other GUI elements may be activated if other conditions are implemented. For example, a third GUI element may be activated when a third set of condition occurs and so on. By way of example, as shown in FIG. 38F, the user may slide their finger 925 from the border 968 to a menu portion 970 of the active window 960 thereby initiating a change from the control panel 966 to a scroll wheel 972 (e.g., while the second GUI element is being deactivated, the third GUI element is being activated).
Further, as shown in FIG. 38G, the user may add another finger 925 to the current touch thereby initiating a change from the first control panel 966 to a second control panel 982. The first control panel 966 may include a first set of control options such as play, stop, seek and volume options and the second control panel 982 may include a second set of control options such as song playing order, song information, light effect options.
Moreover, as shown in FIG. 38H, the user may place one finger 925A over the border 968, another finger 925B over a menu portion 970, and yet another finger 925C over the playlist portion 964 thereby initiating three different GUI elements, particularly, a control panel 966, a first scroll wheel 972 for scrolling through the menu 970, and a second scroll wheel 962 for scrolling through the playlist 964.
In addition, multiple GUI elements can be activated in the same portion. For example, as shown in FIGS. 38I and 38J, if the user selects a particular box 990 in the playlist 964, a keyboard 992 may be activated so that the user can enter data associated with the song (e.g., title, artist, genre, etc.). If the scroll wheel 962 is active at the same time as the keyboard 992, the scroll wheel 962 may be minimized to accommodate the keyboard 992 as shown. Once the keyboard 992 is deactivated, the scroll wheel 962 reverts back to its original size.
a processor communicatively coupled to the touch screen, the processor configured for displaying a series of items on the touch screen, causing a virtual scroll wheel to appear in response to an initial touch detected on the touch screen over the series of items, the virtual scroll wheel being manipulable using swirling motion touch events over the virtual scroll wheel, converting swirling motion touch events detected over the virtual scroll wheel subsequent to the initial touch into serial movement through the displayed series of items; detecting a second touch, the second touch at least partially contemporaneous with the initial touch; and activating a GUI element in response to the second touch,
wherein the virtual scroll wheel and a virtual control interface of the GUI element are manipulable simultaneously; and
2. The computer system as recited in claim 1, the processor further configured for minimizing or shifting the series of items to maintain their visibility when the virtual scroll wheel appears.
3. The computer system as recited in claim 1, the processor further configured for causing the virtual scroll wheel to appear having a virtual button at its center.
4. The computer system as recited in claim 3, the processor further configured for selecting a particular item from the series of items upon detection of a touch event at the virtual button.
5. The computer system as recited in claim 1, the processor further configured for displaying the series of items as an array of photos.
6. The computer system as recited in claim 5, the processor further configured for converting the swirling motion touch events detected over the virtual scroll wheel into movement through the displayed array of photos by moving a highlighter through the displayed array of photos.
7. The computer system as recited in claim 1, wherein the virtual scroll wheel is semitransparent so that the previously displayed series of items disposed underneath the virtual scroll wheel can be seen through the virtual scroll wheel.
8. The computer system as recited in claim 1 wherein the virtual scroll wheel is presented in the vicinity of the detected touch.
9. The computer system as recited in claim 1 wherein the virtual scroll wheel is presented at a predetermined location.
10. The computer system as recited in claim 1 wherein causing the virtual scroll wheel to appear includes implementing a transition effect that transitions the virtual scroll wheel from a first state to a second state.
11. The computer system as recited in claim 10 wherein the transitioning effect is selected from popping, growing, or fading in and out.
12. The computer system as recited in claim 10 wherein the speed of the transition effect is based on the pressure of the touch.
13. The computer system as recited in claim 1, the processor further configured for:
determining whether or not to deactivate the virtual scroll wheel, deactivation including disabling the functionality of the virtual scroll wheel and removing the virtual scroll wheel from display.
14. The computer system as recited in claim 13, the processor further configured for deactivating the virtual scroll wheel when a touch is no longer detected.
15. The computer system as recited in claim 13 wherein the virtual scroll wheel is deactivated when a touch has not been detected for a preset amount of time.
16. The computer system as recited in claim 13 wherein the virtual scroll wheel is deactivated after being activated for a preset amount of time.
17. The computer system as recited in claim 13 wherein the virtual scroll wheel is deactivated via a user selection.
18. The computer system as recited in claim 13 wherein causing the virtual scroll wheel to appear includes implementing a transition effect that transitions the virtual scroll wheel from a first state to a second state, and wherein deactivating the displayed virtual scroll wheel includes implementing a reverse transition effect that transitions the virtual scroll wheel from the second state to the first state.
19. A method for scrolling through a series of items, the method comprising:
displaying a series of items on a touch screen;
detecting an initial touch on the touch screen over at least one of the series of items that are displayed;
causing a virtual scroll wheel to appear in response to the initial touch detected over the displayed series of items, the virtual scroll wheel being graphically manipulable by swirling motion touch events detected over the virtual scroll wheel subsequent to the initial touch;
determining if a swirling motion touch event is performed relative to a touch region of the virtual scroll wheel;
scrolling through the series of items when the swirling motion touch event is performed;
activating a GUI element in response to the second touch,
20. The method as recited in claim 19 wherein causing the virtual scroll wheel to appear includes displaying and enabling the functionality of the virtual scroll wheel, the virtual scroll wheel providing a touch region where the swirling motion touch event can be performed in order to traverse through the series of items.
deactivating the virtual scroll wheel when a touch event is not performed, the deactivation of the virtual scroll wheel including disabling the functionality of the virtual scroll wheel and removing the virtual scroll wheel from display.
22. The method as recited in claim 21 wherein the display and the removal of the virtual scroll wheel from display are performed with a transition effect that transitions the virtual scroll wheel from a first state to a second state when displayed, and that transitions the virtual scroll wheel from the second state to the first state when removed.
23. The method as recited in claim 20 wherein the virtual scroll wheel is displayed with a transition effect that transitions the virtual scroll wheel from a first state to a second state.
24. The method as recited in claim 23 wherein the transition effect causes the virtual scroll wheel to grow, a small virtual scroll wheel being initially displayed, and thereafter the virtual scroll wheel continuously enlarging until the virtual scroll wheel reaches a final size.
25. The method as recited in claim 20 wherein the virtual scroll wheel is displayed over the series of items, and wherein the virtual scroll wheel is semitransparent so that the series of items disposed underneath the virtual scroll wheel can be seen through the virtual scroll wheel.
26. The method as recited in claim 19 wherein the virtual scroll wheel provides one or more virtual buttons, and wherein the method further comprises:
determining if a selection touch event is performed relative to the one or more virtual buttons of the virtual scroll wheel; and
implementing an action associated with a particular button when the selection touch event is performed on the particular button.
27. The method as recited in claim 26 wherein the one or more virtual buttons include at least a center button that is surrounded by the touch region.
28. The method as recited in claim 27 wherein the virtual scroll wheel is circular.
29. The method as recited in claim 19 wherein determining if a touch event is performed relative to the touch region of the virtual scroll wheel comprises:
detecting the presence of at least one finger over the touch region;
setting an initial position of the finger; and
monitoring finger movement relative to the initial position.
30. The method as recited in claim 19 wherein the series of items are a list of songs.
a touch sensing device positioned over the display device, the touch sensing device being configured to detect touches that occur over the display device; and
a processor operatively coupled to the display device and the touch sensing device, the processor configured for displaying a series of items on the display device, detecting an initial touch over the series of items, instructing the display device to cause a virtual scroll wheel to appear in response to the initial touch, the virtual scroll wheel being graphically manipulable by rotational motion touch events subsequent to the initial touch,
converting touch events representing rotational movement around the virtual scroll wheel into serial movement through the displayed series of items;
wherein the virtual scroll wheel and z virtual control interface of the GUI element are manipulable simultaneously; and
32. The computer system of claim 1, wherein the detected initial touch and touch events are touch images representing a profile of an object causing the touch.
33. The method of claim 19, wherein the detected initial touch and touch events are touch images representing a profile of an object causing the touch.
34. The computing system of claim 31, wherein the detected initial touch and touch events are touch images representing profiles of objects in contact with the touch screen.
3748751 July 1973 Breglia et al.
3825730 July 1974 Worthington, Jr. et al.
4014000 March 22, 1977 Uno et al.
4303856 December 1, 1981 Serras-Paulet
4435835 March 6, 1984 Sakow et al.
4475122 October 2, 1984 Green
4629319 December 16, 1986 Clarke et al.
4686374 August 11, 1987 Liptay-Wagner et al.
4993806 February 19, 1991 Clausen et al.
5045846 September 3, 1991 Gay et al.
5328190 July 12, 1994 Dart et al.
5347629 September 13, 1994 Barrett et al.
5495269 February 27, 1996 Elrod et al.
5502514 March 26, 1996 Vogeley et al.
5510806 April 23, 1996 Busch
5530456 June 25, 1996 Kokubo
5572647 November 5, 1996 Blades
5777603 July 7, 1998 Jaeger
5825232 October 20, 1998 Kimura
5831601 November 3, 1998 Vogeley et al.
5870091 February 9, 1999 Lazarony et al.
5871251 February 16, 1999 Welling et al.
5956291 September 21, 1999 Nehemiah et al.
5974541 October 26, 1999 Hall et al.
5982353 November 9, 1999 Gallery et al.
5995104 November 30, 1999 Kataoka et al.
6005555 December 21, 1999 Katsurahira et al.
6013956 January 11, 2000 Anderson, Jr.
6034685 March 7, 2000 Kuriyama et al.
6061177 May 9, 2000 Fujimoto
6105419 August 22, 2000 Michels et al.
6151596 November 21, 2000 Hosomi
6219035 April 17, 2001 Skog et al.
6255604 July 3, 2001 Tokioka et al.
6256020 July 3, 2001 Pabon et al.
6295049 September 25, 2001 Minner
6323849 November 27, 2001 Westerman et al.
6326956 December 4, 2001 Jaeger et al.
6400379 June 4, 2002 Johnson et al.
6421046 July 16, 2002 Edgren
6441806 August 27, 2002 Jaeger
6442440 August 27, 2002 Miller
6480188 November 12, 2002 Horsley
6489978 December 3, 2002 Gong et al.
6563492 May 13, 2003 Furuya et al.
6664989 December 16, 2003 Synder et al.
6677933 January 13, 2004 Yogaratnam
6710771 March 23, 2004 Yamaguchi et al.
6760020 July 6, 2004 Uchiyama et al.
6806869 October 19, 2004 Yamakado
6874129 March 29, 2005 Smith
6896375 May 24, 2005 Peterson et al.
6903730 June 7, 2005 Mathews et al.
6920619 July 19, 2005 Milevic
6944591 September 13, 2005 Raghunandan
6952203 October 4, 2005 Banerjee et al.
6954583 October 11, 2005 Nagasaka et al.
6970749 November 29, 2005 Chinn et al.
6972749 December 6, 2005 Hinckley et al.
7002749 February 21, 2006 Kremen
7058902 June 6, 2006 Iwema et al.
7091410 August 15, 2006 Ito et al.
7100105 August 29, 2006 Nishimura et al.
7143355 November 28, 2006 Yamaguchi et al.
7149981 December 12, 2006 Lundy et al.
7233319 June 19, 2007 Johnson et al.
7242311 July 10, 2007 Hoff et al.
7310781 December 18, 2007 Chen et al.
7319454 January 15, 2008 Thacker et al.
7320112 January 15, 2008 Yamaguchi et al.
7340685 March 4, 2008 Chen et al.
7346853 March 18, 2008 Chen et al.
7417681 August 26, 2008 Lieberman et al.
7478336 January 13, 2009 Chen et al.
7509113 March 24, 2009 Knoedgen
7515810 April 7, 2009 Nagasaka et al.
7664748 February 16, 2010 Harrity
7714849 May 11, 2010 Pryor
7856472 December 21, 2010 Arav
20010012769 August 9, 2001 Sirola et al.
20010015718 August 23, 2001 Hinckley et al.
20010026678 October 4, 2001 Nagasaka et al.
20010040554 November 15, 2001 Nakagawa
20020075317 June 20, 2002 Dardick
20020085037 July 4, 2002 Leavitt et al.
20020113778 August 22, 2002 Rekimoto et al.
20020120543 August 29, 2002 Brittingham et al.
20020133522 September 19, 2002 Greetham et al.
20020140668 October 3, 2002 Crawford
20020180763 December 5, 2002 Kung et al.
20020196227 December 26, 2002 Surloff et al.
20030005454 January 2, 2003 Rodriguez et al.
20030030664 February 13, 2003 Parry
20030071858 April 17, 2003 Morohoshi
20030072077 April 17, 2003 Peterson et al.
20030076363 April 24, 2003 Murphy
20030128188 July 10, 2003 Wilbrink et al.
20030128195 July 10, 2003 Banerjee et al.
20030152241 August 14, 2003 Eastty et al.
20030160808 August 28, 2003 Foote et al.
20030169303 September 11, 2003 Islam et al.
20030179201 September 25, 2003 Thacker
20030197736 October 23, 2003 Murphy
20030201972 October 30, 2003 Usuda
20030210260 November 13, 2003 Palmer et al.
20030210286 November 13, 2003 Gerpheide et al.
20030214534 November 20, 2003 Uemura et al.
20040001048 January 1, 2004 Kraus et al.
20040019505 January 29, 2004 Bowman et al.
20040021696 February 5, 2004 Molgaard
20040056849 March 25, 2004 Lohbihler et al.
20040064473 April 1, 2004 Thomas et al.
20040080529 April 29, 2004 Wojcik
20040141157 July 22, 2004 Ramachandran et al.
20040145601 July 29, 2004 Brielmann et al.
20040146688 July 29, 2004 Treat
20040150668 August 5, 2004 Myers et al.
20040150669 August 5, 2004 Sabiers et al.
20040198463 October 7, 2004 Knoedgen
20040227739 November 18, 2004 Tani et al.
20040227830 November 18, 2004 Kobayashi et al.
20040237052 November 25, 2004 Allport
20040245352 December 9, 2004 Smith
20040262387 December 30, 2004 Hart
20050005241 January 6, 2005 Hunleth et al.
20050016366 January 27, 2005 Ito et al.
20050064936 March 24, 2005 Pryor
20050066270 March 24, 2005 Ali et al.
20050071771 March 31, 2005 Nagasawa et al.
20050078087 April 14, 2005 Gates et al.
20050091577 April 28, 2005 Torres et al.
20050116941 June 2, 2005 Wallington
20050120312 June 2, 2005 Nguyen
20050132072 June 16, 2005 Pennell et al.
20050204008 September 15, 2005 Shinbrood
20050204889 September 22, 2005 Swingle et al.
20050211766 September 29, 2005 Robertson et al.
20060010374 January 12, 2006 Corrington et al.
20060026335 February 2, 2006 Hotelling et al.
20060035681 February 16, 2006 Oh
20060167993 July 27, 2006 Aaron et al.
20060197750 September 7, 2006 Hotelling et al.
20060242587 October 26, 2006 Eagle et al.
20060290921 December 28, 2006 Hotelling et al.
20070011603 January 11, 2007 Makela
20070033269 February 8, 2007 Atkinson et al.
20070083823 April 12, 2007 Jaeger
20070088787 April 19, 2007 Hardy et al.
20070180360 August 2, 2007 Neil
20070276875 November 29, 2007 Brunswig et al.
20080088587 April 17, 2008 Pryor
20080139297 June 12, 2008 Beaulieu et al.
20080174553 July 24, 2008 Trust
20080211784 September 4, 2008 Hotelling et al.
20080211785 September 4, 2008 Hotelling et al.
20080229236 September 18, 2008 Carrer et al.
20090021489 January 22, 2009 Westerman et al.
20090064006 March 5, 2009 Naick et al.
20090160816 June 25, 2009 Westerman et al.
20090244031 October 1, 2009 Westerman et al.
20090244032 October 1, 2009 Westerman et al.
20090244033 October 1, 2009 Westerman et al.
20090251435 October 8, 2009 Westerman et al.
20090251438 October 8, 2009 Westerman et al.
20090251439 October 8, 2009 Westerman et al.
20090267921 October 29, 2009 Pryor
20090273574 November 5, 2009 Pryor
20090300531 December 3, 2009 Pryor
20090322499 December 31, 2009 Pryor
20100149092 June 17, 2010 Westerman et al.
20100231506 September 16, 2010 Pryor
0394614 October 1990 EP
0 422 577 April 1991 EP
0 462 759 December 1991 EP
0 817 000 January 1998 EP
0926588 June 1999 EP
1233330 August 2002 EP
1517228 March 2005 EP
2330670 April 1999 GB
60-198586 October 1985 JP
63-167923 July 1988 JP
04-048318 February 1992 JP
04-054523 February 1992 JP
04-198795 July 1992 JP
05-297979 November 1993 JP
7-129312 May 1995 JP
7-230352 August 1995 JP
9-330175 December 1997 JP
11-133816 May 1999 JP
2000-010705 January 2000 JP
2000-163444 June 2000 JP
2001-134382 May 2001 JP
2001-147918 May 2001 JP
2001-230992 August 2001 JP
2002-034023 January 2002 JP
2002-501271 January 2002 JP
10-2001-0040410 May 2001 KR
2344894 June 2000 UK
WO-92/02000 February 1992 WO
WO-94/29788 December 1994 WO
WO-97/36225 October 1997 WO
WO-97/40744 November 1997 WO
WO-02/39245 May 2002 WO
WO-03/027822 April 2003 WO
WO-03/036457 May 2003 WO
WO-03/062978 July 2003 WO
WO-2004/029789 April 2004 WO
W-2004/051392 June 2004 WO
WO-2004/047069 June 2004 WO
WO-2004/051392 June 2004 WO
WO-2004/091956 October 2004 WO
WO-2006/020304 February 2006 WO
WO-2007/037808 April 2007 WO
WO-2008/094791 July 2008 WO
WO-2010/135478 November 2010 WO
Jog dial | Ask.com, http://www.ask.com/wiki/Jog—dial, 2011.
Jog Dial, Ask.com Encyclopedia.
Ask Search, http://www.ask.com/web?q=what+is+a+jog+wheel&search=&qsrc=0&o=0&1=dir.
Ask Search, http://www.ask.com/web?q=%28graphical+or+virtual/029++%28jog+dial%29+or+%28jo. . . .
Ask Search, http://www.ask.com/web?q=virtual+scroll+wheel&qsrc=0&o=0&1=dir&oo=0.
Ask Search, http://www.ask.com/web?q=emulate+scroll+wheel&qsrc=1&o=0&1=dir&qid=A23E49EA. . . .
IBM Technical Disclosure, Jog Shuttle, Graphical Construct, Apr. 1, 1994.
“Touch Technologies Overview,” 2001', 3M Touch Systems, Massachusetts.
Ian Hardy, “Fingerworks,” Mar. 7, 2002.
“Symbol Commander,” http://www.sensiva.com/symbolcomander/, downloaded Aug. 30, 2005.
“Mouse Gestures in Opera,” http://www.opera.com/features/mouse/, downloaded Aug. 30, 2005.
“A Brief Overview of Gesture Recognition,” http://www.dai.ed.ac.uk/Cvonline/LOCAL—COPIES/COHEN/gesture—overview, downloaded Apr. 20, 2004.
Jun Rekimoto, “SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces,” CHI 2002, Apr. 20-25, 2002.
“iGesture Products for Everyone (learn in minutes),” FingerWorks.
“MultiTouch Overview,” FingerWorks, http://www.fingerworks.com/multoverview.html downloaded Aug. 30, 2005.
“Gesture Recognition,” http://www.fingerworks.com/gesture—recognition.html, downloaded Aug. 30, 2005.
“Tips for Typing,” FingerWorks, http://www.fingerworks.com/mini—typing.html, downloaded Aug. 30, 2005.
“Mouse Emulation,” FingerWorks, http://www.fingerworks.com/gesture—guide—mouse.html, downloaded Aug. 30, 2005.
International Search Report dated Mar. 3, 2006 (PCT/US 05/03325).
U.S. Appl. No. 11/140,529, filed May 27, 2005.
U.S. Appl. No. 11/332,861, filed Jan. 13, 2006.
U.S. Appl. No. 11/428,501, filed Jul. 3, 2006 entitled “Capacitive Sensing Arrangement.”
U.S. Appl. No. 11/428,503, filed Jul. 3, 2006 entitled “Touch Surface”.
U.S. Appl. No. 11/428,506, filed Jul. 3, 2006 entitled “User Interface Gestures”.
U.S. Appl. No. 11/428,515, filed Jul. 3, 2006 entitled “User Interface Gestures”.
U.S. Appl. No. 11/428,522, filed Jul. 3, 2006 entitled “Identifying Contacts on a Touch Surface”.
U.S. Appl. No. 11/428,521, filed Jul. 3, 2006 entitled “Identifying Contacts on a Touch Surface”.
U.S. Appl. No. 11/426,078, filed Jun. 23, 2006 entitled “Electronic Device Having Display and Surrounding Touch Sensitive Bezel for User Interface and Control”.
U.S. Appl. No. 11/382,402, filed May 9, 2006 entitled “Force and Location Sensitive Display”.
International Search Report received in corresponding PCT application No. PCT/US2006/008349.
Annex to Form PCT/ISA/206 Communication Relating to the Results of the Partial International Search received in corresponding PCT Application No. PCT/US2005/025641 dated Feb. 19, 2007.
PCT International Search Report received in corresponding PCT Application No. PCT/US2006/031523 dated Feb. 27, 2007.
PCT International Search Report received in corresponding PCT Application No. PCT/US2005/025657 dated Feb. 26, 2007.
PCT International Search Report received in corresponding PCT Application No. PCT/US2006/031527 dated Feb. 27, 2007.
PCT International Search Report received in corresponding PCT Application No. PCT/US2006/031526 dated Feb. 14, 2007.
Jones; “MTC Express Multi-touch Controller;” Computer Music Journal 25.1, 2001, pp. 97-99.
European Search Report mailed Dec. 13, 2007, for EP Application No. 05772892.5, filed Jul. 19, 2005, three pages.
European Search Report mailed Dec. 15, 2008, for EP Application No. 08016449.4, filed Jul. 19, 2005, six pages.
European Search Report mailed Dec. 15, 2008, for EP Application No. 08016450.2, filed Jul. 19, 2005, six pages.
Final Office Action mailed May 21, 2008, for U.S. Appl. No. 11/048,264, filed Jan. 31, 2005, 11 pages.
Final Office Action mailed Dec. 23, 2008, for U.S. Appl. No. 10/903,964, filed Jul. 30, 2004, 12 pages.
International Search Report mailed Oct. 8, 2008, for PCT Application No. PCT/US2008/051727, filed Jan. 22, 2008, six pages.
International Search Report mailed Aug. 11, 2008, for PCT Application No. PCT/US2007/002512 filed Jan. 30, 2007, six pages.
International Search Report mailed Apr. 24, 2007, for PCT Application No. PCT/US2005/025641 filed Jul. 19, 2005, five pages.
Japanese Office Action mailed Oct. 27, 2008, for JP Patent Application No. 2007-523644, one page.
Mohri, K. (Nov. 25, 2000). “Wearable Human Interface Based on Hand/Finger Gesture Recognition,” Human Interface Association Magazine 2(4):9-18. (Abstract Only in English.).
Non-Final Office Action mailed Mar. 17, 2008, for U.S. Appl. No. 10/903,964, filed Jul. 30, 2004, 34 pages.
Non-Final Office Action mailed Sep. 28, 2007, for U.S. Appl. No. 11/048,264, filed Jan. 31, 2005, 11 pages.
Non-Final Office Action mailed Oct. 3, 2008, for U.S. Appl. No. 11/228,758, filed Sep. 16, 2005, 16 pages.
Non-Final Office Action mailed Dec. 11, 2008, for U.S. Appl. No. 11/048,264, filed Jan. 31, 2005, 11 pages.
Anonymous. “Ai Squared Products—XoomText Magnifier,” http://www/aisquared.com/Products/zoomtexturemag/index.cfm, downloaded Oct. 26, 2005.
Anonymous. “Ai Squared Products,” http://www.aisquared.com/Products/index.cfm, downloaded Oct. 25, 2005.
Anonymous. “Lunar Screen Magnifier and Lunar Plus Enhanced Screen Magnifier,” www.dolphincomputeraccess.com/products/lunar.htm, downloaded Oct. 25, 2005.
Anonymous. “Touchscreen Technology Choices,” http://www.elotouch.com/products/detech2.asp, downloaded Aug. 5, 2005.
Anonymous. “Visual Disabilities,” http://depts.stcc.edu/ods/ACCESS/bpvisual.htm, downloaded Oct. 25, 2005.
Buxton, W. et al. (Jul. 22, 1985). “Issues and Techniques in Touch-Sensitive Tablet Input,” Proceedings ACM Siggraph, pp. 215-224.
Chang, C-C. et al. (Aug. 1, 1993). “A Hashing-Oriented Nearest Neighbor Searching Scheme,” Pattern Recognition Letters, 14(8):625-630.
Crowley, J.L. (Mar. 1, 1997). “Vision for Man-Machine Interaction,” Robotics and Autonomous Systems, 19(3-4):347-358.
Davis, J. et al. (May 2, 1994). “Recognizing Hand Gestures,” European Conference on Computer Vision, Stockholm, SE, 1:331-340.
Davis, J. et al. (Oct. 31, 1994). “Determining 3-D Hand Motion,” Signals, Systems and Computers, 1994 Conference Record of the 28th Asilomar Conference on Pacific Grove, CA, Oct. 31-Nov. 2, 1994, Los Alamitos, CA, pp. 1262-1266.
European Examination Report for European Patent Application No. 06016830.9, mailed Aug. 6, 2008.
European Examination Report for European Patent Application No. 06016856.4 mailed Sep. 16, 2008.
European Examination Report for European Patent Application No. 99904228.6, mailed Apr. 20, 2006.
European Examination Report for European Patent Application No. 99904228.6, mailed Mar. 23, 2007.
European Search Report for European Patent Application No. 06016830.9 mailed Dec. 3, 2007.
European Search Report mailed Dec. 12, 2008, for EP Application No. 06016855.6 filed Jan. 25, 1999, six pages.
European Search Report mailed Dec. 23, 2008, for EP Application No. 06016831.7 filed Jan. 25, 1999, seven pages.
European Search Report mailed Jan. 9, 2009, for EP Application No. 06016832.5 filed Jan. 25, 1999, four pages.
European Supplementary Search Report for European Patent Application No. 99904228.6, mailed Feb. 16, 2005.
Extended European Search Report for European Patent Application No. 06016858.0, mailed Dec. 21, 2007.
Extended European Search Report for European Patent Application No. 06016856.4, mailed Mar. 14, 2008.
Final Office Action mailed Dec. 20, 2007, for U.S. Appl. No. 10/927,925, filed Aug. 26, 2004, 25 pages.
Final Office Action mailed Nov. 10, 2008, for U.S. Appl. No. 10/927,925, filed Aug. 26, 2004, 22 pages.
Final Office Action mailed Dec. 24, 2008, for U.S. Appl. No. 11/240,788, filed Sep. 30, 2005, 12 pages.
Final Office Action mailed Mar. 5, 2009, for U.S. Appl. No. 11/228,758, filed Sep. 16, 2005, 15 pages.
Final Office Action mailed Mar. 17, 2009, for U.S. Appl. No. 11/241,839, filed Sep. 30, 2005, 16 pages.
Heap, T. et al. (Oct. 14, 1996). “Towards 3D Hand Tracking Using a Deformable Model,” Proceedings of the 2nd International Conference, Killington, VT, USA, Oct. 14-16, 1996, Automatic Face and Gesture Recognition, IEEE Comput. Soc., pp. 140-145.
International Search Report for PCT/US99/01454, mailed May 14, 1999.
Kahney, L. (Mar. 8, 2004). “Pocket PCs Masquerade as IPods,” available at: http://www.wired.com/gadgets/mac/news/2004/03/62543, last visited Apr. 28, 2008, two pages.
Nirei, K. et al. (Aug. 5, 1996). “Human Hand Tracking from Binocular Image Sequences,” Proceedings of the 1996 IEEE IECON 22nd International Conference, Taipei, Taiwan, Aug. 5-10, 1996, Industrial Electronics, Control, and Instrumentation 1(5):297-302.
Non-Final Office Action mailed Jul. 24, 2007, for U.S. Appl. No. 10/927,925, filed Aug. 26, 2004, 20 pages.
Non-Final Office Action mailed Sep. 21, 2007, for U.S. Appl. No. 11/428,515, filed Jul. 3, 2006, seven pages.
Non-Final Office Action mailed Sep. 24, 2007, for U.S. Appl. No. 11/428,506, filed Jul. 3, 2006, six pages.
Non-Final Office Action mailed Sep. 24, 2007, for U.S. Appl. No. 11/428,521, filed Jul. 3, 2006, six pages.
Non-Final Office Action mailed Nov. 1, 2007, for U.S. Appl. No. 11/240,788, filed Sep. 30, 2005, 20 pages.
Non-Final Office Action mailed Jan. 28, 2008, for U.S. Appl. No. 11/428,522, filed Jul. 3, 2006, seven pages.
Non-Final Office Action mailed Feb. 4, 2008, for U.S. Appl. No. 11/428,515, filed Jul. 3, 2006, six pages.
Non-Final Office Action mailed Apr. 30, 2008, for U.S. Appl. No. 11/240,788, filed Sep. 30, 2005, 12 pages.
Non-Final Office Action mailed May 5, 2008, for U.S. Appl. No. 10/927,925, filed Aug. 26, 2004, 22 pages.
Non-Final Office Action mailed Jul. 9, 2008, for U.S. Appl. No. 11/428,521, filed Jul. 3, 2006, 11 pages.
Non-Final Office Action mailed Sep. 2, 2008, for U.S. Appl. No. 11/428,522, filed Jul. 3, 2006, six pages.
Non-Final Office Action mailed Sep. 15, 2008, for U.S. Appl. No. 11/428,506, filed Jul. 3, 2006, eight pages.
Non-Final Office Action mailed Sep. 17, 2008, for U.S. Appl. No. 11/214,839, filed Sep. 30, 2005, 18 pages.
Non-Final Office Action mailed Oct. 31, 2008, for U.S. Appl. No. 11/428,515, filed Jul. 3, 2006, seven pages.
Non-Final Office Action mailed Feb. 17, 2009, for U.S. Appl. No. 11/428,522, filed Jul. 3, 2006, six pages.
Notice of Allowability mailed Feb. 11, 2009, for U.S. Appl. No. 11/428,521, filed Jul. 3, 2006, five pages.
Pavlovic, V.I. et al. (Jul. 1997). “Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review,” IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7):677-695.
Smith, R. et al. (1996). “Relating Distortion to Performance in Distortion-Oriented Displays,” Proceedings of the 6th Australian Conference on Computer-Human Interaction (OZCHI '96), pp. 6-11.
The Gadgeteer. (Jun. 6, 2003). “Apple iPod (30GB),” available at http://the-gadgeteer.com/review/apple—ipod—30gb—review, last visited Apr. 28, 208, 19 pages.
Westerman, W. (Jan. 1, 1999). “Hand Tracking, Finger Identification, and Chordic Manipulation on a Multi-Touch Surface,” Dissertation, University of Delaware, pp. 1-333.
Final Office Action mailed Jul. 7, 2009, for U.S. Appl. No. 11/048,264, filed Jan. 31, 2005, 14 pages.
Non-Final Office Action mailed Jun. 10, 2009, for U.S. Appl. No. 10/903,964, filed Jul. 30, 2004, 15 pages.
Non-Final Office Action mailed Jun. 10, 2009, for U.S. Appl. No. 11/240,788, filed Sep. 30, 2005, 13 pages.
Notice of Allowability mailed Jul. 10, 2009, for U.S. Appl. No. 11/428,521, filed Jul. 3, 2006, five pages.
Non-Final Office Action mailed Aug. 18, 2009, for U.S. Appl. No. 11/228,758, filed Sep. 16, 2005, 15 pages.
Final Office Action mailed Mar. 19, 2009, for U.S. Appl. No. 11/428,506, filed Jul. 3, 2006, seven pages.
Non-Final Office Action mailed Mar. 18, 2009, for U.S. Appl. No. 11/428,515, filed Jul. 3, 2006, 12 pages.
Non-Final Office Action mailed Apr. 2, 2009, for U.S. Appl. No. 11/428,501, filed Jul. 3, 2006, 11 pages.
Non-Final Office Action mailed Apr. 2, 2009, for U.S. Appl. No. 11/428,503, filed Jul. 3, 2006, 12 pages.
Non-Final Office Action mailed Aug. 25, 2009, for U.S. Appl. No. 11/428,522, filed Jul. 3, 2006, six pages.
Non-Final Office Action mailed Sep. 2, 2009, for U.S. Appl. No. 11/559,736, filed Nov. 14, 2006, 12 pages.
Notice of Allowability mailed Sep. 2, 2009, for U.S. Appl. No. 11/428,506, filed Jul. 3, 2006, five pages.
Notice of Allowability mailed Sep. 3, 2009, for U.S. Appl. No. 11/241,839, filed Sep. 30, 2005, 10 pages.
Non-Final Office Action mailed Oct. 5, 2009, for U.S. Appl. No. 11/559,799, filed Nov. 14, 2006, 14 pages.
Non-Final Office Action mailed Oct. 6, 2009, for U.S. Appl. No. 11/559,763, filed Nov. 14, 2006, 24 pages.
Non-Final Office Action mailed Oct. 14, 2009, for U.S. Appl. No. 11/428,501, filed Jul. 3, 2006, six pages.
Final Office Action mailed Jan. 19, 2011, for U.S. Appl. No. 11/980,721, filed Oct. 31, 2007, nine pages.
Final Office Action mailed Jan. 20, 2011, for U.S. Appl. No. 11/830,757, filed Jul. 30, 2007, 21 pages.
Non-Final Office Action mailed Oct. 29, 2010, for U.S. Appl. No. 11/048,264, filed Jan. 31, 2005, 12 pages.
Final Office Action mailed Nov. 19, 2009, for U.S. Appl. No. 11/428,515, filed Jul. 3, 2006, 14 pages.
Malik, S. et al. (2004). “Visual Touchpad: A Two-Handed Gestural Input Device,”Proceedings of the 6th International Conference on Multimodal Interfaces, State College, PA, Oct. 13-15, 2004, ICMI '04, ACM pp. 289-296.
Non-Final Office Action mailed Oct. 29, 2009, for U.S. Appl. No. 11/559,822, filed Nov. 14, 2006, 11 pages.
Non-Final Office Action mailed Oct. 30, 2009, for U.S. Appl. No. 11/428,503, filed Jul. 3, 2006, nine pages.
Non-Final Office Action mailed Dec. 18, 2009, for U.S. Appl. No.11/048,264, filed Jan. 31, 2005, 11 pages.
Non-Final Office Action mailed Dec. 22, 2009, for U.S. Appl. No.11/559,833, filed Nov. 14, 2006, six pages.
Non-Final Office Action mailed Dec. 24, 2009, for U.S. Appl. No.11/677,958, filed Feb. 22, 2007, six pages.
Non-Final Office Action mailed Jan. 27, 2010, for U.S. Appl. No. 11/428,522, filed Jul. 3, 2006, five pages.
Non-Final Office Action mailed Feb. 3, 2010, for U.S. Appl. No. 11/228,758, filed Sep. 16, 2005, 20 pages.
Non-Final Office Action mailed Mar. 2, 2010, for U.S. Appl. No. 11/240,788, filed Sep. 30, 2005, 13 pages.
Sun Microsystems. (1992). “The Star7 PDA Prototype,” located at <http://www.youtube.com/watch?v=Ahg8OBYixL0, last visited Jan. 15, 2010, seven pages.
Final Office Action mailed Apr. 14, 2010, for U.S. Appl. No. 11/559,736, filed Nov. 14, 2006, 11 pages.
Final Office Action mailed May 12, 2010, for U.S. Appl. No. 11/428,503, filed Jul. 3, 2006, 12 pages.
Final Office Action mailed Jun. 4, 2010, for U.S. Appl. No. 10/903,964, filed Jul. 30, 2004, 22 pages.
Final Office Action mailed Jun. 11, 2010, for U.S. Appl. No. 11/559,833, filed Nov. 14, 2006, eight pages.
Final Office Action mailed Jul. 6, 2010, for U.S. Appl. No. 11/048,264, filed Jan. 31, 2005, 12 pages.
Final Office Action mailed Jul. 19, 2010, for U.S. Appl. No. 11/428,522, filed Jul. 3, 2006, six pages.
Final Office Action mailed Aug. 17, 2010, for U.S. Appl. No. 11/240,788, filed Sep. 30, 2005, nine pages.
Non-Final Office Action mailed May 11, 2010, for U.S. Appl. No. 11/830,788, filed Jul. 30, 2007, eight pages.
Non-Final Office Action mailed Jun. 8, 2010, for U.S. Appl. No. 11/696,693, filed Apr. 4, 2007, 27 pages.
Non-Final Office Action mailed Jun. 8, 2010, for U.S. Appl. No. 11/830,808, filed Jul. 30, 2007, 13 pages.
Non-Final Office Action mailed Jun. 9, 2010, for U.S. Appl. No. 11/830,793, filed Jul. 30, 2007, eight pages.
Non-Final Office Action mailed Jun. 10, 2010, for U.S. Appl. No. 11/830,801, filed Jul. 30, 2007, 10 pages.
Non-Final Office Action mailed Jun. 22, 2010, for U.S. Appl. No. 11/830,815, filed Jul. 30, 2007, 12 pages.
Notice of Allowability (Supplemental) mailed May 12, 2010, for U.S. Appl. No. 11/559,822, filed Nov. 14, 2006, two pages.
Notice of Allowance mailed Mar. 23, 2010, for U.S. Appl. No. 11/428,501, filed Jul. 3, 2006, eight pages.
Notice of Allowance mailed Apr. 26, 2010, for U.S. Appl. No. 11/559,822, filed Nov. 14, 2006, nine pages.
Notice of Allowance mailed Jun. 21, 2010, for U.S. Appl. No. 11/677,958, filed Feb. 22, 2007, eight pages.
Rubine, D. (May 1992). “Combining Gestures and Direct Manipulation,” CHI '92, pp. 659-660.
Bales, J. W. et al. (Apr. 1981). “Marking Parts to Aid Robot Vision,” NASA Technical Paper 1819, 37 pages.
Final Office Action mailed Jul. 20, 2010, for U.S. Appl. No. 11/228,758, filed Sep. 16, 2005, 19 pages.
Final Office Action mailed Oct. 19, 2010, for U.S. Appl. No. 11/559,799, filed Nov. 14, 2006, eight pages.
Final Office Action mailed Oct. 29, 2010, for U.S. Appl. No. 11/559,763, filed Nov. 14, 2006, 15 pages.
Final Office Action mailed Nov. 23, 2010, for U.S. Appl. No. 11/696,693, filed Apr. 4, 2007, 24 pages.
Final Office Action mailed Nov. 23, 2010, for U.S. Appl. No. 11/830,801, filed Jul. 30, 2007, 13 pages.
Final Office Action mailed Nov. 26, 2010, for U.S. Appl. No. 11/830,793, filed Jul. 30, 2007, nine pages.
Final Office Action mailed Dec. 2, 2010, for U.S. Appl. No. 11/830,815, filed Jul. 30, 2007, seven pages.
Final Office Action mailed Dec. 3, 2010, for U.S. Appl. No. 11/830,788, filed Jul. 30, 2007, 15 pages.
Non-Final Office Action mailed Nov. 18, 2010, for U.S. Appl. No. 11/700,636, filed Jan. 30, 2007, eight pages.
Non-Final Office Action mailed Nov. 23, 2010, for U.S. Appl. No. 11/830,808, filed Jul. 30, 2007, 11 pages.
Final Office Action mailed Apr. 21, 2011, for U.S. Appl. No. 11/830,808, filed Jul. 30, 2007, 10 pages.
Final Office Action mailed May 11, 2011, for U.S. Appl. No. 11/048,264, filed Jan. 31, 2005, 12 pages.
Final Office Action mailed May 27, 2011, for U.S. Appl. No. 11/700,636, filed Jan. 30, 2007, nine pages.
Non-Final Office Action mailed Apr. 21, 2011, for U.S. Appl. No. 11/559,763, filed Nov. 14, 2006, seven pages.
Non-Final Office Action mailed Apr. 28, 2011, for U.S. Appl. No. 11/830,781, filed Jul. 30, 2007, 16 pages.
Non-Final Office Action mailed Apr. 29, 2011, for U.S. Appl. No. 11/980,721, filed Oct. 31, 2007, 10 pages.
Non-Final Office Action mailed May 4, 2011, for U.S. Appl. No. 12/118,639, filed May 9, 2008, seven pages.
Non-Final Office Action mailed Jun. 7, 2011, for U.S. Appl. No. 11/878,024, Jul. 20, 2007, 10 pages.
Non-Final Office Action mailed Jun. 28, 2011, for U.S. Appl. No. 12/422,197, filed Apr. 10, 2009, 18 pages.
Non-Final Office Action mailed Jun. 28, 2011, for U.S. Appl. No. 12/422,205, filed Apr. 10, 2009, 13 pages.
Non-Final Office Action mailed Jun. 28, 2011, for U.S. Appl. No. 12/422,212, filed Apr. 10, 2009, 16 pages.
Non-Final Office Action mailed Jun. 29, 2011, for U.S. Appl. No. 12/342,027, filed Dec. 22, 2008, 32 pages.
Non-Final Office Action mailed Jul. 20, 2011, for U.S. Appl. No. 11/830,788, filed Jul. 30, 2007, 12 pages.
Non-Final Office Action mailed Aug. 4, 2011, for U.S. Appl. No. 11/830,793, filed Jul. 30, 2007, 13 pages.
Notification of Reason(s) for Refusal mailed Apr. 25, 2011, for JP Patent Application No. 2008-531106, with English Translation, five pages.
Final Office Action mailed Aug. 10, 2011, for U.S. Appl. No. 11/240,788, filed Sep. 30, 2005, seven pages.
Final Office Action mailed Sep. 27, 2011, for U.S. Appl. No. 11/830,774, filed Jul. 30, 2007, 15 pages.
Final Office Action mailed Sep. 28, 2011, for U.S. Appl. No. 12/479,678, filed Jun. 5, 2009, 13 pages.
Non-Final Office Action mailed Aug. 5, 2011, for U.S. Appl. No. 12/422,222, filed Apr. 10, 2009, 15 pages.
Non-Final Office Action mailed Aug. 5, 2011, for U.S. Appl. No. 12/422,225, filed Apr. 10, 2009, 17 pages.
Non-Final Office Action mailed Sep. 1, 2011, for U.S. Appl. No. 11/830,766, filed Jul. 30, 2007, 29 pages.
Non-Final Office Action mailed Sep. 16, 2011, for U.S. Appl. No. 11/830,757, filed Jul. 30, 2007, 26 pages.
Non-Final Office Action mailed Sep. 23, 2011, for U.S. Appl. No. 12/500,973, filed Jul. 10, 2009, 5 pages.
Non-Final Office Action mailed Sep. 27, 2011, for U.S. Appl. No. 11/700,636, filed Jan. 30, 2007, eight pages.
Non-Final Office Action mailed Sep. 29, 2011, for U.S. Appl. No. 10/903,964, filed Jul. 30, 2004, 17 pages.
Non-Final Office Action mailed Sep. 29, 2011, for U.S. Appl. No. 11/048,264, filed Jan. 31, 2005, 11 pages.
Notice of Allowance mailed Aug. 16, 2011, for U.S. Appl. No. 11/559,763, filed Nov. 14, 2006, nine pages.
Non-Final Office Action mailed Mar. 31, 2011, for U.S. Appl. No. 12/479,573, filed Jun. 5, 2009, 17 pages.
Non-Final Office Action mailed Mar. 31, 2011, for U.S. Appl. No. 12/479,617, filed Jun. 5, 2009, 20 pages.
Non-Final Office Action mailed Mar. 31, 2011, for U.S. Appl. No. 12/479,678, filed Jun. 5, 2009, 18 pages.
Non-Final Office Action mailed Apr. 4, 2011, for U.S. Appl. No. 11/272,868, filed Nov. 15, 2005, nine pages.
Non-Final Office Action mailed Dec. 22, 2011, for U.S. Appl. No. 11/696,693, filed Apr. 4, 2007, 29 pages.
Non-Final Office Action mailed Jan. 20, 2011, for U.S. Appl. No. 11/830,757, filed Jul. 30, 2007, 21 pages.
Non-Final Office Action mailed Feb. 9, 2011, for U.S. Appl. No. 11/240,788, filed Sep. 30, 2005, nine pages.
Non-Final Office Action mailed Feb. 17, 2011, for U.S. Appl. No. 11/852,690, filed Sep. 10, 2007, 10 pages.
Non-Final Office Action mailed Feb. 17, 2011, for U.S. Appl. No. 11/830,766, filed Jul. 30, 2007, 20 pages.
Final Office Action mailed Nov. 17, 2011, for U.S. Appl. No. 11/830,781, filed Jul. 30, 2007, 16 pages.
Final Office Action mailed Nov. 17, 2011, for U.S. Appl. No. 12/479,617, filed Jun. 5, 2009, 18 pages.
Final Office Action mailed Dec. 16, 2011, for U.S. Appl. No. 12/422,212, filed Apr. 10, 2009, 20 pages.
Final Office Action mailed Feb. 3, 2012, for U.S. Appl. No. 12/422,205, filed Apr. 10, 2009, 16 pages.
Final Office Action mailed Feb. 17, 2012, for U.S. Appl. No. 11/830,801, filed Jul. 30, 2007, 14 pages.
Non-Final Office Action mailed Nov. 23, 2011, for U.S. Appl. No. 11/428,515, filed Jul. 3, 2006, eight pages.
Non-Final Office Action mailed Dec. 8, 2011, for U.S. Appl. No. 11/228,758, filed Sep. 16, 2005, 16 pages.
Non-Final Office Action mailed Jan. 19, 2012, for U.S. Appl. No. 11/830,808, filed Jul. 30, 2007, eight pages.
Non-Final Office Action mailed Jan. 30, 2012, for U.S. Appl. No. 11/428,503, filed Jul. 3, 2006, 15 pages.
Final Office Action mailed Mar. 21, 2011, for U.S. Appl. No. 11/832,134, filed Aug. 1, 2007, 33 pages.
Non-Final Office Action mailed Mar. 18, 2011, for U.S. Appl. No. 11/830,774, filed Jul. 30, 2007, 18 pages.
Non-Final Office Action mailed Mar. 21, 2011, for U.S. Appl. No. 11/830,801, filed Jul. 30, 2007, 11 pages.
Westerman, Wayne, et al., “Multi-Touch: A New Tactile 2-D Gesture Interface for Human-Computer Interaction,” Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting, 2001.
Final Office Action mailed Oct. 14, 2011, for U.S. Appl. No. 11/830,801, filed Jul. 30, 2007, 16 pages.
Final Office Action mailed Oct. 19, 2011, for U.S. Appl. No. 12/479,573, filed Jun. 5, 2009, 13 pages.
Non-Final Office Action mailed Oct. 14, 2011, for U.S. Appl. No. 12/434,439, filed May 1, 2009, nine pages.
Non-Final Office Action mailed Oct. 27, 2011, for U.S. Appl. No. 12/139,411, filed Jun. 13, 2008, six pages.
Non-Final Office Action mailed Nov. 8, 2011, for U.S. Appl. No. 12/118,639, filed May 9, 2008, five pages.
Non-Final Office Action mailed Nov. 10, 2011, for U.S. Appl. No. 11/830,815, filed Jul. 30, 2007, 15 pages.
Notice of Allowance mailed Oct. 26, 2011, for U.S. Appl. No. 11/559,763, filed Nov. 14, 2006, nine pages.
Final Office Action mailed on Mar. 22, 2012, for U.S. Appl. No. 10/903,964, filed Jul. 30, 2004, 17 pages.
Final Office Action mailed Mar. 26, 2012, for U.S. Appl. No. 12/118,639, filed May 9, 2008, seven pages.
Non-Final Office Action mailed May 7, 2012, for U.S. Appl. No. 12/118,645, filed May 9, 2008, five pages.
Non-Final Office Action mailed May 9, 2012, for U.S. Appl. No. 12/118,641, filed May 9, 2008, four pages.
European Search Report mailed Jun. 8, 2012, for EP Application No. 12166818.0, filed Jan. 30, 2007, seven pages.
European Search Report mailed Jun. 14, 2012, for EP Application No. 12166820.6, filed Jan. 30, 2007, six pages.
Final Office Action mailed Jun. 7, 2012, for U.S. Appl. No. 11/228,758, filed Sep. 16, 2005, 16 pages.
Non-Final Office Action mailed May 17, 2012, for U.S. Appl. No. 12/118,648, filed May 9, 2008, four pages.
Patent number: 8239784
Patent Publication Number: 20060026535
Inventors: Steve Hotelling (San Jose, CA), Brian Q. Huppi (San Francisco, CA), Joshua A. Strickon (San Jose, CA), Duncan Robert Kerr (San Francisco, CA), Bas Ording (San Francsico, CA), Imran Chaudhri (San Francisco, CA), Greg Christie (San Jose, CA), Jonathan P. Ive (San Francisco, CA)
Application Number: 11/038,590
Current U.S. Class: Scrolling (e.g., Spin Dial) (715/830); Tactile Based Interaction (715/702); Virtual Input Device (e.g., Virtual Keyboard) (715/773); On-screen Window List Or Index (715/783); Window Scrolling (715/784); Scroll Tool (e.g., Scroll Bar) (715/786); Pop-up Control (715/808); Gesture-based (715/863); For A Small Display Screen (e.g., Personal Digital Assistant, Palm-top) (715/864); Touch Panel (345/173); Including Impedance Detection (345/174); Including Optical Detection (345/175); Transparent Substrate Having Light Entrapment Capability (i.e., Waveguides) (345/176); Including Surface Acoustic Detection (345/177); With Alignment Or Calibration Capability (i.e., Parallax Problem) (345/178)