Source: https://patents.google.com/patent/EP2282275B1/en
Timestamp: 2019-12-14 15:23:06
Document Index: 137766918

Matched Legal Cases: ['Application No. 11', 'Application No. 11', 'Application No. 11', 'Application No. 11', 'Application No. 10', 'Application No. 10', 'Application No. 11', 'Application No. 11', 'Application No. 11', 'Application No. 11', 'Application No. 11', 'Application No. 11', 'Application No. 11']

EP2282275B1 - Portable electronic device for photo management - Google Patents
Portable electronic device for photo management Download PDF
EP2282275B1
EP2282275B1 EP10172417.7A EP10172417A EP2282275B1 EP 2282275 B1 EP2282275 B1 EP 2282275B1 EP 10172417 A EP10172417 A EP 10172417A EP 2282275 B1 EP2282275 B1 EP 2282275B1
EP10172417.7A
EP2282275A1 (en
Michael Matas
Gregory N. Christie
Paul D. Marcos
Bas Ording
2006-09-06 Priority to US82476906P priority Critical
2007-01-06 Priority to US88378507P priority
2007-01-07 Priority to US87925307P priority
2007-01-08 Priority to US87946907P priority
2007-06-29 Priority to US94711807P priority
2007-06-29 Priority to US93799307P priority
2007-08-30 Priority to US11/848,210 priority patent/US8106856B2/en
2007-08-31 Priority to EP07814633A priority patent/EP2059868B1/en
2007-08-31 Application filed by Apple Inc filed Critical Apple Inc
2011-02-09 Publication of EP2282275A1 publication Critical patent/EP2282275A1/en
2011-06-16 First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=38786837&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=EP2282275(B1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
2013-12-11 Publication of EP2282275B1 publication Critical patent/EP2282275B1/en
238000000034 methods Methods 0 description 44
230000003287 optical Effects 0 description 13
230000000007 visual effect Effects 0 description 8
238000009877 rendering Methods 0 description 4
H04N1/00411—Display of information to the user, e.g. menus the display also being used for user input, e.g. touch screen
H04N1/00442—Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails
H04N1/00453—Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails arranged in a two dimensional array
H04N1/00461—Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet marking or otherwise tagging one or more displayed image, e.g. for selective reproduction
H04N2201/325—Modified version of the image, e.g. part of the image, image reduced in size or resolution, thumbnail or screennail
H04N2201/3273—Display
The disclosed embodiments relate generally to portable electronic devices, and more particularly, to portable devices for photo management, such as digital photographing, photo editing, and emailing photos.
As portable electronic devices become more compact and capable of performing functions, it has become a significant challenge to design a user interface that allows users to easily interact with such a multifunction device. This challenge is more significant for handheld portable electronic devices, which have much smaller screens than desktop or laptop computers. This situation is unfortunate because a user interface is the gateway through which a user receives information and a device receives user actions or behaviors, including user attempts to access the portable electronic device's features, tools, and functions.
Some portable devices (e.g., mobile telephones, sometimes called mobile phones, cell phones, cellular telephones, and the like) have resorted to adding more push buttons, increasing the density of push buttons, overloading the functions of push buttons, or using complex menu systems to allow a user to access, store, and manipulate data. These approaches often result in complicated key sequences and menu hierarchies that must be memorized by the user.
Many conventional user interfaces, such as those that include physical push buttons, are also inflexible because a physical push button may prevent a user interface from being configured and/or adapted by either an application running on the portable electronic device or by users. When coupled with the time consuming requirement to memorize multiple key sequences and menu hierarchies, and the difficulty in activating a desired push button, such inflexibility is frustrating to most users.
For example, cell phones with a built-in digital camera have been on the market for some time. But existing cell phones are difficult to use for even basic photo-related operations such as displaying, deleting and sending a photo because of limitations with the cell phones' user interface.
WO 2005/103863 discloses a portable electronic device with a phone, a photo manager, a touch screen display adapted to provide control of both the phone and the photo manager, and one or more accelerometers to detect an orientation of the device, displaying images or thumbnails of images corresponding to photographic images and alters a displayed item in response to detecting of a change in the orientation of the device by the one or more accelerometers.
FR-2830093 discloses displaying an array of thumbnails representing applications on a touch sensible display. A function associated with an icon is executed by touching the location on the touch sensitive display at the position where the icon is located. A substantially horizontal movement of a user gesture leads to scroll through the array of thumbnails.
WO 03-081458 discloses a browsing application in combination with web content, text documents or spreadsheet applications in combination with a touch screen display wherein a substantially horizontal movement leads to replace a first display content with a different display content which may include photographic images.
GB-2420260 discloses photo management within a digital camera with a jog or, alternatively, a touch panel, including thumbnails, thumbnail selection, image full screen presentation and replacement functions.
EP-1124175 discloses a portable devices having a touch screen user interface which upon detection of a change in orientation rotates a photographic image on the touch screen display.
Accordingly, there is a need for portable multifunction devices with more transparent and intuitive user interfaces for photo management.
The above deficiencies and other problems associated with user interfaces for portable devices are reduced or eliminated by the disclosed portable multifunction device. In some embodiments, the portable electronic device has a touch-sensitive display (also known as a "touch screen" or "touch screen display") with a graphical user interface (GUI), one or more processors, memory and one or more modules, programs or sets of instructions stored in the memory for performing multiple functions. In some embodiments, the user interacts with the GUI primarily through finger contacts and gestures on the touch-sensitive display. Instructions for performing photo management may be included in a computer program product configured for execution by one or more processors.
The present invention is defined by appended claim 1. Further aspects of the invention are defined by dependent claims 2-16.
Thus, the invention provides a transparent and intuitive user interface for managing photos on a portable electronic device with a touch screen display
Figure 1 is a block diagram illustrating a portable electronic device with a touch-sensitive display in accordance with some embodiments.
Figure 2 illustrates a portable electronic device having a touch screen in accordance with some embodiments.
Figure 3 illustrates an exemplary user interface for unlocking a portable electronic device in accordance with some embodiments.
Figure 4 illustrates an exemplary user interface for a menu of applications on a portable electronic device in accordance with some embodiments.
Figure 5 illustrates an exemplary user interface for a camera in accordance with some embodiments.
Figure 6 illustrates an exemplary user interface for a camera roll in accordance with some embodiments.
Figures 7A through 7C illustrate an exemplary user interface for viewing and manipulating images in accordance with some embodiments.
Figure 8 illustrates an exemplary user interface for viewing photo albums in accordance with some embodiments.
Figure 9 illustrates an exemplary user interface for setting user preferences in accordance with some embodiments.
Figure 10 illustrates an exemplary user interface for viewing an album in accordance with some embodiments.
Figure 11 illustrates an exemplary user interface for viewing images in an album in accordance with some embodiments.
Figure 12 illustrates an exemplary user interface for selecting a use for an image in an album in accordance with some embodiments.
Figures 13A through 13G illustrate an exemplary user interface for incorporating an image in an email message template in accordance with some embodiments.
Figures 14A and 14B illustrate an exemplary user interface for assigning an image to a contact in the user's contact list in accordance with some embodiments.
Figure 15 illustrates an exemplary user interface for incorporating an image in the user's wallpaper in accordance with some embodiments.
Figure 16 is a flowchart illustrating a process for displaying thumbnail images on a touch screen in accordance with some embodiments.
Figure 17 is a flowchart illustrating a process for performing operations in response to user contact with the touch screen in accordance with some embodiments.
Figure 18 is a flowchart illustrating a process for deleting an image in response to a user contact with the touch screen in accordance with some embodiments.
Figure 19 is a flowchart illustrating a process for displaying multiple photo albums on the touch screen in accordance with some embodiments.
Figure 20 is a flowchart illustrating a process for performing additional operations upon a user selection of an additional options icon in accordance with some embodiments.
Figure 21 is a flowchart illustrating an animated process for rendering an email service interface that includes a user selected image in accordance with some embodiments.
Figure 22 is a flowchart illustrating a process for assigning an image to a user selected contact in the user's contact list in accordance with some embodiments.
Figures 23A-23H illustrate an exemplary user interface for viewing digital objects in a set of digital objects in accordance with some embodiments.
Figure 24 is a flowchart illustrating a process for viewing digital objects in a set of digital objects in accordance with some embodiments.
Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the invention. However, it will be apparent to one skilled in the art that the invention may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.
Embodiments of a portable electronic device, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the portable electronic device is a portable communications device such as a mobile telephone that also contains other functions, such as PDA and/or music player functions.
The user interface may include a physical click wheel in addition to a touch screen or a virtual click wheel displayed on the touch screen. A click wheel is a physical user-interface device that may provide navigation commands based on an angular displacement of the wheel or a point of contact with the wheel by a user of the portable electronic device. A click wheel may also be used to provide a user command corresponding to selection of one or more items, for example, when the user of the portable electronic device presses down on at least a portion of the wheel or the center of the wheel. Alternatively, breaking contact with a click wheel image on a touch screen surface may indicate a user command corresponding to selection. For simplicity, in the discussion that follows, a portable electronic device that includes a touch screen is used as an exemplary embodiment. It should be understood, however, that some of the user interfaces and associated processes may be applied to other devices, such as personal computers and laptop computers, which may include one or more other physical user-interface devices, such as a physical click wheel, a physical keyboard, a mouse and/or a joystick.
In addition to photo management, the device may support a variety of other applications, such as a telephone application, a video conferencing application, an e-mail application, an instant messaging application, a blogging application, a web browsing application, a digital music player application, and/or a digital video player application.
The various applications that may be executed on the portable electronic device may use at least one common physical user-interface device, such as the touch screen. One or more functions of the touch screen as well as corresponding information displayed on the portable electronic device may be adjusted and/or varied from one application to the next and/or within a respective application. In this way, a common physical architecture (such as the touch screen) of the portable electronic device may support the variety of applications with user interfaces that are intuitive and transparent.
The user interfaces may include one or more soft keyboard embodiments. The soft keyboard embodiments may include standard (QWERTY) and/or non-standard configurations of symbols on the displayed icons of the keyboard, such as those described in U.S. Patent Application No. 11/459,606 , "Keyboards For Portable Electronic Devices," filed July 24, 2006, and U.S. Patent Application No. 11/459,615 , "Touch Screen Keyboards For Portable Electronic Devices," filed July 24, 2006, the contents of which are hereby incorporated by reference. The keyboard embodiments may include a reduced number of icons (or soft keys) relative to the number of keys in existing physical keyboards, such as that for a typewriter. This may make it easier for users to select one or more icons in the keyboard, and thus, one or more corresponding symbols. The keyboard embodiments may be adaptive. For example, displayed icons may be modified in accordance with user actions, such as selecting one or more icons and/or one or more corresponding symbols. One or more applications on the portable electronic device may utilize common and/or different keyboard embodiments. Thus, the keyboard embodiment used may be tailored to at least some of the applications. In some embodiments, one or more keyboard embodiments may be tailored to a respective user. For example, based on a word usage history (lexicography, slang, individual usage) of the respective user. Some of the keyboard embodiments may be adjusted to reduce a probability of a user error when selecting one or more icons, and thus one or more symbols, when using the soft keyboard embodiments.
Attention is now directed towards embodiments of the portable electronic device. Figure 1 is a block diagram illustrating a portable electronic device 100 with a touch-sensitive display 112 in accordance with some embodiments. The touch-sensitive display 112 is sometimes called a "touch screen" for convenience. The device 100 may include a memory 102 (which may include one or more computer readable storage mediums), a memory controller 122, one or more processing units (CPU's) 120, a peripherals interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input/output (I/O) subsystem 106, other input or control devices 116, and an external port 124. The device 100 may include one or more optical sensors 164. These components may communicate over one or more communication buses or signal lines 103.
It should be appreciated that the portable electronic device 100 is only one example of a portable electronic device 100, and that the portable electronic device 100 may have more or fewer components than shown, may combine two or more components, or a may have a different configuration or arrangement of the components. The various components shown in Figure 1 may be implemented in hardware, software or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
Memory 102 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Access to memory 102 by other components of the portable electronic device 100, such as the CPU 120 and the peripherals interface 118, may be controlled by the memory controller 122.
The peripherals interface 118 couples the input and output peripherals of the portable electronic device to the CPU 120 and memory 102. The one or more processors 120 run or execute various software programs and/or sets of instructions stored in memory 102 to perform various functions for the portable electronic device 100 and to process data.
In some embodiments, the peripherals interface 118, the CPU 120, and the memory controller 122 may be implemented on a single chip, such as a chip 104. In some other embodiments, they may be implemented on separate chips.
The RF (radio frequency) circuitry 108 receives and sends RF signals, also called electromagnetic signals. The RF circuitry 108 converts electrical signals to/from electromagnetic signals and communicates with communications networks and other communications devices via the electromagnetic signals. The RF circuitry 108 may include well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, and so forth. The RF circuitry 108 may communicate with networks, such as the Internet, also referred to as the World Wide Web (WWW), an intranet and/or a wireless network, such as a cellular telephone network, a wireless local area network (LAN) and/or a metropolitan area network (MAN), and other devices by wireless communication. The wireless communication may use any of a plurality of communications standards, protocols and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), wideband code division multiple access (W-CDMA), code division multiple access (CDMA), time division multiple access (TDMA), Bluetooth, Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n), voice over Internet Protocol (VoIP), Wi-MAX, a protocol for email, instant messaging (IM), and/or Short Message Service (SMS)), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.
The audio circuitry 110, the speaker 111, and the microphone 113 provide an audio interface between a user and the portable electronic device 100. The audio circuitry 110 receives audio data from the peripherals interface 118, converts the audio data to an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal to human-audible sound waves. The audio circuitry 110 also receives electrical signals converted by the microphone 113 from sound waves. The audio circuitry 110 converts the electrical signal to audio data and transmits the audio data to the peripherals interface 118 for processing. Audio data may be retrieved from and/or transmitted to memory 102 and/or the RF circuitry 108 by the peripherals interface 118. In some embodiments, the audio circuitry 110 also includes a headset jack (not shown). The headset jack provides an interface between the audio circuitry 110 and removable audio input/output peripherals, such as output-only headphones or a headset with both output (e.g., a headphone for one or both ears) and input (e.g., a microphone).
The I/O subsystem 106 couples input/output peripherals on the portable electronic device 100, such as the display system 112 and other input/control devices 116, to the peripherals interface 118. The I/O subsystem 106 may include a display controller 156 and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive/send electrical signals from/to other input or control devices 116. The other input/control devices 116 may include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, and so forth. In some alternate embodiments, input controller(s) 160 may be coupled to any (or none) of the following: a keyboard, infrared port, USB port, and a pointer device such as a mouse. The one or more buttons (e.g., 208, Figure 2) may include an up/down button for volume control of the speaker 111 and/or the microphone 113. The one or more buttons may include a push button (e.g., 206, Figure 2). A quick press of the push button may disengage a lock of the touch screen 112 or begin a process that uses gestures on the touch screen to unlock the portable electronic device, as described in U.S. Patent Application No. 11/322,549 , "Unlocking a Device by Performing Gestures on an Unlock Image," filed December 23, 2005, which is hereby incorporated by reference. A longer press of the push button (e.g., 206) may turn power to the portable electronic device 100 on or off. The user may be able to customize a functionality of one or more of the buttons. The touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.
The touch-sensitive display system 112 provides an input interface and an output interface between the portable electronic device and a user. The display controller 156 receives and/or sends electrical signals from/to the display system 112. The display system 112 displays visual output to the user. The visual output may include graphics, text, icons, video, and any combination thereof (collectively termed "graphics"). In some embodiments, some or all of the visual output may correspond to user-interface objects, further details of which are described below.
A touch screen in display system 112 is a touch-sensitive surface that accepts input from the user based on haptic and/or tactile contact. The display system 112 and the display controller 156 (along with any associated modules and/or sets of instructions in memory 102) detect contact (and any movement or breaking of the contact) on the display system 112 and converts the detected contact into interaction with user-interface objects (e.g., one or more soft keys, icons, web pages or images) that are displayed on the touch screen. In an exemplary embodiment, a point of contact between a touch screen in the display system 112 and the user corresponds to a fmger of the user.
The touch screen in the display system 112 may use LCD (liquid crystal display) technology, or LPD (light emitting polymer display) technology, although other display technologies may be used in other embodiments. The touch screen in the display system 112 and the display controller 156 may detect contact and any movement or breaking thereof using any of a plurality of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with a touch screen in the display system 112. A touch-sensitive display in some embodiments of the display system 112 may be analogous to the multi-touch sensitive tablets described in the following U.S. Patents: 6,323,846 (Westerman et al. ), 6,570,557 (Westerman et al ,), and/or 6,677,932 (Westerman ), and/or U.S. Patent Publication 2002/0015024A1 , each of which is hereby incorporated by reference. However, a touch screen in the display system 112 displays visual output from the portable electronic device 100, whereas touch sensitive tablets do not provide visual output. The touch screen in the display system 112 may have a resolution in excess of 100 dpi. In an exemplary embodiment, the touch screen in the display system has a resolution of approximately 168 dpi. The user may make contact with the touch screen in the display system 112 using any suitable object or appendage, such as a stylus, a finger, and so forth. In some embodiments, the user interface is designed to work primarily with finger-based contacts and gestures, which are much less precise than stylus-based input due to the larger area of contact of a finger on the touch screen. In some embodiments, the portable electronic device translates the rough finger-based input into a precise pointer/cursor position or command for performing the actions desired by the user.
A touch-sensitive display in some embodiments of the display system 112 may be as described in the following applications: (1) U.S. Patent Application No. 11/381,313 , "Multipoint Touch Surface Controller," filed on May 2, 2006; (2) U.S. Patent Application No. 10/840,862 , "Multipoint Touchscreen," filed on May 6, 2004; (3) U.S. Patent Application No. 10/903,964 , "Gestures For Touch Sensitive Input Devices," filed on July 30, 2004; (4) U.S. Patent Application No. 11/048,264 , "Gestures For Touch Sensitive Input Devices," filed on January 31, 2005; (5) U.S. Patent Application No. 11/038,590 , "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices," filed on January 18, 2005; (6) U.S. Patent Application No. 11/228,758 , "Virtual Input Device Placement On A Touch Screen User Interface," filed on September 16, 2005; (7) U.S. Patent Application No. 11/228,700 , "Operation Of A Computer With A Touch Screen Interface," filed on September 16, 2005; (8) U.S. Patent Application No. 11/228,737 , "Activating Virtual Keys Of A TouchScreen Virtual Keyboard," filed on September 16, 2005; and (9) U.S. Patent Application No. 11/367,749 , "Multi-Functional Hand-Held Device," filed on March 3, 2006. All of these applications are incorporated by reference herein.
In some embodiments, in addition to the touch screen, the portable electronic device 100 may include a touchpad (not shown) for activating or deactivating particular functions. In some embodiments, the touchpad is a touch-sensitive area of the portable electronic device that, unlike the touch screen, does not display visual output. The touchpad may be a touch-sensitive surface that is separate from the touch screen in the display system 112 or an extension of the touch-sensitive surface formed by the touch screen.
In some embodiments, the portable electronic device 100 may include a physical or virtual click wheel as an input control device 116. A user may navigate among and interact with one or more graphical objects (henceforth referred to as icons) displayed in the display system 112 by rotating the click wheel or by moving a point of contact with the click wheel (e.g., where the amount of movement of the point of contact is measured by its angular displacement with respect to a center point of the click wheel). The click wheel may also be used to select one or more of the displayed icons. For example, the user may press down on at least a portion of the click wheel or an associated button. User commands and navigation commands provided by the user via the click wheel may be processed by an input controller 160 as well as one or more of the modules and/or sets of instructions in memory 102. For a virtual click wheel, the click wheel and click wheel controller may be part of the display system 112 and the display controller 156, respectively. For a virtual click wheel, the click wheel may be either an opaque or semitransparent object that appears and disappears on the touch screen display in response to user interaction with the device. In some embodiments, a virtual click wheel is displayed on the touch screen of a portable multifunction device and operated by user contact with the touch screen.
The device 100 also includes a power system 162 for powering the various components. The power system 162 may include a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)) and any other components associated with the generation, management and distribution of power in portable electronic devices.
The device 100 may also include one or more optical sensors 164. Figure 1 shows an optical sensor coupled to an optical sensor controller 158 in I/O subsystem 106. The optical sensor 164 may include charge-coupled device (CCD) or complementary metal-oxide semiconductor (CMOS) phototransistors. The optical sensor 164 receives light from the environment, projected through one or more lens, and converts the light to data representing an image. In conjunction with an imaging module 143, the optical sensor 164 may capture still images or video. In some embodiments, an optical sensor is located on the back of the portable electronic device 100, opposite the touch screen display 112 on the front of the portable electronic device, so that the touch screen display may be used as a viewfinder for either still and/or video image acquisition. In some embodiments, an optical sensor is located on the front of the portable electronic device so that the user's image may be obtained for videoconferencing while the user views the other video conference participants on the touch screen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and the sensor in the portable electronic device housing) so that a single optical sensor 164 may be used along with the touch screen display for both video conferencing and still and/or video image acquisition.
The device 100 may also include one or more proximity sensors 166. Figure 1 shows a proximity sensor 166 coupled to the peripherals interface 118. Alternately, the proximity sensor 166 may be coupled to an input controller 160 in the I/O subsystem 106. The proximity sensor 166 may perform as described in U.S. Patent Application Nos. 11/241,839 , "Proximity Detector In Handheld Device," filed September 30, 2005, and 11/240,788 , "Proximity Detector In Handheld Device," filed September 30, 2005, which are hereby incorporated by reference. In some embodiments, the proximity sensor turns off and disables the touch screen 112 when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call). In some embodiments, the proximity sensor keeps the screen off when the portable electronic device is in the user's pocket, purse, or other dark area to prevent unnecessary battery drainage when the portable electronic device is a locked state.
In some embodiments, the software components stored in memory 102 may include an operating system 126, a communication module (or set of instructions) 128, a contact/motion module (or set of instructions) 130, a graphics module (or set of instructions) 132, a text input module (or set of instructions) 134, a Global Positioning System (GPS) module (or set of instructions) 135, and applications (or set of instructions) 136.
The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and/or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.
The communication module 128 facilitates communication with other devices over one or more external ports 124 and also includes various software components for handling data received by the RF circuitry 108 and/or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FIREWIRE, etc.) is adapted for coupling directly to other devices or indirectly over a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as, or similar to and/or compatible with the 30-pin connector used on iPod (trademark of Apple Computer, Inc.) devices.
The contact/motion module 130 may detect contact with the touch screen in the display system 112 (in conjunction with the display controller 156) and other touch sensitive devices (e.g., a touchpad or physical click wheel). The contact/motion module 130 includes various software components for performing various operations related to detection of contact, such as determining if contact has occurred, determining if there is movement of the contact and tracking the movement across the touch screen in the display system 112, and determining if the contact has been broken (i.e., if the contact has ceased). Determining movement of the point of contact may include determining speed (magnitude), velocity (magnitude and direction), and/or an acceleration (a change in magnitude and/or direction) of the point of contact. These operations may be applied to single contacts (e.g., one finger contacts) or to multiple simultaneous contacts (e.g., "multitouch"/multiple finger contacts). In some embodiments, the contact/motion module 130 and the display controller 156 also detects contact on a touchpad. In some embodiments, the contact/motion module 130 and the controller 160 detects contact on a click wheel.
The graphics module 132 includes various known software components for rendering and displaying graphics on the display system 112, including components for changing the intensity of graphics that are displayed. As used herein, the term "graphics" includes any object that can be displayed to a user, including without limitation text, web pages, icons (such as user-interface objects including soft keys), digital images, videos, animations and the like.
The text input module 134, which may be a component of graphics module 132, provides soft keyboards for entering text in various applications (e.g., contacts 137, email 140, IM 141, blogging 142, browser 147, and any other application that needs text input).
The GPS module 135 determines the location of the portable electronic device and provides this information for use in various applications (e.g., to telephone 138 for use in location-based dialing, to camera 143 and/or blogger 142 as picture/video metadata, and to applications that provide location-based services such as weather widgets, local yellow page widgets, and map/navigation widgets).
The applications 136 may include the following modules (or sets of instructions), or a subset or superset thereof:
a contacts module 137 (sometimes called an address book or contact list);
a telephone module 138;
a video conferencing module 139;
an e-mail client module 140;
an instant messaging (IM) module 141;
a blogging module 142;
a camera module 143 for still and/or video images;
an image management module 144;
a video player module 145;
a music player module 146;
a browser module 147;
a calendar module 148;
widget modules 149, which may include weather widget 149-1, stocks widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets obtained by the user, as well as user-created widgets 149-6;
widget creator module 150 for making user-created widgets 149-6; and/or
search module 151.
Examples of other applications 136 that may be stored in memory 102 include memo pad and other word processing applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.
In conjunction with display system 112, display controlled 156, optical sensor(s) 164, optical sensor controller 158, contact module 130, graphics module 132, and image management module 144, the camera module 143 may be used to capture still images or video (including a video stream) and store them into memory 102, browse the still images or videos, modify characteristics of a still image or video, or delete a still image or video from memory 102. Embodiments of user interfaces and associated processes using camera module 143 are described further below.
In conjunction with display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 may be used to arrange, modify or otherwise manipulate, label, delete, present (e.g., in a digital slide show or album), and store still and/or video images. Embodiments of user interfaces and associated processes using image management module 144 are described further below.
Note that the above identified modules and applications (including the camera module 143 and the image management module 144) correspond to a set of instructions for performing one or more functions described above. These modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures or modules, and thus various subsets of these modules may be combined or otherwise re-arranged in various embodiments. In some embodiments, memory 102 may store a subset of the modules and data structures identified above. Furthermore, memory 102 may store additional modules and data structures not described above.
In some embodiments, the portable electronic device 100 is a device where operation of a predefined set of functions on the portable electronic device is performed exclusively through a touch screen in the display system 112 and/or a touchpad. By using a touch screen and/or a touchpad as the primary input/control device for operation of the portable electronic device 100, the number of physical input/control devices (such as push buttons, dials, and the like) on the portable electronic device 100 may be reduced.
The predefined set of functions that may be performed exclusively through a touch screen and/or a touchpad include navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the portable electronic device 100 to a main, home, or root menu from any user interface that may be displayed on the portable electronic device 100. In such embodiments, the touchpad may be referred to as a "menu button." In some other embodiments, the menu button may be a physical push button or other physical input/control device instead of a touchpad.
Figure 2 illustrates a portable electronic device 100 having a touch screen 112 in accordance with some embodiments. The touch screen may display one or more graphics. In this embodiment, as well as others described below, a user may select one or more of the graphics by making contact or touching the graphics, for example, with one or more fingers 202 (not drawn to scale in the figure) or a stylus (not shown in the figure). In some embodiments, selection of one or more graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the contact may include a gesture, such as one or more taps, one or more swipes (from left to right, right to left, upward and/or downward and/or a rolling of a finger (from right to left, left to right, upward and/or downward) that has made contact with the portable electronic device 100. In some embodiments, inadvertent contact with a graphic may not select the graphic. For example, a swipe gesture with that sweeps over an application icon may not select the corresponding application when the gesture corresponding to selection is a tap. In other words, the portable electronic device 100 interprets the meaning of a gesture and acts accordingly after considering which application or module is in use at the moment.
The device 100 may also include one or more physical buttons, such as "home" or menu button 204. As described previously, the menu button 204 may be used to navigate to any application 136 in a set of applications that may be executed on the portable electronic device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI in touch screen 112.
In one embodiment, the portable electronic device 100 includes a touch screen 112, a menu button 204, a push button 206 for powering the portable electronic device on/off and locking the portable electronic device, and volume adjustment button(s) 208. The push button 206 may be used to turn the power on/off on the portable electronic device by depressing the button and holding the button in the depressed state for a predefined time interval; to lock the portable electronic device by depressing the button and releasing the button before the predefined time interval has elapsed; and/or to unlock the portable electronic device or initiate an unlock process. In an alternative embodiment, the portable electronic device 100 also may accept verbal input for activation or deactivation of some functions through the microphone 113.
Attention is now directed towards embodiments of user interfaces ("UI") and associated processes that may be implemented on a portable electronic device 100.
Figure 3 illustrates an exemplary user interface for unlocking a portable electronic device in accordance with some embodiments. In some embodiments, user interface 300 includes the following elements, or a subset or superset thereof:
Unlock image 302 that is moved with a finger gesture to unlock the portable electronic device;
Arrow 304 that provides a visual cue to the unlock gesture;
Channel 306 that provides additional cues to the unlock gesture;
Time 308;
Day 310;
Date 312; and
Wallpaper image 314.
In some embodiments, the portable electronic device detects contact with the touch-sensitive display (e.g., a user's finger making contact on or near the unlock image 302) while the portable electronic device is in a user-interface lock state. The device moves the unlock image 302 in accordance with the contact. The device transitions to a user-interface unlock state if the detected contact corresponds to a predefined gesture, such as moving the unlock image across channel 306. Conversely, the portable electronic device maintains the user-interface lock state if the detected contact does not correspond to the predefined gesture. As noted above, processes that use gestures on the touch screen to unlock the portable electronic device are described in U.S. Patent Application 11/322,549 , "Unlocking a Device by Performing Gestures on an Unlock Image," filed December 23, 2005, which is hereby incorporated by reference.
Figure 4 illustrates an exemplary user interface for a menu of applications on a portable electronic device in accordance with some embodiments. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:
Signal strength indicator 402 for wireless communication;
Tray 408 with icons for frequently used applications, such as one or more of the following:
○ Phone 138;
○ E-mail client 140, which may include an indicator 410 of the number of unread e-mails;
○ Browser 147; and
○ Music player 146; and
Icons for other applications, such as one or more of the following:
○ IM 141;
○ Image management 144;
○ Camera 143;
○ Video player 145;
○ Weather 149-1;
○ Stocks 149-2;
○ Blog 142;
○ Calendar 148;
○ Calculator 149-3;
○ Alarm clock 149-4;
○ Dictionary 149-5; and
○ User-created widget 149-6.
In some embodiments, UI 400 displays all of the available applications 136 on one screen so that there is no need to scroll through a list of applications (e.g., via a scroll bar). In some embodiments, as the number of applications increase, the icons corresponding to the applications may decrease in size so that all applications may be displayed on a single screen without scrolling. In some embodiments, having all applications on one screen and a menu button enables a user to access any desired application with at most two inputs, such as activating the menu button 204 and then activating the desired application (e.g., by a tap or other finger gesture on the icon corresponding to the application).
In some embodiments, UI 400 provides integrated access to both widget-based applications and non-widget-based applications. In some embodiments, all of the widgets, whether user-created or not, are displayed in UI 400. In other embodiments, activating the icon for user-created widget 149-6 may lead to another UI (not shown) that contains the user-created widgets or icons corresponding to the user-created widgets.
In some embodiments, a user may rearrange the icons in UI 400, e.g., using processes described in U.S. Patent Application No. 11/459,602 , "Portable Electronic Device With Interface Reconfiguration Mode," filed July 24, 2006, which is hereby incorporated by reference. For example, a user may move application icons in and out of tray 408 using finger gestures on or near corresponding icons displayed on the touch screen 112.
Figure 5 illustrates an exemplary user interface for a camera in accordance with some embodiments. In some embodiments, user interface 500 includes the following elements; or a subset or superset thereof:
Viewfinder 502;
Camera roll 504 that manages images and/or videos taken with the camera;
Shutter 506 for taking still images;
Record button 508 for starting and stopping video recording;
Timer 510 for taking an image or recording a video after a predefined time delay; and
Image 512 that appears (e.g., via the animation illustrated schematically in Figure 5) to be added to camera roll 504 when it is obtained.
Figure 6 illustrates an exemplary user interface for a virtual camera roll in accordance with some embodiments. The portable electronic device displays the user interface after a user finger gesture 514 on the camera roll icon 504 in Figure 5. In some embodiments, the finger gesture is a momentary, substantially single-position contact with the touch screen, while in other embodiments other finger gestures may be used. In some embodiments, user interface 600 includes the following elements, or a subset or superset thereof:
402, 404, and 406, as described above;
Thumbnail images 602 of images and/or videos obtained by camera 143;
Camera icon 604 that when activated (e.g., by a finger gesture on the icon) initiates transfer to the camera UI (e.g., UI 500);
Figure 16 is a flowchart illustrating a process for displaying thumbnail images on a touch screen in accordance with some embodiments. Upon detecting the finger gesture 514 (1602), the portable electronic device identifies a set of thumbnail images in the virtual camera roll (1604) and displays the thumbnail images on the touch screen (1606). In some embodiments, the thumbnail images are displayed in a 2-D array (Figure 6). In some other embodiments, the thumbnail images are displayed in a vertical column or a horizontal row. In some embodiments, a thumbnail image may have a description including a name, a file size, and a timestamp indicating when the image was created. In some embodiments, the thumbnail images of videos have a unique appearance that is visually distinguishable from the other still images. The portable electronic device displays the camera icon 604 at the bottom of the touch screen (1608) and starts monitoring next user contact with the touch screen (1610).
In some embodiments, the user may scroll through the thumbnail images 602 using vertically upward/downward finger gestures 606 on the touch screen (1612). Upon detecting such a finger gesture (e.g., a vertical finger swipe), the portable electronic device scrolls the set of thumbnail images accordingly (1618). In some embodiments, the scrolling gesture is independent of a horizontal position of the user contact with the touch screen display. In some embodiments, the scrolling gesture is substantially independent of a horizontal position of the user contact with the touch screen display (e.g., one or more side regions of the touch screen display may be reserved for other functions, such as functions corresponding to icons, soft keys or application navigation functions, and not available for the scroll gesture). In some embodiments, in response to a stationary gesture on a particular thumbnail image (1614), e.g., a finger tap 608 on the thumbnail image 602-11, the portable electronic device initiates a process of generating an enlarged display of the corresponding image (e.g., UI 700A) on the touch screen. A more detailed description of this process is provided below in connection with Figures 7 and 17. In some embodiments, upon detecting a user's finger gesture on the camera icon 604 (1616), the portable electronic device brings back the camera UI 500 as shown in Figure 5.
Figures 7A through 7C illustrate an exemplary user interface for viewing and manipulating images in accordance with some embodiments. Note that one skilled in the art would understand that the term "image" in the present application covers both still images and video streams.
In some embodiments, user interface 700A includes the following elements, or a subset or superset thereof:
402, 404, 406, and 604, as described above;
Camera roll icon 702 that when activated (e.g., by a finger gesture on the icon) initiates transfer to the camera roll UI (e.g., UI 600);
Image 704;
Additional options icon 706 that when activated (e.g., by a finger gesture on the icon) initiates transfer to a UI with additional options for use of image 704 (e.g., UI 1200, Figure 12));
Previous image icon 708 that when activated (e.g., by a finger gesture on the icon) initiates display of the previous image in the virtual camera roll (e.g., 602-10);
Play icon 710 that when activated (e.g., by a finger gesture on the icon) initiates a slide show of the images in the virtual camera roll;
Next image icon 712 that when activated (e.g., by a finger gesture on the icon) initiates display of the next image in the virtual camera roll (e.g., 602-12); and
Delete symbol icon 714 that when activated (e.g., by a finger gesture on the icon) initiates display of a UI to confirm that the user wants to delete image 704 (e.g. UI 700B, Figure 7B).
Figure 17 is a flowchart illustrating a process for performing operations in response to user contact with the touch screen in accordance with some embodiments. After detecting a user selection of a thumbnail image (1702), the portable electronic device identifies an image associated with the thumbnail image (1704). Generally, this identified image is larger than the thumbnail image. In some embodiments, the thumbnail image is a sub-sampled version of the larger image. As shown in Figure 7A, the large image is displayed on the touch screen in replacement of all the thumbnail images (1706). The portable electronic device displays various icons at predefined locations on the touch screen (1708) and waits for next user contact with the touch screen (1710).
In some embodiments, as shown in Figure 7A, the portable electronic device performs the same operation(s) in response to different user contacts. In some embodiments, a user can browse images in the virtual camera roll through three different gestures: (i) a finger gesture on the previous/next image icon 708/712 (1716), (ii) a user image navigation gesture by a finger tap 715/718 adjacent to the left/right edge of the touch screen (1714), or (iii) a leftward/rightward horizontal finger swipe gesture 720 on the touch screen (1712). Upon detecting any of these user gestures, the portable electronic device replaces the image on the touch screen with the previous/next one in the virtual camera roll (1724). In some embodiments, this replacement is an animated process of moving the current image out of the touch screen to the right/left side and moving the previous/next image into the touch screen from the left/right side. With multiple means to perform the same task, the portable electronic device allows a user to choose whichever the user prefers, thereby making the photo management simpler and more intuitive. In some embodiments, the tap gestures 715 and 718 are used to magnify (e.g., by zooming in) an image by a predetermined amount, rather than to view a previous or next image. For this case, the user is still provided with two different types of gestures for browsing images: (i) a finger gesture on the previous/next image icon 708/712 (1716) and (ii) a leftward/rightward horizontal finger swipe gesture 720 on the touch screen (1712).
In some embodiments, the portable electronic device rotates the image 704 by an angle in response to a user image rotation gesture. For example, the user image rotation gesture may include three simultaneous finger contacts 722, 724 and 726 with the image 704. When the three finger contacts move in the directions indicated by the respective arrows for at least a predefined distance, the portable electronic device rotates the image 704 from a portrait orientation to a landscape orientation or from a landscape orientation to a portrait orientation. In some embodiments, the rotation gesture is a two-finger multitouch gesture (e.g., simultaneous finger contacts 722 and 726). In some embodiments, the image rotates in response to detection of a change in the orientation of the device (e.g., using accelerometers to detect the orientation of the device). For example, the image may rotate to maintain proper viewing orientation as the touch screen 112 is physically rotated from a portrait orientation to a landscape orientation.
In some embodiments, a user finger gesture on the additional options icon 706 (1718) triggers the portable electronic device to render additional operations on the image 704. A more detailed description of some exemplary operations associated with the icon 706 is provided below in connection with Figures 12 and 20.
In some embodiments, a user finger gesture on the delete symbol icon 714 (1717) causes the portable electronic device to provide a user interface 700B as shown in Figure 7B. Through the user interface 700B, the user can delete the current image 704 from the camera roll. The user interface 700B includes the following elements, or a subset or superset thereof:
402, 404, 406, 604, 702, and 704, as described above;
Delete icon 716 that when activated (e.g., by a finger gesture on the icon) deletes the image 704; and
Cancel icon 718 that when activated (e.g., by a finger gesture on the icon) returns the portable electronic device to the previous user interface (e.g. UI 700A)
Figure 18 is a flowchart illustrating a process for deleting an image in response to a user contact with the touch screen in accordance with some embodiments. Upon detecting a user contact with the delete symbol icon 714 (1802), the portable electronic device displays the delete icon 716, the cancel icon 718, and the camera icon 604 on top of the image 704 (1804) and then monitors next user contact with the touch screen (1806).
In some embodiments, in response to a finger gesture on the delete icon 716 (1810), the portable electronic device eliminates the icons 716, 718 from the touch screen (1816) and initiates an animated process of "shredding" the image 704 (1818). In some embodiments, the shredding process includes breaking the image 704 into vertical stripes and dropping the vertical stripes from the touch screen at different paces. Other shredding animations, such as placing the image in a trash icon, may be used in other embodiments.
In some embodiments, the portable electronic device brings back the camera roll user interface 600 as shown in Figure 6 after deleting the image 704. The user can then repeat any aforementioned processes shown in Figure 16. In some other embodiments, the portable electronic device displays the next image in the virtual camera roll on the touch screen. The user may repeat any aforementioned processes shown in Figure 17.
If the portable electronic device detects a finger gesture on the cancel icon 718 (1812), it the device brings back the user interface 700A as shown in Figure 7A. If the next user action is a finger gesture on the camera icon 604 (1814), the portable electronic device switches back to the camera mode user interface 500, which allows the user to take new photos.
This deletion process, which requires user finger gestures on two different user interfaces (e.g., 700A and 700B), reduces the chance of a user accidentally deleting an image or other similar item.
In some embodiments, the portable electronic device stores images within different photo albums. The images may come from different sources. They may be downloaded from locations such as the user's desktop or laptop computer and a website on the Internet, etc. For example, one album may include images downloaded from a website through the web browser 147, images attached to email messages received by the user of the portable electronic device, and photos taken by the portable electronic device using the camera module 143.
Figure 8 illustrates an exemplary user interface for viewing photo albums in accordance with some embodiments. In some embodiments, user interface 800 includes the following elements, or a subset or superset thereof:
Graphics 804, e.g., thumbnail images of the first picture or a u.ser-selected picture in the corresponding albums;
Album names 806;
Selection icons 808 that when activated (e.g., by a finger gesture on the icon) initiates display of the corresponding album (e.g., UI 1000, Figure 10); and
Settings icon 810, that brings up a settings menu (e.g., Figure 9) when activated by a user gesture (e.g., a tap gesture).
Figure 19 is a flowchart illustrating a process for displaying multiple photo albums on the touch screen in accordance with some embodiments. After detecting a finger gesture 412 (Figure 4) on the icon for the image management module 144 (1902), the portable electronic device identifies a set of photo albums (1904) and displays them on the touch screen (1906). Figure 8 depicts a vertically list of photo albums 804 list, each album having a thumbnail image 804, a name 806, and a selection icon 808. In some embodiments, the photo albums are ordered alphabetically by their names. In some other embodiments, the photo albums are ordered by their creation timestamps, e.g., with the most recent one at the top of the list.
The portable electronic device displays a setting icon 810 at the bottom of the touch screen (1908) and monitors user contact with the touch screen (1910). As will be described below in connection with Figure 9, a user can configure the image management module 144 to operate in a user-chosen manner through the setting icon 810.
If there is a long photo album list, the user may scroll through the list using vertically upward/downward finger gestures 812 such as a vertical finger swipe on the touch screen (1912, 1920). When the user selects a particular album by a finger gesture (1914), the portable electronic device opens the album by executing the process described above in connection with Figure 16. The virtual camera roll shown in Figure 6 is one of many photo albums. User operations associated with the virtual camera roll also applies to images in a user-chosen album. A more detailed description of exemplary user operations is provided below in connection with Figures 10-12. In some embodiments, a user may initiate display of an album by contacting any region on the touch screen corresponding to the album (e.g., a finger tap on the graphic 804, album name 806, or selection icon 808).
Upon detecting a finger gesture on the setting icon 810 (1916), the portable electronic device renders a Settings user interface that enables the user to configure the image management service (1918). Figure 9 illustrates an exemplary Settings user interface 900 for setting user preferences in accordance with some embodiments. In some embodiments, user interface 900 includes the following elements, or a subset or superset thereof:
Music setting 902 for selecting the music during a slide show (e.g., Now Playing, 90s Music, Recently Added, or Off);
Repeat setting 904 for selecting whether the slide show repeats (e.g., On or Off);
Shuffle setting 906 for selecting whether the images in the slide show are displayed in a random or pseudo-random order (e.g., On or Off);
Time per slide setting 908 (e.g., 2, 3, 5, 10, 20 seconds or manual);
Transition setting 910 (e.g., random, wipe across, wipe down, or off);
TV out setting 912 for external display (e.g., on, off, or ask user);
TV signal setting 914 (e.g., NTSC or PAL);
Auto Rotate setting 916 (e.g. on or off);
Done icon 918 that when activated (e.g., by a finger gesture on the icon) returns the portable electronic device to the previous UI (c.g., UI 800); and
Selection icons 920 that when activated (e.g., by a finger gesture on the icon) show choices for the corresponding settings.
In some embodiments, a user may touch anywhere in a row for a particular setting to initiate display of the corresponding setting choices. For example, upon detecting a finger tap on TV Signal setting 914, the portable electronic device brings up a dropdown menu adjacent to the corresponding row. The dropdown menu lists configuration options associated with the setting. The user can select one option over another by applying a finger gesture on the selected option.
Figure 10 illustrates an exemplary user interface for viewing an album in accordance with some embodiments. In some embodiments, user interface 1000 includes the following elements, or a subset or superset thereof:
Photo albums icon 1002 that when activated (e.g., by a finger gesture on the icon) initiates transfer to the photo albums UI (e.g., UI 800);
Thumbnail images 1006 of images in the corresponding album;
Play icon 1008 that when activated (e.g., by a finger gesture on the icon) initiates a slide show of the images in the album;
The user interface 1000 is similar to the user interface 600 associated with the camera roll icon 504. Both user interfaces perform similar operations upon detecting a user contact with the thumbnail images. For example, the user may scroll through the thumbnails 1006 using vertically upward/downward gestures 1010 on the touch screen. In some embodiments, a stationary gesture on a particular thumbnail (e.g., a finger tap 1012 on thumbnail 1006-11) initiates transfer to an enlarged display of the corresponding image (e.g., UI 1100).
In some embodiments, there are differences between the two user interfaces. For example, the user interface 1000 has a play icon 1008 while the user interface 600 has a camera icon 604. A user selection of the play icon 1008 triggers the portable electronic device to begin a slide show of the images in the user-selected album. In contrast, the portable electronic device returns to the camera mode (e.g., for taking pictures) when there is a user finger gesture on the camera icon 604.
Upon user selection of a particular image, the portable electronic device renders a new user interface displaying the user-selected image. Figure 11 illustrates such an exemplary user interface for viewing images in an album in accordance with some embodiments. In some embodiments, user interface 1100 includes the following elements, or a subset or superset thereof:
Album name icon 1102 that when activated (e.g., by a finger gesture on the icon) initiates transfer to the corresponding album UI (e.g., UI 1000);
Image 1106;
Additional options icon 1108 that when activated (e.g., by a finger gesture on the icon) initiates transfer to a UI with additional options for use of image 1106 (e.g., UI 1200, Figure 12));
Previous image icon 1110 that when activated (e.g., by a finger gesture on the icon) initiates display of the previous image in the album (e.g., 1006-10);
Play icon 1112 that when activated (e.g., by a finger gesture on the icon) initiates a slide show of the images in the album; and
Next image icon 1114 that when activated (e.g., by a finger gesture on the icon) initiates display of the next image in the album.
Clearly, the user interface 1100 is very similar to the user interface 700A. Various image browsing functions described above with respect to Figure 7A are also available at the user interface 1100. For example, the user can initiate viewing of the previous image by making a tap gesture 1118 on the left side of the image or making a swipe gesture 1116 from left to right on the image. Similarly, the user can initiate viewing of the next image by making a tap gesture 1120 on the right side of the image or making a swipe gesture 1116 from right to left on the image.
In some embodiments, image 1106 moves off screen to the left as the next image moves on screen from the right. In some embodiments, image 1106 moves off screen to the right as the previous image moves on screen from the left.
With multiple ways to perform the same task, the portable electronic device enables a user to choose whichever methodology or gesture the user prefers, thereby making the photo management simpler and more intuitive.
A detailed description of the portable electronic device's operations in response to user selections of the previous image icon 1110, the play icon 1112, and the next image icon 1114 have been provided above in connection with Figures 7A and 17. In response to a user contact with the additional options icon 706 (Figure 7A) or 1108 (Figure 11), the portable electronic device renders a new interface with additional options for the user to choose in connection with the image being displayed.
Figure 12 illustrates such an exemplary user interface for selecting a use for an image in an album in accordance with some embodiments. In some embodiments, user interface 1200 includes the following elements, or a subset or superset thereof:
402, 404, 406, 1602, and 1106 as described above;
Email photo icon 1208 that when activated (e.g., by a finger gesture on the icon) initiates a process for incorporating the image 1106 in an email (e.g., as illustrated in Figures 13A-13G);
Assign to contact icon 1210 that when activated (e.g., by a finger gesture on the icon) initiates a process for associating the image 1106 with a contact in the user's contact list (e.g., as illustrated in Figures 14A-14B);
Use as wallpaper icon 1212 that when activated (e.g., by a finger gesture on the icon) initiates a process for incorporating the image 1106 in the user's wallpaper (e.g., as illustrated in Figure 15); and
Cancel icon 1214 that when activated (e.g., by a finger gesture on the icon) initiates transfer back to the previous UI (e.g., UI 1100).
In some embodiments, as shown in Figure 12, the image 1106 is displayed in the background and one or more the function icons 1208, 1210, 1212, 1214, are superimposed over the displayed image 1106.
Figure 20 is a flowchart illustrating a process for performing additional operations upon a user selection of an additional options icon (e.g., icon 1108 in UI 1100, Figure 11) in accordance with some embodiments. Upon detecting a finger gesture 1122 on the additional options icon (2002), the portable electronic device displays a list of option icons on the touch screen (2004). Each option icon corresponds to a specific operation on the image being displayed. As shown in Figure 12, the list includes Email photo icon 1208, Assign to contact icon 1210, Use as wallpaper icon 1212, and Cancel icon 1214. In some other embodiments, the user interface 1200 may include a subset of these icons, and may also include additional image usage icons for invoking other image usage functions.
If the user selects the email photo icon 1208 by a finger gesture (2008), the portable electronic device renders an email service interface that allows the user to send the image 1106 to somebody through email. If the user selects the assign to contact icon 1210 (2010), the portable electronic device displays a user interface (having a list of contacts) for the user to select a contact to be associated with the image 1106. Similarly, if the user selects the use as wallpaper icon 1212 (2012), the portable electronic device displays a user interface for the user to edit the image 1106 and set it as the portable electronic device's wallpaper.
Figure 21 is a flowchart illustrating an animated process for rendering an email service interface that includes a user selected image in accordance with some embodiments. After detecting the user selection of Email photo icon 1208 (2102), the portable electronic device animates a process of introducing an email message template onto the touch screen and placing the image into a predefined region of the email message template. In some embodiments, the animation includes initially reducing the image's size (Figure 13A) (2104); sliding or otherwise rendering an email message template behind the image 1106 (Figure 13B) (2106); and fitting the image into the message body field (Figure 13C) of an email composition user interface 1300C (2108).
In some embodiments, following the animation, the device monitors the touch screen for user contact (2110). When the user taps on or makes other predefined gestures 1302 (Figure 13D) on the To: field of the email recipient field to enter an email address (2112). The portable electronic device then displays the user's contact list (2122) (Figure 13E). After detecting a user finger gesture or other predefined gesture on a recipient/contact (2124) (e.g., a finger tap 1316 on Bob Adams in Figure 13E), the portable electronic device associates the recipient's email address with the email message and displays the contact's name in the To: field (2126) (e.g., "Bob Adams" in Figure 13F).
In some embodiments, in response to a user finger tap or other predefined gestures on predefined fields within the email message template (2114, 2116) (e.g., finger taps 1304, 1306 in Figure 13D, or "Other Email" in Figure 13E), the portable electronic device displays a letter keyboard 616 (2128) on the touch screen. The user may enter text into the respective fields through the letter keyboard 616 (Figure 13F). In some embodiments, the user may also enter an email address by tapping on character icons in the letter keyboard or other character keyboards.
As shown in Figure 13G, after detecting a finger gesture on the send icon 1314 (2120), the portable electronic device sends the email message to its recipient(s) (2132) and returns to the user interface 1000 or 1100. But if the user selects the cancel icon 1308 (2118), the portable electronic device may display the save draft icon 1310 and the don't save icon 1312 (2130). The device saves the draft in a draft folder associated with the e-mail client module 140 if the user chooses the save draft icon 1310 or deletes the draft if the user chooses the don't save icon 1312.
Assuming that the user taps or makes other predefined gestures on the assign to contact icon 1210 shown in Figure 12, Figure 22 is a flowchart illustrating a process for assigning an image to a user selected contact in the user's contact list in accordance with some embodiments.
Upon a user selection of the assign to contact icon 1210, the portable electronic device displays the user's contact list (Figure 14A). After the user selects a contact in the contact list (e.g., a finger tap 1401 on Bob Adams in Figure 14A), the portable electronic device produces a new user interface 1400B as shown in Figure 14B and monitors next user contact with the touch screen (2208). In some embodiments, the user interface 1400B includes the user instructions 1402 (2202), the user-selected image 1106 (2204), the cancel icon 1404 and the set photo icon 1406 (2206).
The portable electronic device modifies the image (2214) in response to a user finger gesture on the image 1106 (2212). For example, the user may crop, scale, and otherwise adjust the image 1106 using different types of finger gestures. In some embodiments, the portable electronic device moves the image on the touch screen in response to a movement of one-finger contact gesture 1408; enlarges the image in response to a de-pinching gesture including at least two simultaneous and continuous contacts 1410 and 1412; reduces the image in response to a pinching gesture including at least two simultaneous and continuous contacts 1410 and 1412; and/or rotates the image in response to a twisting gesture including two or more simultaneous and continuous contacts 1410 and 1412.
In some embodiments, the user assigns the modified image to the user-selected contact by tapping on the set photo icon 1406 (2216). This triggers the portable electronic device to associate the modified image with the contact. If the user selects the cancel icon 1404 (2218), the portable electronic device terminates the image assignment and brings back the user interface 1100.
If the user taps or makes other predefined gestures on the use as wallpaper icon 1212 in Figure 12, the portable electronic device displays a user interface for incorporating an image in the user's wallpaper. Figure 15 illustrates such an exemplary user interface 1500 in accordance with some embodiments.
In some embodiments, this wallpaper setting process is similar to the assign to contact process. For example, the user may move the image with a one-finger gesture 1508; enlarge the image with a de-pinching gesture using multiple contacts 1510 and 1512; reduce the image with a pinching gesture using multiple contacts 1510 and 1512; and/or rotate the image with a twisting gesture using multiple contacts 1510 and 1512.
The wallpaper setting process is completed after the user selects the set photo icon 1506. If the user selects the cancel icon 1504, the portable electronic device stops the assignment process and brings back the UI 1100 in Figure 11. In some embodiments, the interface 1500 also includes user instruction information 1502.
In Figure 23A, the displayed digital object is a digital image 2300-1. In this example, the entire image 2300-1 is displayed in Figure 23A. This exemplary image includes a first person 2302-1 and a second person 2302-2. In response to detecting a de-pinching gesture 2304 and 2306 on or about the second person 2302-2, a command to zoom in on a portion of the image 2300-1 that includes the second person 2302-2 is executed. Upon execution of the command to zoom in, a reduced portion of the image 2300-1 is displayed at a higher magnification than in Figure 23A. For example, in Figure 23B the second person 2302-2 is shown at a higher magnification than in Figure 23A and the first person 2302-1 is no longer shown.
In Figure 23C, a swipe gesture 2310 is detected on or near the touch screen display. In response, the displayed portion of the image 2300-1, including the second person 2302-2, is translated in a direction corresponding to the direction of the swipe gesture 2310, as shown in Figures 23C-23D, where the image is translated horizontally from right to left. An edge 2312 of the (enlarged) image 2300-1 is displayed in Figure 23D. In response to continued detection of the swipe gesture 2310 (Figure 23D), an area 2314 beyond the edge 2312 is displayed (e.g., a black area or other area visually distinct from the digital object). After the swipe gesture 2310 is no longer detected, as shown in Figure 23E, the image 2300-1, including the image of the second person 2302-2, is translated in a second direction 2316 until the area 2314 is no longer displayed (e.g., horizontally from left to right).
In response to detection of a second swipe gesture 2318, the displayed portion of the image 2300-1 is translated in a direction corresponding to the direction of the second swipe gesture 2318, as shown in Figure 23G, and a second digital image 2300-2 is displayed. In some embodiments, as shown in Figures 23G and 23H, the second digital image 2300-2 (or, more generally, digital object) slides on to the touch screen as the first digital image 2300-1 slides off of the touch screen.
In this example, the display of area 2314 lets the user know that the edge of the (enlarged) digital object has been reached during the first gesture 2310. Upon detecting the second gesture 2318 in the same or substantially the same direction as the first gesture, the device transitions to the display of another image in a set of images, rather than just repeating the visual indication that the edge of the digital object has been reached.
Figure 24 is a flowchart illustrating a process 2400 for viewing digital objects in a set of digital objects in accordance with some embodiments.
In some embodiments, a device with a touch screen display (e.g., device 100, a tablet computer, or a desktop computer with a touch screen display) detects (2402) a first movement of a physical object on or near the touch screen display. In some embodiments, the device is a portable electronic device. In some embodiments, the physical object is a finger. In some embodiments, the physical object is a stylus. In some embodiments, the first movement is a horizontal swipe gesture (e.g., 2310, Figure 23C).
While detecting the first movement, the device translates (2404) a first digital object (e.g., a digital image 2300-1) displayed on the touch screen display in a first direction. In some embodiments, prior to the translating, at least one edge of the first digital object extends beyond the touch screen display in the first direction.
The first digital object is associated with a set of digital objects. In some embodiments, the set of digital objects is a set of digital images (e.g., 2300-1, 2300-2, etc., which may be part of an album or part of a set of images taken with a camera in the device). In some embodiments, the set of digital objects is a set of web pages (e.g., a set of web pages selected by a user for display in a browser). In some embodiments, the set of digital objects is a set of electronic documents.
In response to display of a previously hidden edge (e.g., edge 2312, Figure 23D) of the first digital object and continued detection of the first movement (e.g., swipe gesture 2310, Figure 23D), the device displays (2406) an area beyond the edge of the first digital object (e.g., area 2314).
After the first movement is no longer detected, the device translates (2408) the first digital object in a second direction until the area beyond the edge of the first digital object is no longer displayed. For example, in Figure 23E the digital image 2300-1 is translated in a direction 2316 (e.g., horizontally from left to right) until the area 2314 is no longer displayed. In some embodiments, the second direction is opposite the first direction. In some embodiments, the first digital object is translated in the second direction using a damped motion. In some embodiments, the change from translating the first digital object in the first direction to translating the first digital object in the second direction until the area beyond the edge of the first digital object is no longer displayed makes the edge of the first digital object appear to be elastically attached to an edge of the touch screen display or to an edge displayed on the touch screen display.
The device detects (2410) a second movement (e.g., a second swipe gesture 2318 from right to left, Figure 23F) of the physical object on or near the touch screen display.
In response to detecting the second movement while the previously hidden edge of the first digital object is displayed (e.g., edge 2312, Figure 23F), the device translates (2412) the first digital object in the first direction and displays a second digital object (e.g., a digital image 2300-2, Figures 23G and 23H) in the set of digital objects.
Thus, depending on the context, similar movements (e.g., 2310 and 2318 are both right to left swipe gestures) allow a user to either (1) translate a displayed first digital object or (2) transition from displaying the first digital object to displaying a second digital object in a set of digital objects.
In some embodiments, the time between the first and second movements must be less than a predetermined value (e.g., 0.5 seconds). Otherwise, the device will not transition to displaying the second digital object. Rather, the device may just translate the first digital object and show the area beyond the edge of the object (to show the user again that the edge of the first digital object has been reached).
In some embodiments, if the entire first digital object is displayed (e.g., Figure 23A), then the first movement (e.g., a horizontal swipe gesture) will transition the device to display another digital object in the set of digital objects.
Process 2400 permits a touch screen user to easily navigate within a displayed digital object and between digital objects in a set of digital objects.
A computer-implemented method, comprising:
at a portable electronic device with a phone, a photo manager, a touch screen display adapted to provide control of both the phone and the photo manager, and one or more accelerometers to detect an orientation of the device:
displaying an array of thumbnail images corresponding to a set of photographic images;
replacing the displayed array of thumbnail images with a user-selected photographic image upon detecting a user contact with a corresponding thumbnail image in the array, wherein the user-selected photographic image is displayed at a larger scale than the corresponding thumbnail image;
displaying a different photographic image in replacement of the user-selected photographic image, wherein the different photographic image is selected in accordance with a scrolling gesture comprising a substantially horizontal movement of a user contact with the touch screen display; and,
upon detection of a change in the orientation of the device by the one or more accelerometers, rotating the different photographic image on the touch screen display to maintain a proper viewing orientation.
The method of claim 1, including:
detecting a user image navigation gesture adjacent to a vertical edge of the touch screen display; and
upon detecting the user image navigation gesture, displaying a different photographic image in the set of photographic images, selected in accordance with the vertical edge adjacent to the user image navigation gesture.
The method of claim 2, wherein the user image navigation gesture comprises a momentary, substantially single-position contact with the touch screen display.
The method of any of claims 1-3, including:
upon detecting user selection of an image deletion icon, displaying an image destruction animation of the different photographic image.
The method of claim 4, wherein the image destruction animation includes:
splitting the different photographic image into multiple vertical stripes; and
visually moving the multiple vertical stripes out of the touch screen display with different stripes moving at different speeds.
The method of any of claims 1-5, including:
upon detecting user selection of an email image icon, displaying an email composition user interface for composing an email message, with the different photographic image included in the email message being composed.
The method of claim 6, including:
upon detecting the user selection of the email image icon, displaying an animation of the different photographic image being resized and placed into the email message being composed.
The method of claim 7, wherein the animation of the different photographic image includes visually shrinking the different photographic image to a predefined size;
visually moving the email composition user interface into the touch screen, the user interface including a message body region; and
visually fitting the shrunken different photographic image into the message body region.
The method of claim 8, including:
upon detecting a user selection of the message body region, displaying a letter keyboard overlaid on the user selected image; and
upon detecting a user selection of the letter keyboard, displaying a user selected character in the message body region.
The method of any of claims 1-9, including:
upon detecting user selection of an image contact assignment icon, displaying a list of contacts; and,
upon detecting user selection of a respective contact from the list of contact, displaying a user interface for associating the different photographic image with the user selected contact.
The method of claim 10, wherein displaying a user interface for associating the different photographic image with the user selected contact includes enabling the user to adjust the different photographic image to form an adjusted image to be associated with the user selected contact.
The method of claim 11, wherein the adjustment of the different photographic image includes:
moving the different photographic image on the touch screen in response to a movement of an one-finger contact gesture;
enlarging the different photographic image in response to a de-pinching gesture including multiple simultaneous and continuous contacts with the touch screen;
reducing the different photographic image in response to a pinching gesture including multiple simultaneous and continuous contacts with the touch screen.
The method of any of claims 1-12, including displaying a vertical list of photo albums.
The method of claim 13, wherein displaying the array of thumbnail images corresponding to the set of photographic images occurs upon detecting a touch input corresponding to a photo album in the vertical list of photo albums.
A portable electronic device with a touch screen display, the portable electronic device adapted to implement the method of any one of claims 1 to 14.
A computer program with software code adapted to perform the method of any one of claims 1 to 15.
EP10172417.7A 2006-09-06 2007-08-31 Portable electronic device for photo management Active EP2282275B1 (en)
US82476906P true 2006-09-06 2006-09-06
US88378507P true 2007-01-06 2007-01-06
US87925307P true 2007-01-07 2007-01-07
US87946907P true 2007-01-08 2007-01-08
US94711807P true 2007-06-29 2007-06-29
US93799307P true 2007-06-29 2007-06-29
US11/848,210 US8106856B2 (en) 2006-09-06 2007-08-30 Portable electronic device for photo management
EP07814633A EP2059868B1 (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
EP18197554.1A EP3447620A3 (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
EP11178257.9A EP2390799B1 (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
EP11178259.5A EP2390779B1 (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
EP07814633.9 Division 2007-08-31
EP11178259.5A Division EP2390779B1 (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
EP18197554.1A Division EP3447620A3 (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
EP11178257.9 Division-Into 2011-08-22
EP11178259.5 Division-Into 2011-08-22
EP2282275A1 EP2282275A1 (en) 2011-02-09
EP2282275B1 true EP2282275B1 (en) 2013-12-11
ID=38786837
EP18197554.1A Pending EP3447620A3 (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
EP10172417.7A Active EP2282275B1 (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
EP11178257.9A Active EP2390799B1 (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
EP11178259.5A Active EP2390779B1 (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
EP07814633A Active EP2059868B1 (en) 2006-09-06 2007-08-31 Portable electronic device for photo management
US (5) US8106856B2 (en)
EP (5) EP3447620A3 (en)
JP (8) JP4892061B2 (en)
KR (2) KR101170877B1 (en)
CN (1) CN101893992B (en)
AT (1) AT483196T (en)
AU (2) AU2007283771C1 (en)
CA (5) CA2984527A1 (en)
DE (10) DE202007018421U1 (en)
HK (4) HK1134885A2 (en)
WO (1) WO2008030779A2 (en)
Families Citing this family (372)
US7606819B2 (en) 2001-10-15 2009-10-20 Maya-Systems Inc. Multi-dimensional locating system and method
US7250939B2 (en) 2002-03-19 2007-07-31 Aol Llc Display motion multiplier
US8736557B2 (en) 2006-09-11 2014-05-27 Apple Inc. Electronic device with image based browsers
GB2480777B (en) * 2006-09-11 2012-01-04 Apple Inc Media player with image-based browsing
US7581186B2 (en) 2006-09-11 2009-08-25 Apple Inc. Media manager with integrated browsers
US8284165B2 (en) 2006-10-13 2012-10-09 Sony Corporation Information display apparatus with proximity detection performance and information display method using the same
JP4183003B2 (en) * 2006-11-09 2008-11-19 ソニー株式会社 Information processing apparatus, information processing method, and program
US10298834B2 (en) 2006-12-01 2019-05-21 Google Llc Video refocusing
US8706169B2 (en) * 2006-12-28 2014-04-22 Yahoo! Inc. Interface overlay
US9001047B2 (en) 2007-01-07 2015-04-07 Apple Inc. Modal change based on orientation of a portable multifunction device
AU2012200689B2 (en) * 2007-01-07 2015-06-18 Apple Inc. Scaling documents on a touch-screen display
US8351989B2 (en) * 2007-02-23 2013-01-08 Lg Electronics Inc. Method of displaying menu in a mobile communication terminal
JP5116407B2 (en) * 2007-03-27 2013-01-09 三洋電機株式会社 Imaging apparatus and imaging system
JP4601652B2 (en) * 2007-03-27 2010-12-22 三洋電機株式会社 Imaging device
US8127254B2 (en) 2007-06-29 2012-02-28 Nokia Corporation Unlocking a touch screen device
KR100929236B1 (en) * 2007-09-18 2009-12-01 엘지전자 주식회사 Mobile terminal and its operation control method that includes a touch screen,
DE202008018283U1 (en) * 2007-10-04 2012-07-17 Lg Electronics Inc. Menu display for a mobile communication terminal
US9083814B2 (en) * 2007-10-04 2015-07-14 Lg Electronics Inc. Bouncing animation of a lock mode screen in a mobile communication terminal
KR101397080B1 (en) * 2007-10-05 2014-05-21 엘지전자 주식회사 Portable terminal having multi-function executing capability and executing method thereof
KR101455983B1 (en) 2007-10-19 2014-11-03 엘지전자 주식회사 Mobile terminal and mehod of displaying information therein
TWI373725B (en) * 2007-11-06 2012-10-01 Giga Byte Comm Inc
US8498451B1 (en) 2007-11-12 2013-07-30 Google Inc. Contact cropping from images
WO2009079737A1 (en) * 2007-12-24 2009-07-02 Bce Inc. Visualization method for messages stored in an inbox
US8555193B2 (en) * 2008-01-17 2013-10-08 Google Inc. System for intelligent automated layout and management of interactive windows
EP2088500A1 (en) * 2008-02-11 2009-08-12 Idean Enterprises Oy Layer based user interface
US8416196B2 (en) 2008-03-04 2013-04-09 Apple Inc. Touch event model programming interface
US8205157B2 (en) 2008-03-04 2012-06-19 Apple Inc. Methods and graphical user interfaces for conducting searches on a portable multifunction device
US8717305B2 (en) 2008-03-04 2014-05-06 Apple Inc. Touch event model for web pages
KR101012300B1 (en) 2008-03-07 2011-02-08 삼성전자주식회사 User interface apparatus of mobile station having touch screen and method thereof
JP4931845B2 (en) * 2008-03-18 2012-05-16 富士フイルム株式会社 Imaging apparatus and captured image display control method
TW200941243A (en) * 2008-03-20 2009-10-01 Compal Electronics Inc Method for displaying receiver information
DE102008017716A1 (en) * 2008-04-07 2009-10-08 Volkswagen Ag Displaying and operating device for vehicle, has display device, touch-sensitive position detection unit coupled with display device, and controller which is coupled with display device and position detection unit
TWI428814B (en) * 2008-04-15 2014-03-01 Htc Corp Method for switching wallpaper in screen lock state, mobile electronic device thereof, and recording medium thereof
KR20090113010A (en) * 2008-04-25 2009-10-29 삼성전자주식회사 Method for providing GUI and multimedia apparatus using the same
JP5537044B2 (en) * 2008-05-30 2014-07-02 キヤノン株式会社 Image display apparatus, control method therefor, and computer program
AU2014215929B2 (en) * 2008-06-06 2016-07-28 Apple Inc. User interface for application management for a mobile device
US8099332B2 (en) 2008-06-06 2012-01-17 Apple Inc. User interface for application management for a mobile device
CN101615089A (en) * 2008-06-27 2009-12-30 鸿富锦精密工业（深圳）有限公司;鸿海精密工业股份有限公司 Image display equipment and method for displaying different effects of image by means of operation of user
US8745018B1 (en) 2008-07-10 2014-06-03 Google Inc. Search application and web browser interaction
KR101495170B1 (en) * 2008-07-22 2015-02-24 엘지전자 주식회사 Method for displaying menu of mobile terminal
US7953462B2 (en) 2008-08-04 2011-05-31 Vartanian Harry Apparatus and method for providing an adaptively responsive flexible display device
CN101644986B (en) 2008-08-06 2011-10-12 元太科技工业股份有限公司 Input method and touch display
KR101436841B1 (en) * 2008-08-19 2014-09-03 삼성전자주식회사 Digital image processing apparatus
JP5683062B2 (en) * 2008-08-28 2015-03-11 京セラ株式会社 Communication terminal device, image storage method, and program
US20100056188A1 (en) * 2008-08-29 2010-03-04 Motorola, Inc. Method and Apparatus for Processing a Digital Image to Select Message Recipients in a Communication Device
US20100057761A1 (en) * 2008-09-02 2010-03-04 Nokia Corporation Method, apparatus, computer program and user interface for enabling user input
DE102008051051A1 (en) * 2008-09-03 2010-03-04 Volkswagen Ag Method and device for displaying information in a vehicle
CA2677921C (en) 2008-09-12 2017-06-13 Mathieu Ma Audet Method of managing groups of arrays of documents
US8255825B2 (en) * 2008-10-07 2012-08-28 Microsoft Corporation Content aware adaptive display
KR20100041006A (en) * 2008-10-13 2010-04-22 엘지전자 주식회사 A user interface controlling method using three dimension multi-touch
JP2010101977A (en) * 2008-10-22 2010-05-06 Nec Corp Image display device, method for controlling operation, and program
US20100107081A1 (en) * 2008-10-24 2010-04-29 Infocus Corporation Projection device image viewer user interface
JP5036684B2 (en) * 2008-10-27 2012-09-26 シャープ株式会社 Portable information terminal
US8375333B2 (en) * 2008-10-27 2013-02-12 Lg Electronics Inc. Mobile terminal and operating method thereof
JP5098961B2 (en) * 2008-11-05 2012-12-12 日本電気株式会社 Image display apparatus, method, and program
US9788043B2 (en) * 2008-11-07 2017-10-10 Digimarc Corporation Content interaction methods and systems employing portable devices
KR101048213B1 (en) * 2008-12-04 2011-07-08 에스케이텔레시스 주식회사 Content switching method of mobile communication terminal equipped with touch screen
KR101011474B1 (en) 2008-12-04 2011-01-28 에스케이텔레시스 주식회사 Method and apparatus of searching thumbnail image for terminal
KR101083158B1 (en) * 2008-12-04 2011-11-11 에스케이텔레시스 주식회사 Contents conversion method for mobile terminal with touch screen
KR101527386B1 (en) * 2008-12-08 2015-06-10 삼성전자 주식회사 Display apparatus and control method of the same
JP5134517B2 (en) * 2008-12-08 2013-01-30 キヤノン株式会社 Information processing apparatus and method
TWI394441B (en) * 2008-12-09 2013-04-21 Benq Corp Portable electronic device and image operation method thereof
US20100153168A1 (en) * 2008-12-15 2010-06-17 Jeffrey York System and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device
US8443303B2 (en) * 2008-12-22 2013-05-14 Verizon Patent And Licensing Inc. Gesture-based navigation
JP2010152761A (en) * 2008-12-25 2010-07-08 Sony Corp Input apparatus, control apparatus, control system, electronic apparatus, and control method
US8265658B2 (en) 2009-02-02 2012-09-11 Waldeck Technology, Llc System and method for automated location-based widgets
KR101582687B1 (en) * 2009-03-02 2016-01-05 엘지전자 주식회사 Method for releasing locking in mobile terminal and mobile terminal using the same
US8589374B2 (en) 2009-03-16 2013-11-19 Apple Inc. Multifunction device with integrated search and application selection
US9311112B2 (en) 2009-03-16 2016-04-12 Apple Inc. Event recognition
WO2010105440A1 (en) * 2009-03-20 2010-09-23 Google Inc. Interaction with ime computing device
JP5174735B2 (en) * 2009-04-23 2013-04-03 オリンパスイメージング株式会社 Operation control device, operation control method, and operation control program
US8836648B2 (en) * 2009-05-27 2014-09-16 Microsoft Corporation Touch pull-in gesture
US9148618B2 (en) 2009-05-29 2015-09-29 Apple Inc. Systems and methods for previewing newly captured image content and reviewing previously stored image content
TW201044263A (en) * 2009-06-11 2010-12-16 Htc Corp Image data browsing methods and systems, and computer program products thereof
KR20100136618A (en) * 2009-06-19 2010-12-29 삼성전자주식회사 Apparatus and method for touch input in portable communication system
CN101645856A (en) 2009-08-19 2010-02-10 深圳华为通信技术有限公司 Contact person information processing method and mobile terminal
KR20110027589A (en) * 2009-09-09 2011-03-16 삼성전자주식회사 Method and apparatus for embedding and sharing in a electrionic device
WO2011037558A1 (en) * 2009-09-22 2011-03-31 Apple Inc. Device, method, and graphical user interface for manipulating user interface objects
US9310907B2 (en) 2009-09-25 2016-04-12 Apple Inc. Device, method, and graphical user interface for manipulating user interface objects
US8832585B2 (en) 2009-09-25 2014-09-09 Apple Inc. Device, method, and graphical user interface for manipulating workspace views
US8766928B2 (en) * 2009-09-25 2014-07-01 Apple Inc. Device, method, and graphical user interface for manipulating user interface objects
US8799826B2 (en) * 2009-09-25 2014-08-05 Apple Inc. Device, method, and graphical user interface for moving a calendar entry in a calendar application
US9383916B2 (en) 2009-09-30 2016-07-05 Microsoft Technology Licensing, Llc Dynamic image presentation
GB0919516D0 (en) * 2009-11-06 2009-12-23 Imagination Tech Ltd Touch sensitive display
US8436887B2 (en) 2009-11-13 2013-05-07 Samsung Electronics Co., Ltd. Mobile terminal, display apparatus and control method thereof
US9152318B2 (en) * 2009-11-25 2015-10-06 Yahoo! Inc. Gallery application for content viewing
KR101601032B1 (en) * 2009-12-01 2016-03-08 삼성전자주식회사 Mobile terminal for inserting memory card and method for managing memory card thereof
KR20110063297A (en) * 2009-12-02 2011-06-10 삼성전자주식회사 Mobile device and control method thereof
US10156979B2 (en) * 2009-12-02 2018-12-18 Samsung Electronics Co., Ltd. Method and apparatus for providing user interface of portable device
US9003290B2 (en) * 2009-12-02 2015-04-07 T-Mobile Usa, Inc. Image-derived user interface enhancements
KR101595263B1 (en) * 2009-12-03 2016-02-18 삼성전자주식회사 Method and apparatus for managing an album
KR20110075404A (en) * 2009-12-28 2011-07-06 삼성전자주식회사 Method and apparatus for separating events
US8698762B2 (en) 2010-01-06 2014-04-15 Apple Inc. Device, method, and graphical user interface for navigating and displaying content in context
US9015595B2 (en) * 2010-01-20 2015-04-21 Yahoo! Inc. Self-targeting local AD system
US8539385B2 (en) * 2010-01-26 2013-09-17 Apple Inc. Device, method, and graphical user interface for precise positioning of objects
US8539386B2 (en) * 2010-01-26 2013-09-17 Apple Inc. Device, method, and graphical user interface for selecting and moving objects
US8612884B2 (en) * 2010-01-26 2013-12-17 Apple Inc. Device, method, and graphical user interface for resizing objects
US20110185320A1 (en) * 2010-01-28 2011-07-28 Microsoft Corporation Cross-reference Gestures
US8261213B2 (en) 2010-01-28 2012-09-04 Microsoft Corporation Brush, carbon-copy, and fill gestures
US20110185299A1 (en) * 2010-01-28 2011-07-28 Microsoft Corporation Stamp Gestures
US20110191704A1 (en) * 2010-02-04 2011-08-04 Microsoft Corporation Contextual multiplexing gestures
US9519356B2 (en) * 2010-02-04 2016-12-13 Microsoft Technology Licensing, Llc Link gestures
US20110193881A1 (en) * 2010-02-05 2011-08-11 Sony Ericsson Mobile Communications Ab Regulation of navigation speed among displayed items and tilt angle thereof responsive to user applied pressure
US9122320B1 (en) * 2010-02-16 2015-09-01 VisionQuest Imaging, Inc. Methods and apparatus for user selectable digital mirror
US9965165B2 (en) * 2010-02-19 2018-05-08 Microsoft Technology Licensing, Llc Multi-finger gestures
US9274682B2 (en) * 2010-02-19 2016-03-01 Microsoft Technology Licensing, Llc Off-screen gestures to create on-screen input
US8799827B2 (en) * 2010-02-19 2014-08-05 Microsoft Corporation Page manipulations using on and off-screen gestures
US8707174B2 (en) * 2010-02-25 2014-04-22 Microsoft Corporation Multi-screen hold and page-flip gesture
US9454304B2 (en) * 2010-02-25 2016-09-27 Microsoft Technology Licensing, Llc Multi-screen dual tap gesture
US20110209058A1 (en) * 2010-02-25 2011-08-25 Microsoft Corporation Multi-screen hold and tap gesture
US8751970B2 (en) * 2010-02-25 2014-06-10 Microsoft Corporation Multi-screen synchronous slide gesture
US9075522B2 (en) * 2010-02-25 2015-07-07 Microsoft Technology Licensing, Llc Multi-screen bookmark hold gesture
US20110209089A1 (en) * 2010-02-25 2011-08-25 Hinckley Kenneth P Multi-screen object-hold and page-change gesture
US20110224896A1 (en) * 2010-03-09 2011-09-15 Nokia Corporation Method and apparatus for providing touch based routing services
JP5306266B2 (en) * 2010-03-15 2013-10-02 キヤノン株式会社 Imaging apparatus and control method thereof
KR101793352B1 (en) 2010-04-09 2017-11-02 이 잉크 코포레이션 Methods for driving electro-optic displays
WO2011130919A1 (en) * 2010-04-23 2011-10-27 Motorola Mobility, Inc. Electronic device and method using touch-detecting surface
US8773470B2 (en) 2010-05-07 2014-07-08 Apple Inc. Systems and methods for displaying visual information on a device
KR20110138925A (en) * 2010-06-22 2011-12-28 삼성전자주식회사 Display apparatus and control methof thereof
US9367227B1 (en) * 2010-06-30 2016-06-14 Amazon Technologies, Inc. Chapter navigation user interface
US9223475B1 (en) 2010-06-30 2015-12-29 Amazon Technologies, Inc. Bookmark navigation user interface
TWI420228B (en) * 2010-07-05 2013-12-21 Benq Corp Photographable electronic device and the operating method thereof
KR101849724B1 (en) * 2010-07-09 2018-04-18 김시환 Portable display device
KR101719982B1 (en) * 2010-07-19 2017-03-27 엘지전자 주식회사 Mobile terminal and method for controlling the same
US9098182B2 (en) 2010-07-30 2015-08-04 Apple Inc. Device, method, and graphical user interface for copying user interface objects between content regions
US9081494B2 (en) 2010-07-30 2015-07-14 Apple Inc. Device, method, and graphical user interface for copying formatting attributes
US8972879B2 (en) 2010-07-30 2015-03-03 Apple Inc. Device, method, and graphical user interface for reordering the front-to-back positions of objects
WO2012020865A1 (en) * 2010-08-13 2012-02-16 엘지전자 주식회사 Mobile terminal, display device, and method for controlling same
JP5711479B2 (en) 2010-08-17 2015-04-30 キヤノン株式会社 Display control apparatus and control method thereof
US8854318B2 (en) 2010-09-01 2014-10-07 Nokia Corporation Mode switching
JP5389757B2 (en) * 2010-09-15 2014-01-15 株式会社ソニー・コンピュータエンタテインメント Image processing apparatus, content creation apparatus, image processing method, and data structure of content file
US20120075459A1 (en) * 2010-09-23 2012-03-29 Stuehmeyer Timothy E Miniature viewing camera and remote receiver unit
US9027117B2 (en) * 2010-10-04 2015-05-05 Microsoft Technology Licensing, Llc Multiple-access-level lock screen
WO2012046890A1 (en) * 2010-10-06 2012-04-12 엘지전자 주식회사 Mobile terminal, display device, and method for controlling same
KR101735302B1 (en) 2010-10-13 2017-05-15 삼성전자 주식회사 Fast Executing Method of Camera And Portable Device including the same
US20120110517A1 (en) * 2010-10-29 2012-05-03 Honeywell International Inc. Method and apparatus for gesture recognition
KR101522345B1 (en) 2010-11-12 2015-05-21 주식회사 케이티 Method for displaying background pictures in mobile communication apparatus and apparatus the same
KR101749529B1 (en) * 2010-11-25 2017-06-21 엘지전자 주식회사 Mobile terminal and operation control method thereof
DE102010054859A1 (en) 2010-12-17 2012-06-21 Rohde & Schwarz Gmbh & Co. Kg System with gesture recognition unit
CN102665524B (en) 2010-12-24 2013-09-25 奥林巴斯株式会社 Endoscopic device
WO2012086083A1 (en) 2010-12-24 2012-06-28 オリンパス株式会社 Endoscopic device
EP2484270B1 (en) * 2010-12-24 2014-03-12 Olympus Corporation Endoscopic device
JP4897117B1 (en) 2010-12-24 2012-03-14 オリンパス株式会社 Endoscope device
KR101242620B1 (en) * 2011-01-18 2013-03-19 주식회사 애트랩 Method for processing a touch signal by the touch sensor controller and apparatus thereof
JP5715433B2 (en) * 2011-02-08 2015-05-07 キヤノン株式会社 Imaging apparatus, album creating method, program, and storage medium
TW201235927A (en) * 2011-02-21 2012-09-01 Hon Hai Prec Ind Co Ltd Method for operating page on screen
JP5815259B2 (en) * 2011-03-28 2015-11-17 Ｎｅｃパーソナルコンピュータ株式会社 Information processing apparatus and information processing method
US20120262462A1 (en) * 2011-04-18 2012-10-18 Johan Montan Portable electronic device for displaying images and method of operation thereof
JP5768457B2 (en) 2011-04-19 2015-08-26 ソニー株式会社 Electronic device, display method and program
KR101857563B1 (en) * 2011-05-11 2018-05-15 삼성전자 주식회사 Method and apparatus for data sharing of between different network electronic devices
WO2012162399A2 (en) * 2011-05-23 2012-11-29 Visible Market Inc. Dynamic visual statistical data display and navigation system and method for limited display device
US8971924B2 (en) 2011-05-23 2015-03-03 Apple Inc. Identifying and locating users on a mobile network
US9342280B2 (en) * 2011-05-27 2016-05-17 Microsoft Technology Licesning, LLC Travel log for manipulation of content
CN102890612B (en) * 2011-07-22 2017-02-15 腾讯科技（深圳）有限公司 Method and device for scrolling screen
EP2557562B1 (en) * 2011-08-08 2019-05-22 BlackBerry Limited Method and apparatus for displaying an image
US9026946B2 (en) 2011-08-08 2015-05-05 Blackberry Limited Method and apparatus for displaying an image
US8971572B1 (en) 2011-08-12 2015-03-03 The Research Foundation For The State University Of New York Hand pointing estimation for human computer interaction
US8788979B2 (en) * 2011-09-10 2014-07-22 Microsoft Corporation Secondary actions on a notification
US10289657B2 (en) 2011-09-25 2019-05-14 9224-5489 Quebec Inc. Method of retrieving information elements on an undisplayed portion of an axis of information elements
US8769624B2 (en) 2011-09-29 2014-07-01 Apple Inc. Access control utilizing indirect authentication
US9002322B2 (en) 2011-09-29 2015-04-07 Apple Inc. Authentication with secondary approver
US8631357B2 (en) * 2011-10-31 2014-01-14 Apple Inc. Dual function scroll wheel input
TW201319921A (en) * 2011-11-07 2013-05-16 Benq Corp Method for screen control and method for screen display on a touch screen
US9830049B2 (en) * 2011-12-12 2017-11-28 Nokia Technologies Oy Apparatus and method for providing a visual transition between screens
US20130305354A1 (en) 2011-12-23 2013-11-14 Microsoft Corporation Restricted execution modes
JP2013140460A (en) * 2011-12-29 2013-07-18 Sony Corp Display device, display method, and program
US9218123B2 (en) 2011-12-29 2015-12-22 Apple Inc. Device, method, and graphical user interface for resizing content viewing and text entry interfaces
KR101812585B1 (en) 2012-01-02 2017-12-27 삼성전자주식회사 Method for providing User Interface and image photographing apparatus thereof
US20130250048A1 (en) * 2012-01-13 2013-09-26 Joshua Victor Aller Method of capture, display and sharing of orientation-based image sets
CN103207725B (en) * 2012-01-13 2017-02-08 腾讯科技（深圳）有限公司 Icon conversion method and device
TWI478019B (en) * 2012-03-05 2015-03-21 Innocom Tech Shenzhen Co Ltd Touch display system, display apparatus and frame closing method thereof
CN103294240B (en) * 2012-03-05 2016-05-25 群康科技(深圳)有限公司 Touch control display system, display unit and image close method thereof
US20130238973A1 (en) * 2012-03-10 2013-09-12 Ming Han Chang Application of a touch based interface with a cube structure for a mobile device
JP5984439B2 (en) * 2012-03-12 2016-09-06 キヤノン株式会社 Image display device and image display method
ITRN20120019A1 (en) * 2012-03-24 2013-09-25 Photosi Spa A method of digital photographs edited by hardware devices equipped with at least a display screen and application software for this procedure.
US9575652B2 (en) * 2012-03-31 2017-02-21 Microsoft Technology Licensing, Llc Instantiable gesture objects
JP2013228797A (en) * 2012-04-24 2013-11-07 Ricoh Co Ltd Image control device, and image processing system and program
WO2013169845A1 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for scrolling nested regions
CN105260049B (en) 2012-05-09 2018-10-23 苹果公司 For contacting the equipment for carrying out display additional information, method and graphic user interface in response to user
WO2013169843A1 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for manipulating framed graphical objects
WO2013169875A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for displaying content associated with a corresponding affordance
WO2013169865A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input
WO2013169849A2 (en) 2012-05-09 2013-11-14 Industries Llc Yknots Device, method, and graphical user interface for displaying user interface objects corresponding to an application
WO2013169842A2 (en) 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for selecting object within a group of objects
DE112013002381T5 (en) 2012-05-09 2015-02-26 Apple Inc. Apparatus, method and graphical user interface for moving and dropping a user interface object
WO2013169851A2 (en) * 2012-05-09 2013-11-14 Yknots Industries Llc Device, method, and graphical user interface for facilitating user interaction with controls in a user interface
JP6182207B2 (en) 2012-05-09 2017-08-16 アップル インコーポレイテッド Device, method, and graphical user interface for providing feedback for changing an activation state of a user interface object
KR101683868B1 (en) 2012-05-09 2016-12-07 애플 인크. Device, method, and graphical user interface for transitioning between display states in response to gesture
AU2013259613B2 (en) 2012-05-09 2016-07-21 Apple Inc. Device, method, and graphical user interface for providing tactile feedback for operations performed in a user interface
CN106201316A (en) 2012-05-09 2016-12-07 苹果公司 For selecting the equipment of user interface object, method and graphic user interface
US10255227B2 (en) * 2012-05-21 2019-04-09 Oath Inc. Computerized system and method for authoring, editing, and delivering an interactive social media video
USD731543S1 (en) * 2012-07-03 2015-06-09 Fujifilm Corporation Digital camera display screen with graphical user interface
TWI479328B (en) * 2012-07-06 2015-04-01 Pegatron Corp Method for setting wallpaper and digital media controller
KR20140016050A (en) * 2012-07-30 2014-02-07 삼성전자주식회사 Device and method for controlling data transfer in terminal
CN102819417B (en) * 2012-08-16 2015-07-15 小米科技有限责任公司 Picture display processing method and device
KR101936090B1 (en) * 2012-08-29 2019-01-08 삼성전자주식회사 Apparatus for controlling key input and method for the same
CN103677602B (en) * 2012-09-13 2018-10-02 腾讯科技（深圳）有限公司 a kind of mobile terminal screen unlocking method and device
JP6025473B2 (en) * 2012-09-14 2016-11-16 キヤノン株式会社 Information processing apparatus, information processing method, and program
US8826382B2 (en) * 2012-09-14 2014-09-02 Apple Inc. Antibot mechanisms optimized for mobile computing
US9148625B2 (en) * 2012-09-21 2015-09-29 Cisco Technology, Inc. Transition control in a videoconference
KR102013443B1 (en) * 2012-09-25 2019-08-22 삼성전자주식회사 Method for transmitting for image and an electronic device thereof
JP2014071833A (en) * 2012-10-01 2014-04-21 Toshiba Corp Electronic apparatus, display change method, display change program
EP2720126B1 (en) * 2012-10-09 2017-11-29 Samsung Electronics Co., Ltd Method and apparatus for generating task recommendation icon in a mobile device
CN103777857A (en) * 2012-10-24 2014-05-07 腾讯科技（深圳）有限公司 Method and device for rotating video picture
US9229632B2 (en) * 2012-10-29 2016-01-05 Facebook, Inc. Animation sequence associated with image
US9606720B1 (en) * 2012-12-21 2017-03-28 Google Inc. System and method for providing a preview of a digital photo album
KR102001332B1 (en) 2012-12-29 2019-07-17 애플 인크. Device, method, and graphical user interface for determining whether to scroll or select contents
EP2939097B1 (en) 2012-12-29 2018-12-26 Apple Inc. Device, method, and graphical user interface for navigating user interface hierarchies
WO2014105279A1 (en) 2012-12-29 2014-07-03 Yknots Industries Llc Device, method, and graphical user interface for switching between user interfaces
CN108845748A (en) 2012-12-29 2018-11-20 苹果公司 For abandoning generating equipment, method and the graphic user interface of tactile output for more contact gestures
WO2014105276A1 (en) 2012-12-29 2014-07-03 Yknots Industries Llc Device, method, and graphical user interface for transitioning between touch input to display output relationships
JP6095380B2 (en) * 2013-01-25 2017-03-15 キヤノン株式会社 Communication device, communication device control method, program
US8989773B2 (en) 2013-01-29 2015-03-24 Apple Inc. Sharing location information among devices
JP6219037B2 (en) * 2013-02-06 2017-10-25 任天堂株式会社 Information processing program, information processing apparatus, information processing system, and information processing method
US10334151B2 (en) 2013-04-22 2019-06-25 Google Llc Phase detection autofocus using subaperture images
US20140267281A1 (en) * 2013-03-13 2014-09-18 Ericom Software Ltd. Method for displaying a remote desktop on a portable touch screen device
US9471200B2 (en) 2013-03-15 2016-10-18 Apple Inc. Device, method, and graphical user interface for organizing and presenting a collection of media items
WO2014155696A1 (en) * 2013-03-29 2014-10-02 株式会社 東芝 Electronic apparatus, control method, and program
CN104113682B (en) * 2013-04-22 2018-08-31 联想(北京)有限公司 A kind of image acquiring method and electronic equipment
US20140331131A1 (en) * 2013-05-02 2014-11-06 Autumn Brandy DeSellem Accessible Self-Service Kiosk
US10168882B2 (en) * 2013-06-09 2019-01-01 Apple Inc. Device, method, and graphical user interface for switching between camera interfaces
US10031586B2 (en) * 2013-06-12 2018-07-24 Amazon Technologies, Inc. Motion-based gestures for a computing device
JP6188490B2 (en) * 2013-08-28 2017-08-30 キヤノン株式会社 Image display apparatus, control method, and computer program
IN2013CH03958A (en) * 2013-09-04 2015-08-07 Samsung India Software Operations Pvt Ltd Method and system for providing enhanced user experience for camera application using fingerprint scanner
US9665206B1 (en) 2013-09-18 2017-05-30 Apple Inc. Dynamic user interface adaptable to multiple input tools
JP6257255B2 (en) * 2013-10-08 2018-01-10 キヤノン株式会社 Display control device and control method of display control device
JP2014014194A (en) * 2013-10-23 2014-01-23 Kyocera Corp Portable terminal device
US20150121314A1 (en) * 2013-10-24 2015-04-30 Jens Bombolowsky Two-finger gestures
US10282056B2 (en) * 2013-12-24 2019-05-07 Dropbox, Inc. Sharing content items from a collection
CN103713819A (en) * 2013-12-26 2014-04-09 厦门美图之家科技有限公司 Method for rapidly selecting photos in batches from photo album based on sequence
JP6398190B2 (en) * 2013-12-26 2018-10-03 株式会社リコー Information processing apparatus, information processing method, and program
JP2014063541A (en) * 2014-01-15 2014-04-10 Nikon Corp Display device
US9836205B2 (en) * 2014-02-27 2017-12-05 Dropbox, Inc. Activating a camera function within a content management application
US10095398B2 (en) 2014-02-27 2018-10-09 Dropbox, Inc. Navigating galleries of digital content
PL2921944T3 (en) * 2014-03-17 2019-06-28 Nokia Technologies Oy User interface
US20150277550A1 (en) * 2014-04-01 2015-10-01 Moju Labs, Inc. Face-Centered Motion-Based Content Navigation
US9942464B2 (en) 2014-05-27 2018-04-10 Thomson Licensing Methods and systems for media capture and seamless display of sequential images using a touch sensitive device
US9483763B2 (en) 2014-05-29 2016-11-01 Apple Inc. User interface for payments
US9967401B2 (en) 2014-05-30 2018-05-08 Apple Inc. User interface for phone call routing among devices
US9207835B1 (en) 2014-05-31 2015-12-08 Apple Inc. Message user interfaces for capture and transmittal of media and location content
US10382378B2 (en) 2014-05-31 2019-08-13 Apple Inc. Live location sharing
JP6409344B2 (en) * 2014-06-03 2018-10-24 株式会社ニコン Programs and electronics
WO2016025036A1 (en) * 2014-08-15 2016-02-18 Apple Inc. Authenticated device used to unlock another device
US10339293B2 (en) 2014-08-15 2019-07-02 Apple Inc. Authenticated device used to unlock another device
KR20160024208A (en) * 2014-08-25 2016-03-04 삼성전자주식회사 Method and for sensing proximity in electronic device and the electronic device thereof
EP2990923A1 (en) * 2014-08-28 2016-03-02 Samsung Electronics Co., Ltd Image display device and method
JP2015007800A (en) * 2014-08-29 2015-01-15 レノボ・イノベーションズ・リミテッド（香港） Image display device, method for controlling operation, and program
AU2015312369B2 (en) 2014-09-02 2018-04-05 Apple Inc. Reduced-size interfaces for managing alerts
US20160062571A1 (en) * 2014-09-02 2016-03-03 Apple Inc. Reduced size user interface
WO2016036603A1 (en) 2014-09-02 2016-03-10 Apple Inc. Reduced size configuration interface
US20170010776A1 (en) * 2014-09-08 2017-01-12 Tableau Software Inc. Methods and Devices for Adjusting Chart Filters
US10347027B2 (en) 2014-09-08 2019-07-09 Tableau Software, Inc. Animated transition between data visualization versions at different levels of detail
US10347018B2 (en) 2014-09-08 2019-07-09 Tableau Software, Inc. Interactive data visualization user interface with hierarchical filtering based on gesture location on a chart
US10380770B2 (en) 2014-09-08 2019-08-13 Tableau Software, Inc. Interactive data visualization user interface with multiple interaction profiles
KR20160071694A (en) * 2014-12-12 2016-06-22 삼성전자주식회사 Method, device, and recording medium for processing web application
USD775173S1 (en) * 2014-12-31 2016-12-27 Samsung Electronics Co., Ltd. Display screen or portion thereof with graphical user interface
US20160253837A1 (en) * 2015-02-26 2016-09-01 Lytro, Inc. Parallax bounce
USD765098S1 (en) 2015-03-06 2016-08-30 Apple Inc. Display screen or portion thereof with graphical user interface
US9990107B2 (en) 2015-03-08 2018-06-05 Apple Inc. Devices, methods, and graphical user interfaces for displaying and using menus
US10048757B2 (en) 2015-03-08 2018-08-14 Apple Inc. Devices and methods for controlling media presentation
US10095396B2 (en) 2015-03-08 2018-10-09 Apple Inc. Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object
US9632664B2 (en) 2015-03-08 2017-04-25 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10216351B2 (en) 2015-03-08 2019-02-26 Apple Inc. Device configuration user interface
US9639184B2 (en) 2015-03-19 2017-05-02 Apple Inc. Touch input cursor manipulation
US10152208B2 (en) 2015-04-01 2018-12-11 Apple Inc. Devices and methods for processing touch inputs based on their intensities
US10341632B2 (en) 2015-04-15 2019-07-02 Google Llc. Spatial random access enabled video system with a three-dimensional viewing volume
US10469873B2 (en) 2015-04-15 2019-11-05 Google Llc Encoding and decoding virtual reality video
US10275898B1 (en) 2015-04-15 2019-04-30 Google Llc Wedge-based light-field video capture
US10419737B2 (en) 2015-04-15 2019-09-17 Google Llc Data structures and delivery methods for expediting virtual reality playback
US10412373B2 (en) 2015-04-15 2019-09-10 Google Llc Image capture for virtual reality displays
US20160358133A1 (en) 2015-06-05 2016-12-08 Apple Inc. User interface for loyalty accounts and private label accounts for a wearable device
US10200598B2 (en) 2015-06-07 2019-02-05 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9674426B2 (en) * 2015-06-07 2017-06-06 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9830048B2 (en) 2015-06-07 2017-11-28 Apple Inc. Devices and methods for processing touch inputs with instructions in a web page
US9891811B2 (en) 2015-06-07 2018-02-13 Apple Inc. Devices and methods for navigating between user interfaces
US10346030B2 (en) 2015-06-07 2019-07-09 Apple Inc. Devices and methods for navigating between user interfaces
US10310719B2 (en) 2015-06-09 2019-06-04 Whatsapp Inc. Techniques for media album display and management
US20160364108A1 (en) * 2015-06-09 2016-12-15 Whatsapp Inc. Techniques for interactive media album display and management
US20160378286A1 (en) * 2015-06-25 2016-12-29 Yahoo!, Inc. User interface adjustment methods and systems
US9979909B2 (en) 2015-07-24 2018-05-22 Lytro, Inc. Automatic lens flare detection and correction for light-field images
US10298746B2 (en) 2015-07-29 2019-05-21 Lg Electronics Inc. Mobile terminal and method for controlling same
US9880735B2 (en) 2015-08-10 2018-01-30 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10248308B2 (en) 2015-08-10 2019-04-02 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interfaces with physical gestures
US20170045981A1 (en) 2015-08-10 2017-02-16 Apple Inc. Devices and Methods for Processing Touch Inputs Based on Their Intensities
US10235035B2 (en) 2015-08-10 2019-03-19 Apple Inc. Devices, methods, and graphical user interfaces for content navigation and manipulation
US10416800B2 (en) 2015-08-10 2019-09-17 Apple Inc. Devices, methods, and graphical user interfaces for adjusting user interface objects
CN105243057A (en) * 2015-09-30 2016-01-13 北京奇虎科技有限公司 Method for translating web page contents and electronic device.
US10331873B1 (en) * 2015-10-09 2019-06-25 United Services Automobile Association (“USAA”) Graphical event-based password system
US9762781B2 (en) 2015-10-30 2017-09-12 Essential Products, Inc. Apparatus and method to maximize the display area of a mobile device by increasing the size of the display without necessarily increasing the size of the phone
US9723114B2 (en) 2015-10-30 2017-08-01 Essential Products, Inc. Unibody contact features on a chassis shell of a mobile device
US9736383B2 (en) * 2015-10-30 2017-08-15 Essential Products, Inc. Apparatus and method to maximize the display area of a mobile device
CN105607932B (en) * 2015-12-23 2019-07-26 青岛海信电器股份有限公司 A kind of method and apparatus that display file deletes process
USD799543S1 (en) * 2016-02-04 2017-10-10 Amazon Technologies, Inc. Display screen having an icon
JP2016184927A (en) * 2016-04-26 2016-10-20 株式会社ニコン Electronic apparatus
DK179186B1 (en) 2016-05-19 2018-01-15 Apple Inc Remote authorization to continue with an action
US9832368B1 (en) * 2016-05-31 2017-11-28 Motorola Mobility Llc Managing unintended camera clicks
US10275892B2 (en) 2016-06-09 2019-04-30 Google Llc Multi-view scene segmentation and propagation
DK201670608A1 (en) 2016-06-12 2018-01-02 Apple Inc User interfaces for retrieving contextually relevant media content
US20170357672A1 (en) 2016-06-12 2017-12-14 Apple Inc. Relating digital assets using notable moments
CN106095280B (en) * 2016-06-24 2019-05-17 维沃移动通信有限公司 A kind of photographic method and mobile terminal
KR20180018015A (en) * 2016-08-12 2018-02-21 엘지전자 주식회사 Mobile terminal and method for controlling the same
GB2554668A (en) * 2016-09-30 2018-04-11 Apical Ltd Image manipulation
JP2018077701A (en) * 2016-11-10 2018-05-17 キヤノン株式会社 Electronic apparatus, control method for electronic apparatus, and program
US10474227B2 (en) 2017-05-09 2019-11-12 Google Llc Generation of virtual reality with 6 degrees of freedom from limited viewer data
US10444931B2 (en) 2017-05-09 2019-10-15 Google Llc Vantage generation and interactive playback
US10440407B2 (en) 2017-05-09 2019-10-08 Google Llc Adaptive control for immersive experience delivery
US10354399B2 (en) 2017-05-25 2019-07-16 Google Llc Multi-view back-projection to a light-field
KR101871779B1 (en) 2017-07-07 2018-06-27 김태수 Terminal Having Application for taking and managing picture
JP2018082446A (en) * 2017-12-11 2018-05-24 株式会社ニコン Electronic apparatus
US10482359B2 (en) * 2018-01-18 2019-11-19 Google Llc Systems and methods for removing non-stationary objects from imagery
US3859005A (en) 1973-08-13 1975-01-07 Albert L Huebner Erosion reduction in wet turbines
US4826405A (en) 1985-10-15 1989-05-02 Aeroquip Corporation Fan blade fabrication system
JPS639138A (en) 1986-06-30 1988-01-14 Hitachi Chem Co Ltd Manufacture of wiring board with lead pin
JPH03217976A (en) 1990-01-23 1991-09-25 Canon Inc Image processing system
US5583542A (en) * 1992-05-26 1996-12-10 Apple Computer, Incorporated Method for deleting objects on a computer display
JPH06309138A (en) 1993-04-26 1994-11-04 Toshiba Corp Screen control method using touch panel
JP3337798B2 (en) * 1993-12-24 2002-10-21 キヤノン株式会社 Apparatus for processing image data and audio data, the data processing apparatus and data processing method
JP3974948B2 (en) * 1994-10-07 2007-09-12 株式会社日立製作所 Page turning display method and apparatus
US5677708A (en) * 1995-05-05 1997-10-14 Microsoft Corporation System for displaying a list on a display screen
JPH1093848A (en) * 1996-09-17 1998-04-10 Nikon Corp Electronic camera
US6069626A (en) * 1997-02-27 2000-05-30 International Business Machines Corporation Method and apparatus for improved scrolling functionality in a graphical user interface utilizing a transparent scroll bar icon
US6233015B1 (en) 1997-06-27 2001-05-15 Eastman Kodak Company Camera with user compliant browse and display modes
US6920619B1 (en) * 1997-08-28 2005-07-19 Slavoljub Milekic User interface for removing an object from a display
US6301586B1 (en) * 1997-10-06 2001-10-09 Canon Kabushiki Kaisha System for managing multimedia objects
JP4280314B2 (en) 1997-11-27 2009-06-17 富士フイルム株式会社 Device operating device having a screen display unit
KR100595915B1 (en) 1998-01-26 2006-07-05 웨인 웨스터만 Method and apparatus for integrating manual input
US6784925B1 (en) * 1998-03-24 2004-08-31 Canon Kabushiki Kaisha System to manage digital camera images
US6181316B1 (en) * 1998-06-04 2001-01-30 International Business Machines Corporation Graphical user interface inline scroll control
US6570594B1 (en) * 1998-06-30 2003-05-27 Sun Microsystems, Inc. User interface with non-intrusive display element
US6292273B1 (en) 1998-08-07 2001-09-18 Hewlett-Packard Company Appliance and method of using same having a delete capability for saved data
JP2000138883A (en) 1998-11-02 2000-05-16 Olympus Optical Co Ltd Image handling apparatus
JP3519007B2 (en) * 1999-01-29 2004-04-12 シャープ株式会社 Information devices and map information display method, and a recording medium for recording the map information display program having the map information display function
JP2000244673A (en) 1999-02-24 2000-09-08 Matsushita Electric Ind Co Ltd Portable telephone device and its method
JP2000350134A (en) 1999-06-08 2000-12-15 Sony Corp Digital camera
CN1156746C (en) * 1999-10-20 2004-07-07 皇家菲利浦电子有限公司 Device and method of browing image collection
JP4264170B2 (en) 1999-11-02 2009-05-13 富士フイルム株式会社 Imaging apparatus and control method thereof
GB2359177A (en) 2000-02-08 2001-08-15 Nokia Corp Orientation sensitive display and selection mechanism
US20020021758A1 (en) * 2000-03-15 2002-02-21 Chui Charles K. System and method for efficient transmission and display of image details by re-usage of compressed data
JP2001265481A (en) 2000-03-21 2001-09-28 Nec Corp Method and device for displaying page information and storage medium with program for displaying page information stored
JP4325075B2 (en) * 2000-04-21 2009-09-02 ソニー株式会社 Data object management device
JP3396718B2 (en) 2000-04-24 2003-04-14 株式会社ヘリオス Communication terminal device, image information storage method, and information storage medium
US7688306B2 (en) * 2000-10-02 2010-03-30 Apple Inc. Methods and apparatuses for operating a portable device based on an accelerometer
TW486657B (en) * 2000-10-26 2002-05-11 Animeta Systems Inc Browser interface operation device and its browsing method
JP2003076647A (en) 2001-08-31 2003-03-14 Hitachi Ltd Mail transmitting/receiving method, and device using it
US7299418B2 (en) * 2001-09-10 2007-11-20 International Business Machines Corporation Navigation method for visual presentations
FI114175B (en) 2001-09-10 2004-08-31 Myorigo Oy Navigation Method, program product and apparatus for presenting information in the user interface
JP2003091347A (en) * 2001-09-18 2003-03-28 Sony Corp Information processor, screen display method, screen display program and recording medium recording the screen display program
FR2830093A3 (en) 2001-09-25 2003-03-28 Bahia 21 Corp Method of navigation on a touch-sensitive screen, uses a control on the display panel to stop and start scrolling of icons across screen
US6961908B2 (en) * 2001-12-05 2005-11-01 International Business Machines Corporation System and method for navigating graphical images
AU2003220400A1 (en) 2002-03-19 2003-10-08 America Online, Inc. Controlling content display
US6882337B2 (en) * 2002-04-18 2005-04-19 Microsoft Corporation Virtual keyboard for touch-typing using audio feedback
JP3977684B2 (en) * 2002-05-21 2007-09-19 株式会社東芝 Digital still camera
JP2003345491A (en) 2002-05-24 2003-12-05 Sharp Corp Display input apparatus, display input method, program and recording medium
JP2004032346A (en) 2002-06-26 2004-01-29 Toshiba Corp Picture photographing apparatus
TW591488B (en) * 2002-08-01 2004-06-11 Tatung Co Window scrolling method and device thereof
FI20021759A0 (en) 2002-10-03 2002-10-03 Nokia Corp The method and user interface for entering text
JP2004145291A (en) 2002-10-03 2004-05-20 Casio Comput Co Ltd Image display apparatus, method and program for image display
US20040085457A1 (en) 2002-10-31 2004-05-06 Thorland Miles K. Reviewing stored images
US7360172B2 (en) * 2002-12-19 2008-04-15 Microsoft Corporation Contact controls
US7380212B2 (en) * 2003-03-18 2008-05-27 Microsoft Corporation Dynamic-template incorporation of digital images in an electronic mail message
CN100370799C (en) 2003-04-18 2008-02-20 卡西欧计算机株式会社 Imaging apparatus with communication function, image data storing method and computer program
JP4374610B2 (en) 2003-04-18 2009-12-02 カシオ計算機株式会社 Imaging apparatus, image data storage method, and program
JP4236986B2 (en) 2003-05-09 2009-03-11 富士フイルム株式会社 Imaging apparatus, method, and program
JP4145746B2 (en) * 2003-07-17 2008-09-03 シャープ株式会社 Information output device, information output method, information output program, and recording medium containing the program
US7164410B2 (en) * 2003-07-28 2007-01-16 Sig G. Kupka Manipulating an on-screen object using zones surrounding the object
JP2005102126A (en) * 2003-08-21 2005-04-14 Casio Comput Co Ltd Image pickup device with communication function and display processing method
CN1275023C (en) 2003-09-02 2006-09-13 纬创资通股份有限公司 Installation system of detecting device and its method
JP2005092386A (en) * 2003-09-16 2005-04-07 Sony Corp Image selection apparatus and method
US7078785B2 (en) 2003-09-23 2006-07-18 Freescale Semiconductor, Inc. Semiconductor device and making thereof
JP2005100084A (en) 2003-09-25 2005-04-14 Toshiba Corp Image processor and method
US7484175B2 (en) * 2003-09-30 2009-01-27 International Business Machines Corporation Method and apparatus for increasing personability of instant messaging with user images
US7545428B2 (en) * 2003-10-02 2009-06-09 Hewlett-Packard Development Company, L.P. System and method for managing digital images
US7343568B2 (en) * 2003-11-10 2008-03-11 Yahoo! Inc. Navigation pattern on a directory tree
JP2005150836A (en) 2003-11-11 2005-06-09 Canon Inc Photographing apparatus
US20050122345A1 (en) 2003-12-05 2005-06-09 Kirn Kevin N. System and method for media-enabled messaging having publish-and-send feature
JP4292399B2 (en) * 2003-12-12 2009-07-08 ソニー株式会社 Image processing apparatus and image processing method
JP4373199B2 (en) * 2003-12-17 2009-11-25 株式会社エヌ・ティ・ティ・ドコモ E-mail creation device and communication terminal
JP2005202483A (en) 2004-01-13 2005-07-28 Sony Corp Information processor, information processing method and program
JP2005202651A (en) 2004-01-15 2005-07-28 Canon Inc Information processing apparatus, information processing method, recording medium with program recorded thereon, and control program
KR100853605B1 (en) 2004-03-23 2008-08-22 후지쯔 가부시끼가이샤 Distinguishing tilt and translation motion components in handheld devices
JP2005303728A (en) 2004-04-13 2005-10-27 Fuji Photo Film Co Ltd Digital camera
JP2005321516A (en) 2004-05-07 2005-11-17 Mitsubishi Electric Corp Mobile device
JP4063246B2 (en) * 2004-05-11 2008-03-19 日本電気株式会社 Page information display device
JP5055684B2 (en) * 2004-05-13 2012-10-24 ソニー株式会社 Image folder switching device
CN100498761C (en) 2004-05-24 2009-06-10 株式会社东芝;东芝医疗系统株式会社 Medical image display apparatus
JP4855654B2 (en) 2004-05-31 2012-01-18 ソニー株式会社 On-vehicle device, on-vehicle device information providing method, on-vehicle device information providing method program, and on-vehicle device information providing method program
US7084494B2 (en) * 2004-06-18 2006-08-01 Texas Instruments Incorporated Semiconductor package having integrated metal parts for thermal enhancement
US7464110B2 (en) * 2004-06-30 2008-12-09 Nokia Corporation Automated grouping of image and other user data
TWI248576B (en) * 2004-07-05 2006-02-01 Elan Microelectronics Corp Method for controlling rolling of scroll bar on a touch panel
JP4903371B2 (en) * 2004-07-29 2012-03-28 任天堂株式会社 Game device and game program using touch panel
JP2006067344A (en) * 2004-08-27 2006-03-09 Mitsubishi Electric Corp Method for transmitting e-mail with image, and communication terminal
CN1756273A (en) 2004-09-27 2006-04-05 华为技术有限公司 Method for adding linkman information in hand-held equipment telephone directory
KR101058011B1 (en) * 2004-10-01 2011-08-19 삼성전자주식회사 How to Operate Digital Camera Using Touch Screen
US7778671B2 (en) * 2004-10-08 2010-08-17 Nokia Corporation Mobile communications terminal having an improved user interface and method therefor
US20060077266A1 (en) * 2004-10-08 2006-04-13 Nokia Corporation Image processing in a communication device having a camera
KR101058013B1 (en) * 2004-10-13 2011-08-19 삼성전자주식회사 Thumbnail image retrieval method of digital storage device with touch screen
WO2006045530A2 (en) 2004-10-22 2006-05-04 Novo Nordisk A/S An apparatus and a method of providing information to a user
US7433546B2 (en) 2004-10-25 2008-10-07 Apple Inc. Image scaling arrangement
JP4565495B2 (en) 2004-11-10 2010-10-20 富士通株式会社 Terminal device, mail processing method of terminal device, and mail processing program
JP4306592B2 (en) 2004-11-15 2009-08-05 ソニー株式会社 Playback device and display control method
US20060136839A1 (en) * 2004-12-22 2006-06-22 Nokia Corporation Indicating related content outside a display area
US8024658B1 (en) * 2005-01-09 2011-09-20 Apple Inc. Application for designing photo albums
JP4932159B2 (en) 2005-01-11 2012-05-16 Ｎｅｃカシオモバイルコミュニケーションズ株式会社 Communication terminal, communication terminal display method, and computer program
JP2006236249A (en) * 2005-02-28 2006-09-07 Fuji Photo Film Co Ltd Device for preparing attached image file for e-mail, its method and its control program
FI20055369A0 (en) * 2005-06-30 2005-06-30 Nokia Corp Method and device for processing digital media files
JP4782105B2 (en) * 2005-06-30 2011-09-28 パナソニック株式会社 Image processing apparatus and image processing method
JP4600203B2 (en) * 2005-08-08 2010-12-15 株式会社日立製作所 Video playback device
US8085318B2 (en) * 2005-10-11 2011-12-27 Apple Inc. Real-time image capture and manipulation based on streaming data
US7786975B2 (en) * 2005-12-23 2010-08-31 Apple Inc. Continuous scrolling list with acceleration
US7559027B2 (en) * 2006-02-28 2009-07-07 Palm, Inc. Master multimedia software controls
US20070229678A1 (en) * 2006-03-31 2007-10-04 Ricoh Company, Ltd. Camera for generating and sharing media keys
US7627828B1 (en) 2006-04-12 2009-12-01 Google Inc Systems and methods for graphically representing users of a messaging system
KR20070102346A (en) * 2006-04-13 2007-10-18 삼성전자주식회사 Method and apparatus for generating xhtml data of device
US7783990B2 (en) 2006-05-05 2010-08-24 Microsoft Corporation Association of display elements
US20080030456A1 (en) * 2006-07-19 2008-02-07 Sony Ericsson Mobile Communications Ab Apparatus and Methods for Providing Motion Responsive Output Modifications in an Electronic Device
US7791594B2 (en) * 2006-08-30 2010-09-07 Sony Ericsson Mobile Communications Ab Orientation based multiple mode mechanically vibrated touch screen display
US7855714B2 (en) * 2006-09-01 2010-12-21 Research In Motion Limited Method and apparatus for controlling a display in an electronic device
JP5156217B2 (en) 2006-10-24 2013-03-06 株式会社Ｅ−マテリアル Refractory coating material, coating method of refractory coating material, and coating of refractory coating
US20080133697A1 (en) * 2006-12-05 2008-06-05 Palm, Inc. Auto-blog from a mobile device
US7469381B2 (en) * 2007-01-07 2008-12-23 Apple Inc. List scrolling and document translation, scaling, and rotation on a touch-screen display
US8717412B2 (en) * 2007-07-18 2014-05-06 Samsung Electronics Co., Ltd. Panoramic image production
JP5697058B2 (en) * 2013-02-27 2015-04-08 株式会社ユピテル Navigation device and program
2007-08-30 US US11/848,210 patent/US8106856B2/en active Active
2007-08-31 AT AT07814633T patent/AT483196T/en not_active IP Right Cessation
2007-08-31 JP JP2009526943A patent/JP4892061B2/en active Active
2007-08-31 DE DE202007018421U patent/DE202007018421U1/en not_active Expired - Lifetime
2007-08-31 KR KR1020097009549A patent/KR101170877B1/en active IP Right Grant
2007-08-31 DE DE202007019586.9U patent/DE202007019586U1/en not_active Expired - Lifetime
2007-08-31 DE DE202007019585.0U patent/DE202007019585U1/en not_active Expired - Lifetime
2007-08-31 CA CA2984527A patent/CA2984527A1/en active Pending
2007-08-31 EP EP18197554.1A patent/EP3447620A3/en active Pending
2007-08-31 EP EP10172417.7A patent/EP2282275B1/en active Active
2007-08-31 DE DE202007019583.4U patent/DE202007019583U1/en not_active Expired - Lifetime
2007-08-31 DE DE202007019581.8U patent/DE202007019581U1/en not_active Expired - Lifetime
2007-08-31 CA CA2935875A patent/CA2935875C/en active Active
2007-08-31 EP EP11178257.9A patent/EP2390799B1/en active Active
2007-08-31 DE DE212007000015U patent/DE212007000015U1/en not_active Expired - Lifetime
2007-08-31 AU AU2007283771A patent/AU2007283771C1/en active Active
2007-08-31 HK HK08110871.5A patent/HK1134885A2/en not_active IP Right Cessation
2007-08-31 DE DE602007009551T patent/DE602007009551D1/en active Active
2007-08-31 DE DE202007019579.6U patent/DE202007019579U1/en not_active Expired - Lifetime
2007-08-31 EP EP11178259.5A patent/EP2390779B1/en active Active
2007-08-31 CA CA2627118A patent/CA2627118C/en active Active
2007-08-31 EP EP07814633A patent/EP2059868B1/en active Active
2007-08-31 HK HK08110872.4A patent/HK1134886A2/en not_active IP Right Cessation
2007-08-31 CA CA2853273A patent/CA2853273C/en active Active
2007-08-31 KR KR1020097007065A patent/KR101132872B1/en active IP Right Grant
2007-08-31 WO PCT/US2007/077441 patent/WO2008030779A2/en active Application Filing
2007-08-31 CA CA2762030A patent/CA2762030C/en active Active
2007-08-31 CN CN2010102276338A patent/CN101893992B/en active IP Right Grant
2007-08-31 DE DE202007019584.2U patent/DE202007019584U1/en not_active Expired - Lifetime
2007-08-31 DE DE112007000067T patent/DE112007000067T5/en active Pending
2009-09-02 AU AU2009212904A patent/AU2009212904B2/en active Active
2011-05-24 HK HK11105131.6A patent/HK1151115A1/en unknown
2011-12-12 JP JP2011271621A patent/JP5313325B2/en active Active
2012-01-30 US US13/361,912 patent/US8305355B2/en active Active
2012-05-29 HK HK12105228.9A patent/HK1165034A1/en unknown
2012-11-01 US US13/666,943 patent/US9459792B2/en active Active
2013-07-03 JP JP2013140171A patent/JP5771242B2/en active Active
2014-12-22 JP JP2014259225A patent/JP6117766B2/en active Active
2015-06-26 JP JP2015129152A patent/JP6174083B2/en active Active
2016-09-30 US US15/281,524 patent/US10356309B2/en active Active
2017-03-23 JP JP2017057997A patent/JP6343697B2/en active Active
2017-07-05 JP JP2017132229A patent/JP6377216B2/en active Active
2018-07-24 JP JP2018138559A patent/JP2018198070A/en active Pending
2019-06-24 US US16/450,531 patent/US20190313012A1/en active Pending
KR101170877B1 (en) 2012-08-02
KR20090066319A (en) 2009-06-23
WO2008030779A3 (en) 2008-06-26
CN101893992A (en) 2010-11-24
CN101893992B (en) 2012-10-10
US20120127207A1 (en) 2012-05-24
WO2008030779A2 (en) 2008-03-13
EP2390799B1 (en) 2013-07-17
CA2853273A1 (en) 2008-03-13
JP6174083B2 (en) 2017-08-02
JP2017208117A (en) 2017-11-24
JP4892061B2 (en) 2012-03-07
AU2007283771C1 (en) 2010-06-03
HK1134885A2 (en) 2010-05-14
JP2012094170A (en) 2012-05-17
EP2390799A1 (en) 2011-11-30
JP2018198070A (en) 2018-12-13
AU2009212904B2 (en) 2011-09-22
DE202007019586U1 (en) 2014-02-12
CA2627118C (en) 2012-03-06
EP3447620A2 (en) 2019-02-27
DE212007000015U1 (en) 2008-07-24
US20170019587A1 (en) 2017-01-19
JP2017142827A (en) 2017-08-17
JP6343697B2 (en) 2018-06-13
EP2282275A1 (en) 2011-02-09
DE202007019585U1 (en) 2014-02-12
AU2007283771A1 (en) 2008-04-03
AU2007283771B8 (en) 2010-01-28
EP2390779A1 (en) 2011-11-30
CA2853273C (en) 2016-10-11
EP2059868B1 (en) 2010-09-29
DE202007019581U1 (en) 2014-01-27
KR20090060429A (en) 2009-06-12
DE112007000067T5 (en) 2008-09-18
DE602007009551D1 (en) 2010-11-11
US9459792B2 (en) 2016-10-04
DE202007018421U1 (en) 2008-06-26
EP2390779B1 (en) 2019-05-01
US20080052945A1 (en) 2008-03-06
JP2013239193A (en) 2013-11-28
HK1165034A1 (en) 2013-10-25
CA2627118A1 (en) 2008-03-13
KR101132872B1 (en) 2012-04-03
JP2015097104A (en) 2015-05-21
DE202007019579U1 (en) 2014-01-27
US20130061175A1 (en) 2013-03-07
JP5313325B2 (en) 2013-10-09
CA2935875A1 (en) 2008-03-13
AU2009212904A1 (en) 2009-09-24
JP2015215913A (en) 2015-12-03
CA2984527A1 (en) 2008-03-13
EP3447620A3 (en) 2019-07-03
DE202007019584U1 (en) 2014-02-12
CA2762030A1 (en) 2008-03-13
DE202007019583U1 (en) 2014-02-12
JP2010503082A (en) 2010-01-28
CA2762030C (en) 2014-08-19
JP5771242B2 (en) 2015-08-26
AU2007283771B2 (en) 2009-10-01
HK1134886A2 (en) 2010-05-14
HK1151115A1 (en) 2013-11-01
US8305355B2 (en) 2012-11-06
AT483196T (en) 2010-10-15
US10356309B2 (en) 2019-07-16
US20190313012A1 (en) 2019-10-10
EP2059868A2 (en) 2009-05-20
JP6377216B2 (en) 2018-08-22
US8106856B2 (en) 2012-01-31
CA2935875C (en) 2017-12-19
JP6117766B2 (en) 2017-04-19
US9049302B2 (en) 2015-06-02 Portable multifunction device, method, and graphical user interface for managing communications received while in a locked state
US8407613B2 (en) 2013-03-26 Directory management on a portable multifunction device
EP2565767B1 (en) 2017-11-08 Portable multifunction device with interface reconfiguration mode
JP5335690B2 (en) 2013-11-06 Portable multifunction device, method and graphic user interface for interpreting finger gestures on a touch screen display
CA2661886C (en) 2014-10-21 Portable electronic device for instant messaging
KR101266622B1 (en) 2013-05-22 List scrolling and document translation, scaling, and rotation on a touch-screen display
US8607167B2 (en) 2013-12-10 Portable multifunction device, method, and graphical user interface for providing maps and directions
US8650507B2 (en) 2014-02-11 Selecting of text using gestures
USRE46864E1 (en) 2018-05-22 Insertion marker placement on touch sensitive display
EP2067094B1 (en) 2011-04-20 Methods for determining a cursor position from a finger contact with a touch screen display
CN101535939B (en) 2011-12-14 Delete stance on a portable multifunction device
US9772751B2 (en) 2017-09-26 Using gestures to slide between user interfaces
CN102681776B (en) 2015-05-06 Portable electronic device performing similar operations for different gestures
US20080165151A1 (en) 2008-07-10 System and Method for Viewing and Managing Calendar Entries
US7966578B2 (en) 2011-06-21 Portable multifunction device, method, and graphical user interface for translating displayed content
US20080165145A1 (en) 2008-07-10 Portable Multifunction Device, Method, and Graphical User Interface for Interpreting a Finger Swipe Gesture
US10409461B2 (en) 2019-09-10 Portable multifunction device, method, and graphical user interface for interacting with user input elements in displayed content
EP2118730B1 (en) 2013-01-23 Portrait-landscape rotation heuristics for a portable multifuncion device
KR101085768B1 (en) 2011-11-21 Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US8253695B2 (en) 2012-08-28 Email client for a portable multifunction device
2011-02-09 AC Divisional application: reference to earlier application
Ref document number: 2059868
2011-02-09 17P Request for examination filed
2011-02-09 AK Designated contracting states
2011-11-30 17Q First examination report despatched
Ref document number: 602007034267
Free format text: PREVIOUS MAIN CLASS: G06F0017300000
Ipc: G06F0003048800
2013-06-19 RIC1 Information provided on ipc code assigned before grant
Ipc: G06F 3/0485 20130101ALI20130516BHEP
Ipc: G06F 3/0488 20130101AFI20130516BHEP
2013-08-07 INTG Intention to grant announced
2013-12-11 AC Divisional application: reference to earlier application
2013-12-11 AK Designated contracting states
2013-12-11 REG Reference to a national code
2013-12-13 REG Reference to a national code
Ref document number: 644893
Effective date: 20140115
2014-04-15 REG Reference to a national code
2014-05-26 REG Reference to a national code
2014-05-30 PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]
2014-09-12 REG Reference to a national code
2014-11-19 26N No opposition filed
2014-12-24 REG Reference to a national code
2015-02-27 PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]
2015-03-31 PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]
2015-04-29 GBPC Gb: european patent ceased through non-payment of renewal fee
2015-04-30 PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]
2015-06-03 REG Reference to a national code
2016-06-30 PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]
2016-07-29 PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]
Payment date: 20190814
Payment date: 20190820
Payment date: 20190816
Payment date: 20190812
Payment date: 20190711
Payment date: 20190821