# Patent

## Title
Mobile terminal having touch screen and function controlling method of the same

## Abstract

A method for providing a graphical user interface on a display of a device includes displaying a photograph image on the display of the device, detecting a touch on the display, providing a plurality of control guides at a location corresponding to the touch over the displayed photograph image, in response to detecting the touch, detecting a first drag in a first direction corresponding to a first one of the plurality of control guides provided on the display, removing the plurality of control guides from the display in response to detecting the first drag, detecting a second drag in a second direction different from the first direction of the first drag and corresponding to a second one of the plurality of control guides, the second drag is performed while maintaining touch on the display after the first drag is performed, adjusting a display characteristic of the photograph image corresponding to the second one of the plurality of control guides corresponding to the second drag, and displaying the photograph image having the adjusted display characteristic on the display in response to detecting the second drag.

## Background
CROSS REFERENCE TO RELATED APPLICATIONS
This is a continuation application of U.S. patent application Ser. No. 14/052,406, filed in the U.S. Patent and Trademark Office on Oct. 11, 2013, which is a continuation application of U.S. patent application Ser. No. 12/335,772, filed in the U.S. Patent and Trademark Office on Dec. 16, 2008, now U.S. Pat. No. 8,558,801, which claims priority from Korean Patent Application No. 10-2007-0133866, filed on Dec. 20, 2007, filed in the Korean Intellectual Property Office, the disclosures of which are incorporated herein by reference in their entireties.


BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention relates generally to a mobile terminal and, more particularly, to a method of controlling a function of a mobile terminal, which has a touch screen to provide an interaction guide thereon.
2. Discussion of the Background
Advances in information and communication technologies have enabled a mobile terminal to perform multi-functions. For example, in addition to call processing, an advanced mobile terminal may support various supplementary functions such as a camera function, Digital Multimedia Broadcasting (DMB), and a Bluetooth®. function.
The mobile terminal may include an input unit, such as a keypad, to input control commands to control a variety of functions, however, it may be inconvenient for a user to manipulate the keypad with his/her finger because the keypad may be relatively small compared to his/her finger. Therefore, a mobile terminal may be provided with a touch screen instead of a keypad. However, a user using the mobile terminal having a touch screen may have difficulty in controlling various functions if the user is not familiar with processes of performing a function when a function is to be performed, which may result in unnecessary multiple touches of the touch screen.
SUMMARY OF THE INVENTION
The present invention provides a mobile terminal having a touch screen and a method of controlling a function thereof that may enable a user to control a variety of functions with ease.
Additional features of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention.
The present invention discloses a method of controlling a function of a mobile terminal having a touch screen. The method includes displaying a function execution screen on the touch screen, displaying a control interaction guide on the function execution screen in response to a request to display the control interaction guide, the control interaction guide to guide at least one control command to be executed on the function execution screen, determining a control command corresponding to a drag if the drag is detected on the touch screen, and executing a function corresponding to the control command on the function execution screen.
The present invention also discloses a mobile terminal including a touch screen including a touch panel to detect a drag and drop generated on the function execution screen and a display unit to display a function execution screen, a control unit to control the display unit to display of a control interaction guide to guide at least one control command to be executed on the function execution screen in response to a request to display the control interaction guide, to determine a control command corresponding to a drag generated on the function execution screen, and to execute a function corresponding to the control command on the function execution screen, and a memory unit to store the control command to be executed on the function execution screen and the control interaction guide to be displayed on the function execution screen.
The present invention also discloses a method of controlling a function of a mobile terminal having a touch screen including displaying a function execution screen on the touch screen, searching for a stored control interaction guide if an approach is detected, displaying the stored control interaction guide if the stored control interaction guide exists, stopping the display of the control interaction guide if a touch on the display control interaction guide is detected, calculating drag characteristic values when a drag is detected, determining a control command corresponding to the drag characteristic values, and executing a function corresponding to the control command.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.



BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention, and together with the description serve to explain the principles of the invention.
FIG. 1 shows a configuration of a mobile terminal having a touch screen to perform a function according to an exemplary embodiment of the present invention.
FIG. 2 is a flow chart showing a method of performing a function of a mobile terminal according to another exemplary embodiment of the present invention.
FIG. 3A, FIG. 3B, FIG. 3C, FIG. 3D, and FIG. 3E are screen representations showing the procedure of FIG. 2.
FIG. 4 is a flow chart showing a method of performing a function of a mobile terminal according to another exemplary embodiment of the present invention.



DETAILED DESCRIPTION OF THE ILLUSTRATED EMBODIMENTS
The invention is described more fully hereinafter with reference to the accompanying drawings, in which embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure is thorough, and will fully convey the scope of the invention to those skilled in the art. In the drawings, the size and relative sizes of layers and regions may be exaggerated for clarity. Like reference numerals in the drawings denote like elements.
It will be understood that when an element or layer is referred to as being “on” or “connected to” another element or layer, it can be directly on or directly connected to the other element or layer, or intervening elements or layers may be present. In contrast, when an element is referred to as being “directly on” or “directly connected to” another element or layer, there are no intervening elements or layers present.
In an exemplary embodiment of the present invention, the term “function execution screen” refers to a displayed screen of a mobile terminal when a particular function is performed. The term “control command” refers to a control command to perform a sub-function that is to be performed through the function execution screen when a particular function is performed. Such a control command may be, for example a zoom-in command or a zoom-out command when performing a camera function, or a volume control command or a playback command of a previous file or next file when performing an audio function. Herein, the control command may be a command to move to an upper-level menu or a lower-level menu or to a next menu of the same level. The control command may be performed in response to a user manipulation.
The term “control interaction guide” refers to a display image that guides control commands to be executed on a function execution screen of a mobile terminal. At this time, either none or at least one control interaction guide may be present according to a function execution screen. The control interaction guide may further include a direction image that shows a direction in which a user should move to manipulate corresponding control commands. Also, the control interaction guide may further include a symbol image that indicates corresponding control commands.
The term “touch” refers to an action in which a user contacts a touch screen using a touch device, typically a stylus or a finger. The term “drag” refers to an action in which a user moves the touch device along the touch screen. The term “drop” refers to an action in which a user releases a touch device contacting the touch screen from the touch screen.
FIG. 1 shows a configuration of a mobile terminal 100 according to an exemplary embodiment of the present invention. For the purpose of the following description, the mobile terminal 100 is embodied as a mobile phone.
Referring to FIG. 1, the mobile terminal 100 includes a wireless unit 110, a touch screen 120, a proximity sensor 130, a memory unit 140, a control unit 150, and an audio processor 160.
The wireless communication unit 110 performs wireless communication operations for the mobile terminal 100. The wireless unit 110 includes a radio frequency (RF) transmitter to upconvert the frequency of a signal to be transmitted and amplify the signal, and an RF receiver to low-noise amplify a received signal and downconvert the frequency of the received signal.
The touch screen 120 includes a display unit 121 and a touch panel 123. The display unit 121 displays a state of the mobile terminal 100. The display unit 121 may include an LCD, and in this case includes an LCD control unit, a memory to story display data, and an LCD display element. The touch panel 123 may be mounted on or integral with the display unit 121 and may include a touch sensor and a signal converter. The touch sensor detects control commands of a touch, a drag, and a drop from a change in magnitude of a physical parameter, such as pressure or another force, or a change in magnitude of an electrical parameter, such as capacitance or resistance. The signal converter converts the change in the magnitude of the physical or electrical parameter into a touch signal.
The proximity sensor 130 detects a presence of objects near to the touch screen 120 without any physical contact. The proximity sensor 130 detects, for instance, a variation of a temperature or luminous intensity. Herein, at least one proximity sensor 130 may be installed on the rear of the display unit 121 and on a side of the display unit 121. When a single proximity sensor 130 is installed, the proximity sensor 130 may be located to detect the movement of a user's hand toward the mobile terminal.
The memory unit 140 includes a program memory section and a data memory section. The program memory section stores programs of control commands to control the mobile terminal 100 and programs to perform a function using the touch screen 123 according to an exemplary embodiment of the present invention. The data memory section stores data generated during the execution of a program of the mobile terminal 100. The memory unit 140 stores a control command to be executed on each function execution screen according to an exemplary embodiment of the present invention. Further, the memory unit 140 stores a control interaction guide for guiding a control command according to an exemplary embodiment of the present invention.
The control unit 150 controls the overall operation of the mobile terminal 100. The control unit 150 performs a signal processing function to encode and modulate a signal to be transmitted, and to demodulate and decode a received signal. The control unit 150 may include a modulator/demodulator (modem) and a coder/decoder (codec).
In particular, the control unit 150 controls display of a function execution screen when executing a function according to an exemplary embodiment of the present invention. Further, the control unit 150 controls the display unit 121 to display a control interaction guide on the function execution screen by retrieving the control interaction guide from the memory unit 140 in response to a user request to display the control interaction guide while displaying the function execution screen. Herein, the control unit 150 may recognize an approach to the touch screen 120 through a proximity sensor 130 as a request to display a control interaction guide.
The control unit 150 may remove a control interaction guide from the function execution screen if an occurrence of a touch on the touch screen 120 is detected while the control interaction guide is being displayed. Further, the control unit 120 may remove a control interaction guide from the function execution screen if a time period for displaying the guide elapses while the control interaction guide is being displayed. In addition, the control unit 150 controls the mobile phone by detecting a control command corresponding to a drag if the drag is detected on the touch screen 120.
The audio processor 160 reproduces an audio signal from an audio codec through a speaker SPK, and transmits an audio signal from a microphone MIC to the audio codec.
FIG. 2 is a flow chart showing a method of performing a function of a mobile terminal according to another exemplary embodiment of the present invention. FIG. 3A, FIG. 3B, FIG. 3C, FIG. 3D, and FIG. 3E are screen representations showing processes of performing a function according to the method of FIG. 2. Specifically, FIG. 3A, FIG. 3B, FIG. 3C, FIG. 3D, and FIG. 3E are screen representations when a camera function is performed. In detail, FIG. 3A shows a touch screen when a particular function is to be performed. FIG. 3B shows the touch screen when an approach to the touch screen is detected. FIG. 3C shows the touch screen when a drag is detected on the touch screen. FIG. 3D shows the touch screen when a drop is detected on the touch screen. FIG. 3E shows the touch screen after the function is performed.
Referring to FIG. 2, a function execution screen is displayed on the touch screen 120 (S211) when a function is to be performed, as shown in FIG. 3A. For example, the control unit 150 may display a function execution screen as a preview screen when performing a camera function. If the control unit 150 detects an approach to the touch screen 120 (S213), the control unit 150 searches for a control interaction guide corresponding to the displayed function execution screen stored in the memory unit 140 (S215).
The control unit 150 determines if a control interaction guide to be displayed on the function execution screen exists (S217). In other words, the control unit 150 determines if a control command to be executed on the function execution screen corresponding to a function execution screen exists. If the control unit 150 determines that a control interaction guide stored in a memory unit 140 exists, the control unit 150 displays the control interaction guide (S219), as shown in FIG. 3B. For example, the control unit 150 may display a control interaction guide to guide a control command to be performed on the preview screen such as a zoom-in command, a zoom-out command, a brightness command, or a shot command.
If the control unit 150 detects a touch on the touch screen 120 (S221), the control unit 150 removes the control interaction guide from the function execution screen (S223), as shown in FIG. 3C.
If the control unit 150 detects a drag generated on the touch screen 120 (S225), the control unit determines changes of the drag coordinates and calculates values of drag characteristics therefrom (S227). For example, the control unit 150 calculates the distance, direction, and velocity of the drag. Next, the control unit 150 determines a control command to be executed on the function execution screen corresponding to the calculated drag characteristic values and executes a function corresponding to the determined control command (S229), as shown in FIG. 3D. For example, if the distance of the drag is X pixels, and the direction of the drag is upward, the control unit enlarges the preview screen by Y times (where Y=MX, M is a constant number).
The memory unit 140 may store a control command to be executed corresponding to specific drag characteristic values in advance. The control unit 150 may further display the calculated drag characteristic values on the function execution screen (not shown).
If the control unit 150 detects a drop generated on the touch screen 120 (S231), the control unit 150 terminates the function execution procedure, as shown in FIG. 3E. When the drop is detected, the control unit 150 may further control to perform functions determining a control command to be executed on the function execution screen corresponding to the drop and a subsequent touch (not shown in FIG. 2). If a drop is not detected through the touch screen 120 at step S231, the process returns to step S225 and the control unit 150 may repeat steps S225 to S231.
If a drop is detected at step S231, the control unit 150 may further determine a control command to be executed on the function execution screen corresponding to the touch and drop (not shown in FIG. 2).
In the exemplary embodiments, a control interaction guide is displayed when an approach to a touch screen is detected while a function execution screen of a mobile terminal is being displayed. However, the present invention is not limited thereto. For example, exemplary embodiments of the present invention can be realized by displaying various interaction guides in response to approaching different positions of a touch screen while displaying a function execution screen. In addition, the present invention can be realized by detecting a request to display a control interaction guide while a function execution guide of a mobile terminal is being displayed. For example, if a touch or a drop is detected on a touch screen while a control interaction guide is being displayed on a function execution screen of a mobile terminal, the touch or drop may be regarded as a request to display a control interaction guide.
In the exemplary embodiments, a control interaction guide is removed when a touch is detected while a control interaction guide is being displayed on the function execution screen of a mobile terminal. However, the present invention is not limited thereto. Exemplary embodiments of the present invention may be realized by detecting a request to remove a control interaction guide from a function execution screen of a mobile terminal. For example, a display period to display various control interaction guides may be stored in a memory unit of a mobile terminal. If the preset display period of a control interaction guide elapses while the control interaction guide is being displayed on a function execution screen of a mobile terminal, the elapse of the preset display period may be regarded as a request to remove the control interaction guide from the function execution screen.
According to exemplary embodiments of the present invention, when executing a function of a mobile terminal, a control command to be executed on a function execution screen may be guided by displaying a control interaction guide corresponding to the control command on a function execution screen. Thereby, a user of a mobile terminal may manipulate various functions of the mobile terminal conveniently.
FIG. 4 is a flow chart showing a method of performing a function of a mobile terminal according to another exemplary embodiment of the present invention. In this exemplary embodiment, a detailed explanation of a configuration of a mobile terminal is omitted, as the configuration of a mobile terminal in this exemplary embodiment is similar to the configuration of a mobile terminal in the exemplary embodiment of the present invention shown in FIG. 1, except that the mobile terminal of the present exemplary embodiment may not include a proximity sensor.
Referring to FIG. 4, a function execution screen is displayed on the touch screen 120 when a function is to be performed (S411). If the control unit 150 detects a touch on the touch screen 120 (S413), the control unit 150 searches for a control interaction guide corresponding to the touch on the displayed function execution screen stored in the memory 140.
If the control unit 150 determines that a control interaction guide to be displayed on a function execution screen exists (S417), the control unit 150 displays the control interaction guide (S419).
If the control unit 150 detects a drag generated on the touch screen 120 (S421), the control unit 150 removes the control interaction guide from the function execution screen (S423). The control unit 150 determines changes of the drag coordinates and calculates values of drag characteristics therefrom (S425). For example, the control unit 150 calculates the distance, direction, and velocity of the drag. The control unit 150 then determines a control command to be executed on the function execution screen corresponding to the calculated drag characteristic values and executes a function corresponding to the determined control command (S427). Herein, a control command corresponding to specific drag characteristic values may be stored in the memory unit 140 in advance. The control unit 150 may further display the calculated drag characteristic values corresponding to the control command on the function execution screen (not shown).
If the control unit 150 detects a drop generated on the touch screen 120 (S429), the control unit 150 terminates the function execution procedure. If a drop is not detected through the touch screen 120 at step S429, the control unit 150 may repeat steps S421 to S429.
When the drop is detected, the control unit 150 may further control the mobile terminal 100 to perform functions determining a control command to be executed on the function execution screen corresponding to the drop and a subsequent touch (not shown in FIG. 4). If a drop is not detected through the touch screen 120 at step S429, the process returns to step S421 and the control unit 150 may repeat the S421 to S429.
A method of detecting a control interaction guide while a control interaction guide is being displayed on a function execution screen is described in this exemplary embodiment, but the present invention is not limited thereto. Exemplary embodiments of the present invention may be realized by displaying various interaction guides in response to approaching different positions of a touch screen while a function execution screen is being displayed.
A method of removing a control interaction guide from a function execution screen is described in this exemplary embodiment, but the present invention is not limited thereto. Exemplary embodiments of the present invention may be implemented by detecting a request to remove a control interaction guide from a function execution screen. For example, a display period to display a specific interaction guide may be stored in a memory unit of a mobile terminal. If the preset display period elapses while the specific interaction guide is being displayed, the elapse of the preset display period may be regarded as a request to remove the control interaction guide from the function execution screen.
As apparent from the above description, the present invention provides a display of a control command that may be executed by a user on a function execution screen of a mobile terminal by displaying the control interaction guide on the function execution screen. As a result, a user may easily manipulate various functions using a touch screen of a mobile terminal.
It will be apparent to those skilled in the art that various modifications and variation can be made in the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

## Claims

1. A method for providing a graphical user interface on a display of a device, the method comprising:
displaying a photograph image on the display of the device;
detecting a touch on the display;
providing a plurality of control guides at a location corresponding to the touch over the displayed photograph image, in response to detecting the touch;
detecting a first drag in a first direction corresponding to a first one of the plurality of control guides provided on the display;
removing the plurality of control guides from the display in response to detecting the first drag;
detecting a second drag in a second direction different from the first direction of the first drag and corresponding to a second one of the plurality of control guides, the second drag is performed while maintaining touch on the display after the first drag is performed;
adjusting a display characteristic of the photograph image corresponding to the second one of the plurality of control guides corresponding to the second drag; and
displaying the photograph image having the adjusted display characteristic on the display in response to detecting the second drag.

2. The method according to claim 1, wherein the plurality of control guides are a plurality of directional arrows superimposed over the displayed photograph image.

3. The method according to claim 2, wherein the plurality of control guides are respectively associated with a plurality of different controls that adjust display characteristics of the photograph image.

4. The method according to claim 2, wherein the plurality of control guides are associated with text information describing the adjusting the display characteristic.

5. The method according to claim 2, wherein the plurality of directional arrows are respectively arranged to indicate different directions.

6. The method according to claim 1, wherein the display characteristic is a brightness of the photograph image.

7. The method according to claim 1, wherein the display characteristic is a magnification of the photograph image.

8. The method according to claim 1, wherein the display characteristic is adjusted based on a velocity of the drag.

9. The method according to claim 1, wherein the display characteristic is adjusted based on a distance of the drag.

10. The method according to claim 1, wherein the drag characteristic is a direction of the drag.

11. The method according to claim 1, wherein the plurality of control guides are associated with a plurality of tasks, respectively, and
the adjusting comprises adjusting the display characteristic in accordance with one of the plurality of tasks associated with the second one of the control guides.

12. The method according to claim 11, wherein different control guides among the plurality of control guides are displayed based on different locations of the touch input.

13. A non-transitory computer-readable medium having recorded thereon a program, which when executed by a computer causes the computer to execute a method for providing a graphical user interface on a display of a device, the method comprising:
displaying a photograph image on the display of the device;
detecting a touch on the display;
providing a plurality of control guides at a location corresponding to the touch over the displayed photograph image, in response to detecting the touch;
detecting a first drag in a first direction corresponding to a first one of the plurality of control guides provided on the display;
removing the plurality of control guides from the display in response to detecting the first drag;
detecting a second drag in a second direction different from the first direction of the first drag and corresponding to a second one of the plurality of control guides, the second drag is performed while maintaining touch on the display after the first drag is performed;
adjusting a display characteristic of the photograph image corresponding to the second one of the plurality of control guides corresponding to the second drag; and
displaying the photograph image having the adjusted display characteristic on the display in response to receiving the second drag.

14. The non-transitory computer-readable medium according to claim 13, wherein the display characteristic is a brightness of the photograph image.

15. An image capturing method using a graphical user interface on a preview screen of a device, the method comprising:
displaying a photograph image on the preview screen of the device;
providing a plurality of control guides over the displayed photograph image;
detecting a first drag on the preview screen in a first direction corresponding to a first one of the plurality of control guides provided on the preview screen;
removing the plurality of control guides from the preview screen in response to detecting the first drag;
detecting a second drag in a second direction different from the first direction of the first drag and corresponding to a second one of the plurality of control guides, the second drag is performed while maintaining touch on the preview screen after the first drag is performed;
adjusting a display characteristic of the photograph image corresponding to the second one of the plurality of control guides corresponding to the second drag;
displaying the photograph image having the adjusted display characteristic on the preview screen; and
capturing the photograph image having the adjusted display characteristic displayed on the preview screen.

16. The method of claim 1, further comprising adjusting a characteristic of the photograph image corresponding to the first one of the plurality of control guides provided on the display.