Patent Description:
Terminals can be classified into two types, such as a mobile or portable terminal and a stationary terminal based on its mobility. Furthermore, the mobile terminal can be further classified into two types, such as a handheld terminal and a vehicle mount terminal based on whether or not it can be directly carried by a user.

As it becomes multifunctional, for example, such a terminal is allowed to capture still images or moving images, play music or video files, play games, receive broadcast and the like, so as to be implemented as an integrated multimedia player. Moreover, the improvement of structural or software elements of the terminal may be taken into consideration to support and enhance the functions of the terminal.

Owing to the enhancement, an image that has captured various objects such as humans, things or the like may be generated through a camera of the terminal. However, when the image is generated only in case where the user directly touches a capture button of the terminal camera, it may cause a problem of missing his or her desired scene.

Furthermore, there has been some inconvenience in viewing images that have been captured for the same object or images that have been captured within a predetermined period of time in an all-at-once or successive manner.

From <CIT>, a camera is known which is capable of continuous shooting before and after a still image shot and of recording shot image data after having image-processed the image data. From <CIT>, a signal processing circuit is known in which, in recording of a moving picture taken before and after shooting of a still picture, the storage style is determined from predetermined conditions to thereby minimize consumption of a recording medium.

An objective of the present disclosure is to provide a mobile terminal and control method thereof capable of displaying a plurality of captured images in a successively linked manner.

The present disclosure provides a mobile terminal and a control method thereof as defined in the independent claims. Further, optional features thereof are defined in the dependent claims.

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specifi cation, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, and the same or similar elements are designated with the same numeral references regardless of the numerals in the drawings and their redundant description will be omitted. A suffix "module" or "unit" used for constituent elements disclosed in the following description is merely intended for easy description of the specification, and the suffix itself does not give any special meaning or function.

A mobile terminal disclosed herein may include a portable phone, a smart phone, a laptop computer, a digital broadcast mobile device, a personal digital assistant (PDA), a mobile multimedia player (PMP), a navigation, a slate PC, a tablet PC, an ultrabook, and the like. However, it would be easily understood by those skilled in the art that a configuration according to the following description may be applicable to a stationary terminal such as a digital TV, a desktop computer, and the like, excluding constituent elements particularly configured for mobile purposes.

<FIG> is a block diagram illustrating a mobile terminal <NUM> according to an embodiment disclosed in the present disclosure.

The mobile terminal <NUM> may include a wireless communication unit <NUM>, an audio/video (A/V) input unit <NUM>, a user input unit <NUM>, a sensing unit <NUM>, an output unit <NUM>, a memory <NUM>, an interface unit <NUM>, a controller <NUM>, a power supply unit <NUM>, and the like. However, the constituent elements as illustrated in <FIG> are not necessarily required, and the mobile communication terminal may be implemented with greater or less number of elements than those illustrated elements.

Hereinafter, the foregoing constituent elements will be described in sequence.

The wireless communication unit <NUM> may include one or more modules allowing radio communication between the mobile terminal <NUM> and a wireless communication system, or allowing radio communication between the mobile terminal <NUM> and a network in which the mobile terminal <NUM> is located. For example, the wireless communication unit <NUM> may include at least one of a broadcast receiving module <NUM>, a mobile communication module <NUM>, a wireless Internet module <NUM>, a short-range communication module <NUM>, a location information module <NUM>, and the like.

The broadcast receiving module <NUM> receives a broadcast signal and/or broadcast associated information from an external broadcast managing entity via a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast managing entity may indicate a server which generates and transmits a broadcast signal and/or broadcast associated information or a server which receives a pre-generated broadcast signal and/or broadcast associated information and sends them to the mobile terminal. The broadcast signal may be implemented as a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, among others. The broadcast signal may further include a data broadcast signal combined with a TV or radio broadcast signal.

Examples of broadcast associated information may include information associated with a broadcast channel, a broadcast program, a broadcast service provider, and the like. The broadcast associated information may be provided via a mobile communication network, and received by the mobile communication module <NUM>.

The broadcast associated information may be implemented in various formats. For instance, broadcast associated information may include Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H), and the like.

The broadcast receiving module <NUM> may be configured to receive digital broadcast signals transmitted from various types of broadcast systems. Such broadcast systems may include Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T) and the like. Of course, the broadcast receiving module <NUM> may be configured to be suitable for every broadcast system transmitting broadcast signals as well as the digital broadcasting systems.

Broadcast signals and/or broadcast associated information received via the broadcast receiving module <NUM> may be stored in a memory <NUM>.

The mobile communication module <NUM> transmits and receives wireless signals to and from at least one a base station, an external terminal and a server on a mobile communication network. Here, the wireless signals may include audio call signals, video call signals, or various formats of data according to the transmission and reception of text/multimedia messages.

The mobile communication module <NUM> may be configured to implement an video communication mode and a voice communication mode. The video communication mode refers to a configuration in which communication is made while viewing the image of the counterpart, and the voice communication mode refers to a configuration in which communication is made without viewing the image of the counterpart. The mobile communication module <NUM> may be configured to transmit or receive at least one of audio or video data to implement the video communication mode and voice communication mode.

The wireless Internet module <NUM> refers to a module for supporting wireless Internet access, and may be built-in or externally installed on the mobile terminal <NUM>. Here, it may be used a wireless Internet access technique including WLAN (Wireless LAN), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), Wibro (Wireless Broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), and the like.

The short-range communication module <NUM> refers to a module for supporting a short-range communication. Here, it may be used a short-range communication technology including Bluetooth™, Radio Frequency IDentification (RFID), Infrared Data Association (IrDA), Ultra WideBand (UWB), ZigBee, Near Field Communication (NFC) and the like.

The location information module <NUM> is a module for checking or acquiring the location of the mobile terminal, and there is a Global Positioning Module (GPS) module or Wireless Fidelity (WiFI) as a representative example.

Referring to <FIG>, the A/V(audio/video) input unit <NUM> receives an audio or video signal, and the A/V (audio/video) input unit <NUM> may include a camera <NUM> and a microphone <NUM>. The camera <NUM> processes image frames, such as still or moving images, obtained by an image sensor in a video phone call or image capturing mode. The processed image frame may be displayed on a display unit <NUM>.

The image frames processed by the camera <NUM> may be stored in the memory <NUM> or transmitted to an external device through the wireless communication unit <NUM>. Furthermore, the user's location information or the like may be produced from image frames acquired from the camera <NUM>. Two or more cameras <NUM> may be provided according to the use environment.

The microphone <NUM> receives an external audio signal through a microphone in a phone call mode, a recording mode, a voice recognition mode, and the like, and processes the audio signal into electrical voice data. The processed voice data may be converted and outputted into a format that is transmittable to a mobile communication base station through the mobile communication module <NUM> in the phone call mode. The microphone <NUM> may implement various types of noise canceling algorithms to cancel noise generated in a procedure of receiving the external audio signal.

The user input unit <NUM> may generate input data to control an operation of the terminal. The user input unit <NUM> may be configured by including a keypad, a dome switch, a touch pad (pressure/capacitance), a jog wheel, a jog switch, and the like.

The sensing unit <NUM> detects a current status of the mobile terminal <NUM> such as an opened or closed configuration of the mobile terminal <NUM>, a location of the mobile terminal <NUM>, a presence or absence of user contact with the mobile terminal <NUM>, an orientation of the mobile terminal <NUM>, an acceleration/deceleration of the mobile terminal <NUM>, and the like, so as to generate a sensing signal for controlling the operation of the mobile terminal <NUM>. For example, when the mobile terminal <NUM> is a slide phone type, the sensing unit <NUM> may sense whether a sliding portion of the mobile terminal is open or closed. Other examples include sensing functions, such as the sensing unit <NUM> sensing the presence or absence of power provided by the power supply unit <NUM>, the presence or absence of a coupling between the interface unit <NUM> and an external device.

The output unit <NUM> is configured to generate an output associated with visual sense, auditory sense or tactile sense, and may include a display unit <NUM>, an audio output module <NUM>, an alarm unit <NUM>, a haptic module <NUM>, and the like.

The display unit <NUM> may display (output) information processed in the mobile terminal <NUM>. For example, when the mobile terminal <NUM> is in a phone call mode, the display unit <NUM> may display a User Interface (UI) or a Graphic User Interface (GUI) associated with a call. When the mobile terminal <NUM> is in a video call mode or image capturing mode, the display unit <NUM> may display a captured image and/or received image, a UI or GUI.

The display unit <NUM> may include at least one of a Liquid Crystal Display (LCD), a Thin Film Transistor-LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and an e-ink display.

Some of those displays may be configured with a transparent or optical transparent type to allow viewing of the exterior through the display unit, which may be called transparent displays. An example of the typical transparent displays may include a transparent LCD (TOLED), and the like. Under this configuration, a user can view an object positioned at a rear side of a mobile terminal body through a region occupied by the display unit <NUM> of the mobile terminal body.

Two or more display units <NUM> may be implemented according to a configured aspect of the mobile terminal <NUM>. For instance, a plurality of the display units <NUM> may be arranged on one surface to be spaced apart from or integrated with each other, or may be arranged on different surfaces.

Furthermore, the display unit <NUM> may be configured with a stereoscopic display unit <NUM> for displaying a stereoscopic image.

Here, stereoscopic image indicates a <NUM>-dimensional stereoscopic image, and the <NUM>-dimensional stereoscopic image is an image for allowing the user to feel the gradual depth and reality of an object located on the monitor or screen as in a real space. The <NUM>-dimensional stereoscopic image may be implemented by using binocular disparity. Here, binocular disparity denotes a disparity made by the location of two eyes separated from each other, allowing the user to feel the depth and reality of a stereoscopic image when two eyes see different two-dimensional images and then the images are transferred through the retina and merged in the brain as a single image.

A stereoscopic method (glasses method), an auto-stereoscopic method (no-glasses method), a projection method (holographic method), and the like may be applicable to the stereoscopic display unit <NUM>. The stereoscopic method primarily used in a home television receiver and the like may include a Wheatstone stereoscopic method and the like.

The examples of the auto-stereoscopic method may include a parallel barrier method, a lenticular method, an integral imaging method, and the like. The projection method may include a reflective holographic method, a transmissive holographic method, and the like.

In general, a <NUM>-dimensional stereoscopic image may include a left image (image for the left eye) and a right image (image for the right eye). The method of implementing a <NUM>-dimensional stereoscopic image can be divided into a top-down method in which a left image and a right image are disposed at the top and bottom within a frame, a left-to-right (L-to-R) or side by side method in which a left image and a right image are disposed at the left and right within a frame, a checker board method in which the pieces of a left image and a right image are disposed in a tile format, an interlaced method in which a left and a right image are alternately disposed for each column and row unit, and a time sequential or frame by frame method in which a left image and a right image are alternately displayed for each time frame, according to the method of combining a left image and a right image into a <NUM>-dimensional stereoscopic image.

For <NUM>-dimensional thumbnail images, a left image thumbnail and a right image thumbnail may be generated from the left and the right image of the original image frame, and then combined with each other to generate a <NUM>-dimensional stereoscopic image. Typically, thumbnail denotes a reduced image or reduced still video. The left and right thumbnail image generated in this manner are displayed with a left and right distance difference on the screen in a depth corresponding to the disparity of the left and right image, thereby implementing a stereoscopic space feeling.

A left image and a right image required to implement a <NUM>-dimensional stereoscopic image are displayed on the stereoscopic display unit <NUM> by a stereoscopic processing unit (not shown). The stereoscopic processing unit receives a 3D image to extract a left image and a right image from the 3D image, or receives a 2D image to convert it into a left image and a right image.

On the other hand, when the display unit <NUM> and a touch sensitive sensor (hereinafter, referred to as a "touch sensor") have an interlayer structure (hereinafter, referred to as a "touch screen"), the display unit <NUM> may be used as an input device in addition to an output device. The touch sensor may be implemented as a touch film, a touch sheet, a touch pad, and the like.

The touch sensor may be configured to convert changes of a pressure applied to a specific part of the display unit <NUM>, or a capacitance occurring from a specific part of the display unit <NUM>, into electric input signals. The touch sensor may be configured to sense not only a touched position and a touched area, but also a touch pressure at which a touch object body is touched on the touch sensor. Here, the touch object body may be a finger, a touch pen or stylus pen, a pointer, or the like as an object by which a touch is applied to the touch sensor.

When there is a touch input to the touch sensor, the corresponding signals are transmitted to a touch controller. The touch controller processes the signal(s), and then transmits the corresponding data to the controller <NUM>. Accordingly, the controller <NUM> may sense which region of the display unit <NUM> has been touched.

Referring to <FIG>, a proximity sensor <NUM> may be arranged at an inner region of the mobile device <NUM> surrounded by the touch screen, or adjacent to the touch screen. The proximity sensor <NUM> may be provided as an example of the sensing unit <NUM>. The proximity sensor <NUM> refers to a sensor to sense the presence or absence of an object approaching to a surface to be sensed, or an object disposed adjacent to a surface to be sensed, by using an electromagnetic field or infrared rays without a mechanical contact. The proximity sensor <NUM> has a longer lifespan and a more enhanced utility than a contact sensor.

The proximity sensor <NUM> may include an optical transmission type photoelectric sensor, a direct reflective type photoelectric sensor, a mirror reflective type photoelectric sensor, a high-frequency oscillation proximity sensor, a capacitance type proximity sensor, a magnetic type proximity sensor, an infrared rays proximity sensor, and so on. When the touch screen is implemented as a capacitance type, the proximity of an object having conductivity (hereinafter, referred to as a "pointer") to the touch screen is sensed by changes of an electromagnetic field. In this case, the touch screen (touch sensor) may be categorized into a proximity sensor.

Hereinafter, for the sake of convenience of brief explanation, a behavior that the pointer is positioned to be proximate onto the touch screen without contact will be referred to as a "proximity touch", whereas a behavior that the pointer substantially comes in contact with the touch screen will be referred to as a "contact touch". For the position corresponding to the proximity touch of the pointer on the touch screen, such position corresponds to a position where the pointer faces perpendicular to the touch screen upon the proximity touch of the pointer.

The proximity sensor <NUM> senses a proximity touch, and a proximity touch pattern (e.g., proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch moving status, etc.). Information relating to the sensed proximity touch and the sensed proximity touch patterns may be output onto the touch screen.

When the stereoscopic display unit <NUM> and a touch sensor are configured with an interlayer structure (hereinafter, referred to as a "stereoscopic touch screen") or the stereoscopic display unit <NUM> and a 3D sensor for detecting a touch operation are combined with each other, the stereoscopic display unit <NUM> may be used as a <NUM>-dimensional input device.

As an example of the 3D sensor, the sensing unit <NUM> may include a proximity sensor <NUM>, a stereoscopic touch sensing unit <NUM>, a ultrasound sensing unit <NUM>, and a camera sensing unit <NUM>.

The proximity sensor <NUM> measures a distance between the sensing object (for example, the user's finger or stylus pen) and a detection surface to which a touch is applied using an electromagnetic field or infrared rays without a mechanical contact. The terminal may recognize which portion of a stereoscopic image has been touched by using the measured distance. In particular, when the touch screen is implemented with a capacitance type, it may be configured such that the proximity level of a sensing object is sensed by changes of an electromagnetic field according to the proximity of the sensing object to recognize a <NUM>-dimensional touch using the proximity level.

The stereoscopic touch sensing unit <NUM> may be configured to sense the strength or duration time of a touch applied to the touch screen. For example, stereoscopic touch sensing unit <NUM> senses a user applied touch pressure, and if the applied pressure is strong, then the stereoscopic touch sensing unit <NUM> recognizes it as a touch for an object located farther from the touch screen.

The ultrasound sensing unit <NUM> may be configured to sense the location of the sensing object using ultrasound.

For example, the ultrasound sensing unit <NUM> may be configured with an optical sensor and a plurality of ultrasound sensors. The optical sensor may be formed to sense light, and the ultrasound sensor may be formed to sense ultrasound waves. Since light is far faster than ultrasound waves, the time for light to reach the optical sensor is far faster than the time for ultrasound waves to reach the ultrasound sensor. Accordingly, the location of the wave generating source may be calculated using a time difference between the light and ultrasound waves to reach the optical sensor.

The camera sensing unit <NUM> may include at least one of a camera <NUM>, a photo sensor, and a laser sensor.

For example, the camera <NUM> and laser sensor may be combined to each other to sense a touch of the sensing object to a <NUM>-dimensional stereoscopic image. Distance information sensed by the laser sensor is added to a two-dimensional image captured by the camera to acquire <NUM>-dimensional information.

For another example, a photo sensor may be deposited on the display element. The photo sensor may be configured to scan the motion of the sensing object in proximity to the touch screen. More specifically, the photo sensor is integrated with photo diodes and transistors in the rows and columns thereof, and a content placed on the photo sensor may be scanned by using an electrical signal that is changed according to the amount of light applied to the photo diode. In other words, the photo sensor performs the coordinate calculation of the sensing object according to the changed amount of light, and the location coordinate of the sensing object may be detected through this.

The audio output module <NUM> may output audio data received from the wireless communication unit <NUM> or stored in the memory <NUM>, in a call-receiving mode, a call-placing mode, a recording mode, a voice recognition mode, a broadcast reception mode, and so on. The audio output module <NUM> may output audio signals relating to the functions performed in the mobile terminal <NUM> (e.g., sound alarming a call received or a message received, and so on). The audio output module <NUM> may include a receiver, a speaker, a buzzer, and so on.

The alarm <NUM> outputs signals notifying occurrence of events from the mobile terminal <NUM>. The events occurring from the mobile terminal <NUM> may include call received, message received, key signal input, touch input, and so on. The alarm <NUM> may output not only video or audio signals, but also other types of signals such as signals notifying occurrence of events in a vibration manner. Since the video or audio signals can be output through the display unit <NUM> or the audio output unit <NUM>, the display unit <NUM> and the audio output module <NUM> may be categorized into part of the alarm <NUM>.

The haptic module <NUM> generates various tactile effects which a user can feel. A representative example of the tactile effects generated by the haptic module <NUM> includes vibration. Vibration generated by the haptic module <NUM> may have a controllable intensity, a controllable pattern, and so on. For instance, different vibration may be output in a synthesized manner or in a sequential manner.

The haptic module <NUM> may generate various tactile effects, including not only vibration, but also arrangement of pins vertically moving with respect to a skin being touched, air injection force or air suction force through an injection hole or a suction hole, touch by a skin surface, presence or absence of contact with an electrode, effects by stimulus such as an electrostatic force, reproduction of cold or hot feeling using a heat absorbing device or a heat emitting device, and the like.

The haptic module <NUM> may be configured to transmit tactile effects through a user's direct contact, or a user's muscular sense using a finger or a hand. The haptic module <NUM> may be implemented in two or more in number according to the configuration of the mobile terminal <NUM>.

The memory <NUM> may store a program for processing and controlling the controller <NUM>. Alternatively, the memory <NUM> may temporarily store input/output data (e.g., phonebook, messages, still images, videos, and the like). Also, the memory <NUM> may store data related to various patterns of vibrations and sounds outputted upon the touch input on the touch screen.

The memory <NUM> may be implemented using any type of suitable storage medium including a flash memory type, a hard disk type, a multimedia card micro type, a memory card type (e.g., SD or DX memory), Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-only Memory (EEPROM), Programmable Read-only Memory (PROM), magnetic memory, magnetic disk, optical disk, and the like. Also, the mobile terminal <NUM> may operate in association with a web storage which performs the storage function of the memory <NUM> on the Internet.

The interface unit <NUM> may generally be implemented to interface the mobile terminal with external devices connected to the mobile terminal <NUM>. The interface unit <NUM> may allow a data reception from an external device, a power delivery to each component in the mobile terminal <NUM>, or a data transmission from the mobile terminal <NUM> to an external device. The interface unit <NUM> may include, for example, wired/wireless headset ports, external charger ports, wired/wireless data ports, memory card ports, ports for coupling devices having an identification module, audio Input/Output (I/O) ports, video I/O ports, earphone ports, and the like.

On the other hand, the identification module may be configured as a chip for storing various information required to authenticate an authority to use the mobile terminal <NUM>, which may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), and the like. Also, the device having the identification module (hereinafter, referred to as "identification device") may be implemented in a type of smart card. Hence, the identification device can be coupled to the mobile terminal <NUM> via a port.

Furthermore, the interface unit <NUM> may serve as a path for power to be supplied from an external cradle to the mobile terminal <NUM> when the mobile terminal <NUM> is connected to the external cradle or as a path for transferring various command signals inputted from the cradle by a user to the mobile terminal <NUM>. Such various command signals or power inputted from the cradle may operate as signals for recognizing that the mobile terminal <NUM> has accurately been mounted to the cradle.

The controller <NUM> typically controls the overall operations of the mobile terminal <NUM>. For example, the controller <NUM> performs the control and processing associated with telephony calls, data communications, video calls, and the like. The controller <NUM> may include a multimedia module <NUM> which provides multimedia playback. The multimedia module <NUM> may be configured as part of the controller <NUM> or as a separate component.

Furthermore, the controller <NUM> can perform a pattern recognition processing so as to recognize writing or drawing input carried out on the touch screen as text or image.

Furthermore, the controller <NUM> may implement a lock state for limiting the user's control command input to applications when the state of the mobile terminal satisfies a preset condition. Furthermore, the controller <NUM> may control a lock screen displayed in the lock state based on a touch input sensed through the display unit <NUM> in the lock state.

The power supply unit <NUM> receives external and internal power to provide power required for various components under the control of the controller <NUM>.

Various embodiments described herein may be implemented in a computer or similar device readable medium using software, hardware, or any combination thereof.

For hardware implementation, it may be implemented by using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and electrical units designed to perform the functions described herein. In some cases, such embodiments may be implemented in the controller <NUM> itself.

For software implementation, the embodiments such as procedures or functions described in the present disclosure may be implemented with separate software modules. Each of the software modules may perform at least one function or operation described in the present disclosure.

Software codes can be implemented by a software application written in any suitable programming language. The software codes may be stored in the memory <NUM> and executed by the controller <NUM>.

Next, a communication system that can be implemented through the mobile terminal <NUM> according to the present disclosure will be described.

<FIG> and <FIG> are conceptual views illustrating a communication system in which a mobile terminal <NUM> according to the present disclosure is operable.

First, referring to <FIG>, the communication system may use different wireless interfaces and/or physical layers. For example, wireless interfaces that can be used by the communication system may include, frequency division multiple access (FDMA), time division multiple access (TDMA), code division multiple access (CDMA), universal mobile telecommunications system (UMTS) (particularly, long term evolution (LTE)), global system for mobile communications (GSM), and the like.

Hereinafter, for the sake of convenience of explanation, the description disclosed herein will be limited to CDMA. However, it is apparent that the present invention may be also applicable to all communication systems including a CDMA wireless communication system.

As illustrated in <FIG>, a CDMA wireless communication system may include a plurality of terminals <NUM>, a plurality of base stations (BSs) <NUM>, a plurality of base station controllers (BSCs) <NUM>, and a mobile switching center (MSC) <NUM>. The MSC <NUM> may interface with a Public Switched Telephone Network (PSTN) <NUM>, and the MSC <NUM> may also interface with the BSCs <NUM>. The BSCs <NUM> may be connected to the BSs <NUM> via backhaul lines. The backhaul lines may be configured in accordance with at least any one of E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL, for example. Further, the system illustrated in <FIG> may include a plurality of BSCs <NUM>.

Each of the plurality of BSs <NUM> may include at least one sector, each sector having an omni-directional antenna or an antenna indicating a particular radial direction from the base station <NUM>. Alternatively, each sector may include two or more antennas with various forms. Each of the BSs <NUM> may be configured to support a plurality of frequency assignments, each frequency assignment having a particular spectrum (for example, <NUM>, <NUM>, etc.).

The intersection of a sector and frequency assignment may be referred to as a CDMA channel. The BSs <NUM> may also be referred to as Base Station Transceiver Subsystems (BTSs). In this case, the term "base station" may collectively refer to a BSC <NUM>, and at least one BS <NUM>. The base stations may also indicate "cell sites". Alternatively, individual sectors for a specific BS <NUM> may also be referred to as a plurality of cell sites.

As illustrated in <FIG>, the Broadcasting Transmitter (BT) <NUM> may transmit broadcasting signals to the mobile terminals <NUM> being operated within the system. The broadcast receiving module <NUM> as illustrated in <FIG> may be provided in the mobile terminal <NUM> to receive broadcast signals transmitted by the BT <NUM>.

In addition, <FIG> illustrates several global positioning system (GPS) satellites <NUM>. Such satellites <NUM> facilitate locating at least one of a plurality of mobile terminals <NUM>. Though two satellites are illustrated in <FIG>, location information may be obtained with a greater or fewer number of satellites. The location information module <NUM> as illustrated in <FIG> may cooperate with the satellites <NUM> as illustrated in <FIG> to obtain desired location information. However, other types of position detection technology, all types of technologies capable of tracing the location may be used in addition to a GPS location technology. Furthermore, at least one of the GPS satellites <NUM> may alternatively or additionally provide satellite DMB transmissions.

During the operation of a wireless communication system, the BS <NUM> may receive reverse-link signals from various mobile terminals <NUM>. At this time, he mobile terminals <NUM> may perform calls, message transmissions and receptions, and other communication operations. Each reverse-link signal received by a specific base station <NUM> may be processed within that specific base station <NUM>. The processed resultant data may be transmitted to an associated BSC <NUM>. The BSC <NUM> may provide call resource allocation and mobility management functions including the systemization of soft handoffs between the base stations <NUM>. Furthermore, the BSCs <NUM> may also transmit the received data to the MSC <NUM>, which provides additional transmission services for interfacing with the PSTN <NUM>. Furthermore, similarly, the PSTN <NUM> may interface with the MSC <NUM>, and the MSC <NUM> may interface with the BSCs <NUM>. The BSCs <NUM> may also control the BSs <NUM> to transmit forward-link signals to the mobile terminals <NUM>.

Next, a method of acquiring the location information of a mobile terminal using a WiFi (Wireless Fidelity) positioning system (WPS) will be described with reference to <FIG>.

The WiFi positioning system (WPS) <NUM> refers to a location determination technology based on a wireless local area network (WLAN) using WiFi as a technology for tracking the location of the mobile terminal <NUM> using a WiFi module provided in the mobile terminal <NUM> and a wireless access point <NUM> for transmitting and receiving to and from the WiFi module.

The WiFi positioning system <NUM> may include a WiFi location determination server <NUM>, a mobile terminal <NUM>, a wireless access point (AP) <NUM> connected to the mobile terminal <NUM>, and a database <NUM> stored with any wireless AP information.

The WiFi location determination server <NUM> extracts the information of the wireless AP <NUM> connected to the mobile terminal <NUM> based on a location information request message (or signal) of the mobile terminal <NUM>. The information of the wireless AP <NUM> may be transmitted to the WiFi location determination server <NUM> through the mobile terminal <NUM> or transmitted to the WiFi location determination server <NUM> from the wireless AP <NUM>.

The information of the wireless AP extracted based on the location information request message of the mobile terminal <NUM> may be at least one of MAC address, SSID, RSSI, channel information, privacy, network type, signal strength and noise strength.

The WiFi location determination server <NUM> receives the information of the wireless AP <NUM> connected to the mobile terminal <NUM> as described above, and compares the received wireless AP <NUM> information with information contained in the preestablished database <NUM> to extract (or analyze) the location information of the mobile terminal <NUM>.

On the other hand, referring to <FIG>, as an example, the wireless AP connected to the mobile terminal <NUM> is illustrated as a first, a second, and a third wireless AP <NUM>. However, the number of wireless APs connected to the mobile terminal <NUM> may be changed in various ways according to a wireless communication environment in which the mobile terminal <NUM> is located. When the mobile terminal <NUM> is connected to at least one of wireless APs, the WiFi positioning system <NUM> can track the location of the mobile terminal <NUM>.

Next, considering the database <NUM> stored with any wireless AP information in more detail, various information of any wireless APs disposed at different locations may be stored in the database <NUM>.

The information of any wireless APs stored in the database <NUM> may be information such as MAC address, SSID, RSSI, channel information, privacy, network type, latitude and longitude coordinate, building at which the wireless AP is located, floor number, detailed indoor location information (GPS coordinate available), AP owner's address, phone number, and the like.

In this manner, any wireless AP information and location information corresponding to the any wireless AP are stored together in the database <NUM>, and thus the WiFi location determination server <NUM> may retrieve wireless AP information corresponding to the information of the wireless AP <NUM> connected to the mobile terminal <NUM> from the database <NUM> to extract the location information matched to the searched wireless AP, thereby extracting the location information of the mobile terminal <NUM>.

Furthermore, the extracted location information of the mobile terminal <NUM> may be transmitted to the mobile terminal <NUM> through the WiFi location determination server <NUM>, thereby acquiring the location information of the mobile terminal <NUM>.

Hereinafter, a mobile terminal according to an embodiment of the present disclosure as illustrated in <FIG> or a mobile terminal disposed with the constituent elements of the mobile terminal or the structure of a mobile terminal will be described.

<FIG> is a front perspective view illustrating an example of the mobile terminal <NUM> associated with the present disclosure.

The mobile terminal <NUM> disclosed herein is provided with a bar-type terminal body. However, the present invention may not be limited to this, but also may be applicable to various structures such as watch type, clip type, glasses type or folder type, flip type, swing type, swivel type, or the like, in which two and more bodies are combined with each other in a relatively movable manner.

The body includes a case (casing, housing, cover, etc.) forming the appearance of the terminal. In this embodiment, the case may be divided into a front case <NUM> and a rear case <NUM>. Various electronic components is incorporated into a space formed between the front case <NUM> and the rear case <NUM>. At least one middle case may be additionally disposed between the front case <NUM> and the rear case <NUM>, and a battery cover <NUM> for covering the battery <NUM> may be detachably configured at the rear case <NUM>.

The cases may be formed by injection-molding a synthetic resin or may be also formed of a metal, for example, stainless steel (STS), titanium (Ti), or the like.

A display unit <NUM>, a first audio output module 153a, a first camera 121a, a first manipulating unit <NUM> and the like may be disposed on a front surface of the terminal body, and a microphone <NUM>, an interface unit <NUM>, a second manipulating unit <NUM> and the like may be provided on a lateral surface thereof.

The display unit <NUM> may be configured to display (output) information being processed in the mobile terminal <NUM>. The display unit <NUM> may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a <NUM>-dimensional (3D) display, and an e-ink display.

The display unit <NUM> includes a touch sensing means to receive a control command by a touch method. When a touch is made to any one place on the display unit <NUM>, the touch sensing means may be configured to sense this touch and enter the content corresponding to the touched place. The content entered by a touch method may be a text or numerical value, or a menu item capable of indication or designation in various modes.

The touch sensing means may be formed with transparency to allow visual information displayed on the display unit <NUM> to be seen, and may include a structure for enhancing the visibility of a touch screen at bright places. Referring to <FIG>, the display unit <NUM> occupies a most portion of the front surface of the front case <NUM>.

The first audio output unit 153a and the first camera 121a are disposed in a region adjacent to one of both ends of the display unit <NUM>, and the first manipulation input unit <NUM> and the microphone <NUM> are disposed in a region adjacent to the other end thereof. The second manipulation interface <NUM> (refer to FIG. B), the interface <NUM>, and the like may be disposed on a lateral surface of the terminal body.

The first audio output module 153a may be implemented in the form of a receiver for transferring voice sounds to the user's ear or a loud speaker for outputting various alarm sounds or multimedia reproduction sounds.

It may be configured such that the sounds generated from the first audio output module 153a are released along an assembly gap between the structural bodies. In this case, a hole independently formed to output audio sounds may not be seen or hidden in terms of appearance, thereby further simplifying the appearance of the mobile terminal <NUM>. However, the present invention may not be limited to this, but a hole for releasing the sounds may be formed on the window.

The first camera 121a processes video frames such as still or moving images obtained by the image sensor in a video call mode or capture mode. The processed video frames may be displayed on the display unit <NUM>.

The user input unit <NUM> is manipulated to receive a command for controlling the operation of the mobile terminal <NUM>. The user input unit <NUM> may include a first and a second manipulation unit <NUM>, <NUM>. The first and the second manipulation unit <NUM>, <NUM> may be commonly referred to as a manipulating portion, and any method may be employed if it is a tactile manner allowing the user to perform manipulation with a tactile feeling such as touch, push, scroll or the like.

In the present drawing, it is illustrated on the basis that the first manipulation unit <NUM> is a touch key, but the present disclosure may not be necessarily limited to this. For example, the first manipulation unit <NUM> may be configured with a mechanical key, or a combination of a touch key and a mechanical key.

The content received by the first and/or second manipulation units <NUM>, <NUM> may be set in various ways. For example, the first manipulation unit <NUM> may be used to receive a command such as menu, home key, cancel, search, or the like, and the second manipulation unit <NUM> may receive a command, such as controlling a volume level being outputted from the first audio output module 153a, or switching into a touch recognition mode of the display unit <NUM>.

The microphone <NUM> may be formed to receive the user's voice, other sounds, or the like. The microphone <NUM> may be provided at a plurality of places, and configured to receive stereo sounds.

The interface unit <NUM> serves as a path allowing the mobile terminal <NUM> to exchange data with external devices. For example, the interface unit <NUM> may be at least one of a connection terminal for connecting to an earphone in a wired or wireless manner, a port for near field communication (for example, an Infrared Data Association (IrDA) port, a Bluetooth port, a wireless LAN port, and the like), and a power supply terminal for supplying power to the mobile terminal <NUM>. The interface unit <NUM> may be implemented in the form of a socket for accommodating an external card such as Subscriber Identification Module (SIM) or User Identity Module (UIM), and a memory card for information storage.

<FIG> is a rear perspective view illustrating mobile terminal <NUM> illustrated in <FIG>.

Referring to <FIG>, a second camera 121b may be additionally mounted at a rear surface of the terminal body, namely, the rear case <NUM>. The second camera 121b has an image capturing direction, which is substantially opposite to the direction of the first camera unit 121a (refer to <FIG>), and may have a different number of pixels from that of the first camera unit 121a.

For example, it is preferable that the first camera 121a has a relatively small number of pixels enough not to cause difficulty when the user captures his or her own face and sends it to the other party during a video call or the like, and the second camera 121b has a relatively large number of pixels since the user often captures a general object that is not sent immediately. The first and the second camera 121a, 121b may be provided in the terminal body in a rotatable and popupable manner.

Furthermore, a flash <NUM> and a mirror <NUM> may be additionally disposed adjacent to the second camera 121b. The flash <NUM> illuminates light toward an object when capturing the object with the second camera 121b. The mirror <NUM> allows the user to look at his or her own face, or the like, in a reflected way when capturing himself or herself (in a self-portrait mode) by using the second camera 121b.

A second audio output unit 153b may be additionally disposed at a rear surface of the terminal body. The second audio output unit 153b together with the first audio output unit 153a (refer to <FIG>) can implement a stereo function, and may be also used to implement a speaker phone mode during a phone call.

An antenna (not shown) for receiving broadcast signals may be additionally disposed at a lateral surface of the terminal body in addition to an antenna for making a phone call or the like. The antenna constituting part of the broadcast receiving module <NUM> (refer to <FIG>) may be provided in the terminal body in a retractable manner.

A power supply unit <NUM> (refer to <FIG>) for supplying power to the mobile terminal <NUM> may be mounted on the terminal body. The power supply unit <NUM> may be incorporated into the terminal body, or may include a battery <NUM> configured in a detachable manner on the outside of the terminal body. According to the drawing, it is illustrated that the battery cover <NUM> is combined with the rear case <NUM> to cover the battery <NUM>, thereby restricting the battery <NUM> from being released and protecting the battery <NUM> from external shocks and foreign substances.

Accordingly, a mobile terminal <NUM> capable of enhancing the user's convenience in displaying a plurality of images in a successively linked manner and a control method thereof will be described with reference to the accompanying drawings.

The terms including an ordinal number such as first, second, etc. can be used to describe various elements, but the elements should not be limited by those terms. The terms are used merely for the purpose to distinguish an element from the other element.

For example, a first element may be named to a second element, and similarly, a second element may be named to a first element without departing from the scope of right of the invention.

<FIG> and <FIG> are flow charts for explaining a mobile terminal <NUM> (refer to <FIG>) according to an embodiment of the present disclosure. The mobile terminal <NUM> includes an image generation unit, a display unit <NUM> and a controller <NUM>.

Referring to <FIG>, first, the process (S110) of receiving an image generation control command is carried out.

Specifically, the user touches a capture button of the camera <NUM> to enter an image generation control command. Otherwise, the user pushes a capture button of the camera <NUM> implemented with a physical key to enter an image generation control command.

Subsequently, the process (S120) of automatically capturing images at a first point in time at which an image generation control command is received and for a period of time prior to and subsequent to the first point in time is carried out.

Specifically, an image is captured and generated at a point in time at which a capture button of the camera <NUM> is selected. Furthermore, images are automatically captured and generated in advance for a predetermined period of time prior to selecting the capture button, and images are automatically captured and generated for a predetermined period of time even subsequent to selecting the capture button. In other words, images can be automatically captured without selecting the capture button.

Next, the process (S130) of displaying images captured and generated at a second point in time which is a point in time subsequent to the first point in time at which an image generation control command is received and for a period of time prior to and subsequent to the second point in time and at least one image selected from the images generated during the process of S120 in a successively linked manner is carried out.

Specifically, at least one image between the first and the second points in time is automatically captured and stored in a preset specific condition.

The preset specific condition is set to a case where the capture button is successively touched within a previously set predetermined period of time, and may be set to a case where the capture button is successively touched within a previously set predetermined distance, a case where a specific object is contained in an image generated at each point in time at which the capture button touched, and the like.

Furthermore, images automatically captured for a predetermined period of time prior to and subsequent to the first and the second points in time may be overlapped with images automatically captured when a preset specific condition is satisfied between the foregoing first and the second point in time.

Specifically, when the capture button is selected at a first point in time and the capture button is selected again at a second point in time within <NUM> seconds from the first point in time, images are automatically captured and stored even when the capture button is not selected for at least one image between the first and the second points in time.

For another embodiment not belonging to the present invention, a first image is captured by pressing the capture button in the vicinity of Eiffel Tower, and then a second image is captured by pressing the capture button again within a radius of <NUM> from the point where the first image has been captured. In this case, images may be automatically captured and stored even when the capture button is not selected prior to capturing the second image but subsequent to capturing the first image.

For yet still another embodiment not belonging to the present invention, a first and a second image which are the features of a moving kid may be captured by pressing the capture button. Similarly, images may be automatically captured and stored even when the capture button is not selected prior to capturing the second image but subsequent to capturing the first image.

Furthermore, according to each embodiment, part of a plurality of images captured and generated at each point in time at which the capture button is touched and prior to and subsequent to the each point in time are displayed in a successively linked manner.

On the other hand, it is possible to enter a specific capture mode to automatically obtain an image even when the capture button is not touched, and in this case, images may be automatically captured and generated in a continuous manner prior to releasing the relevant capture mode even without touching the capture button.

Specifically, in an embodiment not belonging to the present invention, when the preset specific condition is satisfied even without touching the capture button while being in a specific capture mode, images may be automatically captured and generated in a continuous manner.

According to another embodiment not belonging to the present invention, images may be automatically captured and generated all the time even without entering a capture mode or touching the capture button. In this case, images for which a predetermined period of time has passed subsequent to the automatic capture may be deleted in consideration of the capacity of the memory <NUM>.

Through the foregoing process, images can be obtained even when the capture button is not captured.

Referring to <FIG>, the process (S210) of storing a plurality of images that have been captured and generated for each preset time interval in the memory <NUM> is carried out.

Subsequently, the process (S220) of capturing and generating a plurality of images at a first point in time at which the capture button is pressed and for a predetermined period of time prior to and subsequent to the first point in time is carried out.

Next, the process (S230) of determining whether or not there exists an image for which a predetermined period of time has passed subsequent to the generation among a plurality of images is carried out.

During the step of S230, when there exists an image for which a predetermined period of time has passed, the process (S240) of deleting the relevant image is carried out.

Subsequently, the process (S250) of displaying at least one image selected from a plurality of images captured and generated at a second point in time at which the capture button is pressed and for a predetermined period of time prior to and subsequent to the second point in time and a plurality of images generated during the step of S220 in a successively linked manner is carried out.

At this time, the step of S250 is carried out similarly to the foregoing step of S130 illustrated in <FIG>.

On the other hand, automatically captured images described in <FIG> and <FIG> may be still or moving images.

<FIG>, <FIG>, <FIG>, <FIG> and <FIG> are conceptual views illustrating a user interface configured to reproduce a plurality of images in a successively linked manner according to an embodiment.

Referring to <FIG>, the thumbnails of a plurality of photo images displayed in a photo album are shown. An image captured at a point in time at which the capture button is touched may be displayed on each thumbnail, and an indicator indicating that there exist images captured for a period of time prior to and subsequent to touching the capture button may be displayed thereon.

For example, a play button <NUM> for video, a number <NUM> of successively linked images or the like may be displayed on the thumbnail. Subsequently, the user may touch and select the thumbnail <NUM> of an image. Furthermore, other thumbnails overlapped under the thumbnail may be displayed to indicate that there exist a plurality of successively captured images.

Referring to <FIG>, when the user touches the thumbnail <NUM> in <FIG>, a photo image corresponding to the thumbnail <NUM> may be displayed in an enlarged manner. A walking person <NUM> is contained in the current displayed image.

Referring to <FIG>, when a play button <NUM> displayed at an edge of the image is touched in <FIG>, images captured for a predetermined period of time prior to touching the capture button, an image captured at a point in time at which the capture button is touched, and images captured for a predetermined period of time subsequent to touching the capture button are displayed in a successively linked manner according to the captured sequence.

In other words, video with a plurality of successively linked images is displayed. For example, video in which the person <NUM> displayed in <FIG> is walking may be displayed with images successively captured prior to and subsequent to the point in time.

Meanwhile, an image captured and generated at the first point in time and an image captured and generated at the second point in time may be displayed adjacent to each other, and a link object for connecting a plurality of adjacent images between a plurality of adjacent images may be displayed.

Referring to <FIG>, an image captured at a point in time at which the capture button is touched is displayed on each thumbnail displayed in the photo album, and a link object connected between each thumbnail may be displayed at the same time.

Specifically, a first thumbnail containing a first image <NUM> captured at the first point in time and a second thumbnail containing a second image <NUM> captured at the second point in time may be displayed. Furthermore, a link object <NUM> in a connecting link shape connected between the first and the second thumbnail may be also displayed.

The link object <NUM> indicates that connected images can be displayed in a linked manner. The link object <NUM> may link images captured within a previously set predetermined distance, images successively captured containing the same object, and images successively captured at the same location.

For example, the thumbnails of the first and the second image successively captured within <NUM> seconds at the same location may be connected with a link object, and are displayed like one successively linked video.

Referring to <FIG> and <FIG>, when the user touches and selects the first thumbnail in <FIG>, a first image <NUM> and images captured for a period of time subsequent to capturing the first image <NUM> are successively displayed.

Furthermore, images captured for a period of time prior to capturing a second image <NUM> connected with the link object <NUM>, the second image <NUM>, a second plurality of images which are images captured for a period of time subsequent to capturing the second image <NUM> are successively displayed.

If the second image <NUM> is linked with a third image through another link object, then images captured for a period of time prior to capturing the third image, the third image, a third plurality of images which are images captured for a period of time subsequent to capturing the third image are successively displayed.

In the above assumed example, if the user touches and selects the second thumbnail, then the second image <NUM>, images captured for a period of time subsequent to capturing the second image <NUM>, and a plurality of third images are successively displayed.

In other words, if the thumbnail of a captured image is touched and selected, then images linked with a link object are displayed in a successively linked manner.

Referring to <FIG>, each thumbnail containing a reproducible image can be displayed on a play bar <NUM>.

Specifically, a thumbnail of images captured for a period of time prior to capturing the first image <NUM>, a thumbnail of the first image <NUM>, a thumbnail of images <NUM>, <NUM> captured for period of time subsequent to capturing the first image <NUM>, a thumbnail of images <NUM> captured for a period of time prior to capturing the second image <NUM> connected with the link object <NUM>, a thumbnail of the second image <NUM>, a thumbnail of images <NUM> captured for a period of time subsequent to capturing the second image <NUM>, and the like can be displayed in a successively linked manner on the bar <NUM>.

Furthermore, on the images <NUM>, <NUM> captured by directly pressing the capture button among thumbnails displayed on the bar <NUM>, an object indicating that they are captured by directly pressing the capture button may be displayed. For example, the frame of the thumbnail can be displayed in a bold manner or the thumbnail can be displayed with a different color.

For another embodiment, when the images <NUM>, <NUM> captured by directly pressing the capture button are reproduced on the entire screen <NUM>, a flash effect similar to being displayed when pressing the capture button may be displayed. Otherwise, a sound effect such as "click" or the like that is output when pressing the capture button may be output.

For still another embodiment, duplicated images may exist between the first and the second image <NUM>, <NUM> connected with the link object <NUM>. In other words, common images may exist between images captured for a period of time subsequent to capturing the first image <NUM> and images captured for a period of time prior to capturing the second image <NUM>.

In this case, only one duplicated image may be displayed. Otherwise, an object indicating the image being duplicated may be displayed. For example, a duplicated image may be displayed only once, indicating a duplication using the displayed image with a different color.

Subsequently, if the user touches and selects the thumbnail of the image <NUM> displayed on the bar <NUM>, then images <NUM>, <NUM>, <NUM> displayed on the bar <NUM> subsequent to the relevant image <NUM> are displayed in a successively linked manner.

On the other hand, a first plurality of images captured and generated at a first point in time at which an image generation control command is received and for a period of time prior to and subsequent to the first point in time, and a second plurality of images captured and generated at a second point in time at which an image generation control command is received and for a period of time prior to and subsequent to the second point in time are displayed adjacent to one another.

Furthermore, an image selected from the first and the second plurality of images and at least one image captured and generated subsequent to the selected image are displayed in a successively linked manner according to the time sequence.

Referring to <FIG>, if a link object <NUM> connected between the first and the second thumbnail corresponding to the first and the second image <NUM>, <NUM> is touched and selected, then the thumbnails <NUM> of images captured for a period of time subsequent to capturing the first image <NUM> and images captured for a period of time prior to capturing the second image <NUM> are unfolded.

Each image is displayed according to the captured time sequence. Specifically, the thumbnails <NUM> of images captured for a period of time subsequent to capturing the first image <NUM> and images captured for a period of time prior to capturing the second image <NUM> are displayed according to the captured time sequence.

The thumbnails <NUM> may be unfolded on the original screen as illustrated in <FIG> or unfolded after the screen is converted to create a vacant space as illustrated in <FIG>. At this time, the user may check it by turning the successive thumbnails <NUM> using a flicking input.

Referring to <FIG>, if the user touches and selects one <NUM> of the turned over thumbnails, then the images <NUM> of the thumbnails displayed according to the time sequence from the image <NUM> of the relevant thumbnail and images <NUM> captured by pressing the capture button are displayed.

Specifically, the image <NUM> of the selected thumbnail, the image <NUM> of the thumbnail linked subsequent to the selected thumbnail, the second image <NUM>, images captured for a period of time subsequent to capturing the second image <NUM>, images captured for a period of time prior to capturing the third image connected to the second image <NUM> with a link object, and images captured for a period of time subsequent to capturing the third image are displayed in a linked manner.

Furthermore, referring to <FIG>, thumbnails containing each image may be displayed on the play bar <NUM>. At this time, a dim image effect may be added to the thumbnails of previously reproduced images or the thumbnails <NUM> of images captured prior to the image of the selected thumbnail.

<FIG>, <FIG>, <FIG>, <FIG> and <FIG> are conceptual views illustrating a user interface configured to edit images to be consecutively reproduced according to an embodiment.

Referring to <FIG> and <FIG>, if the user applies a long touch to a link object <NUM> connected between the first and the second thumbnail <NUM>, <NUM> or applies a drag input to the link object <NUM> in the downward direction, then the link object <NUM> disappears.

As a result, if the first thumbnail <NUM> is touched, then a first image contained in the first thumbnail and images captured for a period of time subsequent to the first image are displayed in successively linked manner. In other words, a plurality of images (a second image contained in the second thumbnail and images captured prior to and subsequent to the second image capture point in time) corresponding to the second thumbnail <NUM> are not displayed in a linked manner.

Furthermore, automatically captured images that are not directly captured by pressing the capture button according to a drag input for disconnecting the link object <NUM> may be all deleted. Specifically, images automatically captured for a predetermined period of time prior to and subsequent to the first and the second image other than the first and the second image can be deleted.

Referring to <FIG>, when the first and the second thumbnail <NUM>, <NUM> are touched at the same time and then a drag input is applied in the inward direction or an input for changing the locations of the thumbnails is applied, the locations of the thumbnails <NUM>, <NUM> will be changed. Accordingly, the sequence of images displayed in a successively linked manner can be changed.

Referring to <FIG>, when the first and the second thumbnail <NUM>, <NUM> separated from each other are touched at the same time or a drag input in the inward direction is applied to each of the first and the second thumbnail <NUM>, <NUM>, the first and the second thumbnail <NUM>, <NUM> can be connected with a link object <NUM>.

As a result, when the user touches the first thumbnail <NUM>, a first image corresponding to the first thumbnail <NUM>, images captured for a period of time subsequent to capturing the first image, a second plurality of images (a second image contained in the second thumbnail <NUM> and images captured prior to and subsequent to the second image capture point in time) connected with the link object <NUM> can be displayed in a successively linked manner.

Furthermore, when desired to reproduce images captured for a period of time prior to capturing the first image, a thumbnail <NUM> overlapped under the first thumbnail <NUM> can be touched and selected.

Accordingly, a first plurality of images (a first image contained in the first thumbnail <NUM> and images captured prior to and subsequent to the first image capture point in time) and a second plurality of images (a second image contained in the second thumbnail <NUM> and images captured prior to and subsequent to the second image capture point in time) can be displayed in a successively linked manner according to the captured time sequence.

On the other hand, at least one image among a first and a second image captured by pressing the capture button and a plurality of images captured for a predetermined period of time prior to and subsequent to capturing the first and the second image may be selected and deleted. Otherwise, the selected at least one image may be added to the plurality of images.

Subsequently, an image selected from the edited plurality of images and at least one image captured subsequent to selecting the selected image can be displayed in a successively linked manner according to the captured time sequence.

Referring to <FIG>, when the thumbnail <NUM> of an image desired to be displayed in a successively linked manner is dragged to the second thumbnail <NUM>, the relevant image can be added to a second plurality of images. Accordingly, when the first or the second thumbnail <NUM>, <NUM> is selected, the image of the dragged thumbnail <NUM> can be added and displayed.

At this time, the play sequence of the added image can be set in various ways. For example, the added image may be immediately displayed prior to or subsequent to the image of the second thumbnail <NUM>.

Referring to <FIG>, when the link object <NUM> is selected, the thumbnails <NUM> of images captured subsequent to capturing the first image of the first thumbnail <NUM> and images captured prior to capturing the second image of the second thumbnail <NUM> can be unfolded and displayed.

Subsequently, when the user drags the thumbnail <NUM> of the added image to the third thumbnail <NUM> which is one of the unfolded thumbnails <NUM>, the added image subsequent to the third image corresponding to the third thumbnail <NUM> can be reproduced. In other words, the sequence of reproducing the added image can be set.

Referring to <FIG>, when the second thumbnail <NUM> is dragged to a vacant space of the screen <NUM> or dragged in any direction, the second image can be deleted. As a result, only images excluding the second image may be successively displayed, and the thumbnail of an image captured subsequent to the second image can be displayed.

Referring to <FIG>, any one desired to be deleted from the thumbnails <NUM> unfolded by touching the link object <NUM> may be deleted by dragging it to a vacant space or in any direction. As a result, only images excluding the image of the selected thumbnail <NUM> can be displayed in a successively linked manner.

Referring to <FIG>, the thumbnail <NUM> may be dragged to a vacant space to display only images corresponding to the thumbnail <NUM> in a separate space. Even in this case, only images excluding the image of the selected thumbnail <NUM> can be displayed in a successively linked manner. Furthermore, the dragged image <NUM> is not deleted but separately exists as a sheet of image.

<FIG> is a conceptual view illustrating a user interface configured to reproduce a plurality of images in a successively linked manner according to another embodiment.

Referring to <FIG>, if the user touches and selects one <NUM> of thumbnails unfolded on a first link object <NUM> connected between the first and the second thumbnail <NUM>, <NUM>, then images <NUM>, <NUM> captured subsequent to the image of the selected thumbnail <NUM> can be displayed in a successively linked manner at an inner portion <NUM> of the thumbnail unfolded on the first link object <NUM>.

Referring to <FIG>, the images of thumbnails <NUM>, <NUM>, <NUM> unfolded on the first link object <NUM> may be all displayed, and then a plurality of automatically captured images may be displayed at an inner portion of the thumbnail <NUM> displayed on the second link object <NUM> connected between the second and the third thumbnail <NUM>, <NUM>.

Specifically, the second image of the second thumbnail <NUM>, images captured subsequent to capturing the second image and images captured prior to capturing the third image, the third image, images capturing subsequent to capturing the third image can be displayed in a successively linked manner at an inner portion of the thumbnail <NUM> on the second link object <NUM>.

<FIG> and <FIG> are conceptual views illustrating a user interface configured to display reproducible images at the same time according to an embodiment.

Referring to <FIG>, when the user applies a pinch-out input to the first image <NUM>, the first image <NUM> and some <NUM>, <NUM>, <NUM> of images captured at a point in time prior to and subsequent to capturing the first image can be unfolded.

Referring to <FIG>, when the user applies a pinch-out input again in <FIG>, some <NUM>, <NUM>, <NUM>, <NUM> of images captured at a point in time prior to and subsequent to capturing the first image may be further displayed in addition to the images <NUM>, <NUM>, <NUM>, <NUM> displayed in <FIG>.

For example, when the user applies a pinch-out input once, the first image <NUM>, the second image <NUM> captured at <NUM> second prior to capturing the first image, the third image <NUM> captured at <NUM> second subsequent to capturing the first image, and the image <NUM> captured at <NUM> second subsequent to capturing the first image can be displayed.

Subsequently, when the user applies a pinch-out input again, images <NUM>, <NUM> captured at <NUM> second and <NUM> seconds, respectively, prior to capturing the first image, and images <NUM>, <NUM> captured at <NUM> seconds and <NUM> seconds, respectively, subsequent to capturing the first image can be displayed along with the previously displayed images <NUM>, <NUM>, <NUM>, <NUM>.

For another embodiment, automatically capture images may be displayed with a narrower time interval as a successive pinch-out input is applied.

Specifically, when an initial pinch-out input is applied to an image captured by pressing the capture button, four sheets of images captured with a four-second interval among images automatically captured for <NUM> seconds may be displayed.

Subsequently, when a pinch-out input is applied again to the displayed four sheets of images, eight sheets of images captured with a two-second interval may be displayed.

Referring to <FIG>, when the user selects one <NUM> of the displayed images in <FIG>, images <NUM>, <NUM>, <NUM>, <NUM>, <NUM> captured according to the time sequence from the relevant image <NUM> can be displayed in a successively linked manner.

At this time, the thumbnails <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> of displayable images may be displayed on the play bar <NUM>, and a dim image effect may be added to the thumbnail of a previously displayed image or the thumbnails of images captured prior to the selected image capture point in time. Otherwise, they may be displayed on the play bar <NUM> from the thumbnail <NUM> of the selected image.

For still another embodiment, when one <NUM> of thumbnails displayed on the play bar <NUM> is touched and selected while reproducing the image <NUM>, the screen may be converted to display images in a successively linked manner from an image corresponding to the relevant thumbnail <NUM>.

<FIG> and <FIG> are conceptual views illustrating a user interface configured to reproduce an audio file contained in a plurality of images according to an embodiment.

Referring to <FIG>, a plurality of images can be unfolded and displayed as illustrated in <FIG> and <FIG>. The user may touch and select one <NUM> of them. For example, the thumbnail <NUM> of the first image can be selected using a double tab.

Referring to <FIG>, the play bar <NUM> of the first image <NUM> may be displayed, and the user may control the location of the play bar <NUM> using a drag input to display an image corresponding to the location of the play bar <NUM>.

Specifically, when a drag input is applied to the left side, images captured prior to capturing the first image <NUM> can be displayed in a sequential manner. Similarly, when a drag input is applied to the right side, images captured subsequent to capturing the first image <NUM> can be displayed in a sequential manner.

In other words, image files provided like one lengthy photo may be dragged in the horizontal direction to retrieve previous or subsequent images, and the thumbnail of images to be reproduced may be displayed on the play bar <NUM> at a lower end thereof according to the play sequence of each image.

For yet still another embodiment, a flicking input may be applied to an image displayed in <FIG> to retrieve images by turning them over.

Specifically, when a flicking input is applied to the left side, images captured prior to capturing the first image <NUM> may be sequentially displayed. Similarly, when a flicking input is applied to the right side, images captured subsequent to capturing the first image <NUM> may be sequentially displayed.

Referring to <FIG>, icons <NUM>, <NUM> containing information on images captured along with the captured image may be displayed.

Specifically, when information on a captured place is stored, a location information icon <NUM> may be displayed. Furthermore, when an audio file exists in the captured image, an audio information icon <NUM> may be displayed.

For example, when information on a place where the first image <NUM> is captured is stored, the location information icon <NUM> can be displayed at the same time when displaying the first image <NUM>. When an audio file exists in an image displayed subsequent to the first image <NUM>, the location information icon <NUM> that has been displayed disappears to display the audio information icon <NUM>.

For still yet another embodiment, the location and audio information icon <NUM>, <NUM> continue to be displayed, and when an audio file exists in the displayed image, only the audio information icon <NUM> may be displayed in a highlighted manner such as in an enlarged manner or in a different color.

Subsequently, when the user touches and selects the audio information icon <NUM>, only audio may be output while continuing to display the first image <NUM>. Specifically, the first image <NUM> can be displayed on the screen <NUM>, and only audio contained in images captured prior to and subsequent to the displayed image <NUM> can be sent out.

For yet still another embodiment, while successively displaying images automatically captured subsequent to the first image <NUM>, audio contained in the images may be output at the same time. In other words, subsequent images may be displayed in a successively linked manner without using a drag input applied to the play bar <NUM> or a flicking input applied to the images.

Referring to <FIG>, when an audio information icon is selected, audio is output, and the audio information icon <NUM> may be changed to a text information icon <NUM>.

Specifically, when the user touches and selects the <NUM>, audio information may be converted and displayed as text. For example, text may be displayed at a lower end or edge of the screen <NUM>. Otherwise, when the speaker of the voice is displayed on the image, the text may be displayed in a talk balloon for the relevant speaker.

For example, the voice of the speaker <NUM> contained in the first image <NUM> may be converted into text, and then the text may be displayed in a talk balloon <NUM> for the speaker. At this time, the voice may be also sent out at the same time.

For still yet another embodiment, while successively displaying images automatically captured subsequent to the first image <NUM>, text converted from audio contained in the images may be output at the same time. In other words, subsequent images may be displayed in a successively linked manner without using a drag input applied to the play bar <NUM> or a flicking input applied to the images.

<FIG> is a conceptual view illustrating a user interface configured to edit text converted from a voice contained in an image according to an embodiment.

Referring to <FIG>, when the user touches a text information icon <NUM>, text <NUM> converted from audio being output from an image may be output at the same time while turning the screen over. At this time, the audio of the relevant text can be output at the same time.

Referring to <FIG>, talk balloons <NUM>, <NUM> containing texts that are spoken by speakers may be displayed for each speaker, and each talk balloon <NUM>, <NUM> may be displayed in a different color or shape. Subsequently, the user may touch and select the talk balloon <NUM> of the text desired to be edited.

Referring to <FIG>, it enters a text edit mode capable of editing the selected text. Specifically, the selected talk balloon <NUM> may be displayed in an enlarged manner, and a cursor <NUM> capable of modifying text may be displayed within the talk balloon <NUM>.

Accordingly, the user can modify text, and then audio corresponding to the modified text can be output when an audio information icon is selected by the user. In other words, the user can also modify audio information being output due to the modification of text. Furthermore, the user can delete the displayed text to delete the audio.

As illustrated in <FIG> and <FIG>, when selecting the audio information icon <NUM>, the audio information icon <NUM> may be changed and displayed as a text information icon <NUM> or <NUM>, but each icon <NUM>, <NUM> or <NUM> may be displayed in a separate manner. In other words, the audio and text information icon <NUM>, <NUM> or <NUM> may be displayed at once, respectively.

<FIG> is a conceptual view illustrating a user interface configured to store an image displayed with text according to an embodiment.

Referring to <FIG>, text converted from the voice may be displayed at the same time on the image <NUM>. At this time, the user can apply a long touch or double tap to select the displayed image <NUM>.

Referring to <FIG>, a message window <NUM> asking whether to store the displayed image <NUM> may be displayed. When the user touches and selects a "Yes" button, the image <NUM> displaying the text <NUM> may be stored.

Specifically, the image <NUM> displaying the text <NUM> may be stored instead of a previous image that has not been displayed with the text <NUM>. Otherwise, the image <NUM> displaying the text <NUM> may be stored as one of images prior to and subsequent to a previous image.

For yet still another embodiment, the audio file of the relevant text may be also stored along with the image <NUM> displaying the text <NUM>.

For still yet another embodiment, when the user applies a double tab to the edited screen after text editing in <FIG>, a message window <NUM> asking whether to store the image may be displayed similarly to that of <FIG>.

<FIG> is a conceptual view illustrating a user interface associated with the location information of an image according to an embodiment.

Referring to <FIG>, when the user touches a location information icon <NUM>, information <NUM> on a location at which the displayed image <NUM> is captured may be displayed on the screen.

For example, a map <NUM> indicating a location at which the first image <NUM> is captured, a name <NUM> of a place at which the first image <NUM> is captured or the like may be displayed. Subsequently, the user can touch and select the displayed information <NUM>.

Referring to <FIG>, the thumbnails <NUM> of an image or video associated with the selected location information <NUM> may be displayed. For example, images captured at the same place as that of the first image <NUM> or the thumbnail of images captured at a place associated with a place where the first image <NUM> is captured may be displayed. Furthermore, a plurality of thumbnail lists may be turned over and displayed according to the user's flicking input.

At this time, when the user touches and selects one of the plurality of thumbnails, the image of the relevant thumbnail may be displayed.

<FIG> and <FIG> are conceptual views illustrating a user interface configured to select images to be reproduced according to an embodiment.

Referring to <FIG>, when the user applies a long touch to the screen displayed with the thumbnails of images, a check box is displayed for each image. When the user touches and selects check boxes <NUM>, <NUM>, <NUM>, <NUM>, check indicators are displayed in the check boxes <NUM>, <NUM>, <NUM>, <NUM>, respectively. Then, the user can touch and select a play button <NUM>.

Referring to <FIG>, only images <NUM>, <NUM>, <NUM>, <NUM> checked with a check box may be displayed in a successively linked manner, and thumbnails <NUM>, <NUM>, <NUM>, <NUM> corresponding to the checked images may be displayed on a play bar <NUM>.

As an embodiment, thumbnails corresponding to unchecked images may be displayed on the play bar along with a dim effect.

Referring to <FIG>, the checked images <NUM>, <NUM>, <NUM>, <NUM> are all reproduced, and then a message window <NUM> asking whether or not to make a new file with the reproduced images <NUM>, <NUM>, <NUM>, <NUM> may be displayed. Subsequently, the user may select "Yes" to store the reproduced images <NUM>, <NUM>, <NUM>, <NUM> as a new file.

<FIG> and <FIG> are conceptual views illustrating a user interface configured to display a captured image as a thumbnail according to an embodiment.

Referring to <FIG>, when the user touches and selects the thumbnail of the first image <NUM>, the first image <NUM> and images <NUM>, <NUM>, <NUM>, <NUM> captured subsequent to capturing the first image <NUM> may be successively displayed like video.

Specifically, images <NUM>, <NUM>, <NUM> automatically captured subsequent to capturing the first image <NUM> by pressing the capture button and a second image <NUM> captured by pressing the capture button may be successively displayed.

As described above, the thumbnail of each image <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may be displayed on a play bar. Furthermore, an image effect distinguished from that of the thumbnail of automatically captured images <NUM>, <NUM>, <NUM> may be added to the thumbnail of the first and the second image <NUM>, <NUM> captured by pressing the capture button.

Referring to <FIG>, one <NUM> of automatically captured images being reproduced may be captured by selecting the capture button <NUM>.

Specifically, the capture button <NUM> may be implemented with a touch button capable of receiving a touch input or a physical button capable of receiving a push input.

Referring to <FIG>, the thumbnail of the captured image <NUM> may be connected and displayed between the thumbnails of the first and the second image <NUM>, <NUM> with a link object.

In other words, when compared with <FIG>, it is seen that the thumbnail of the captured image <NUM> may be connected and displayed between the thumbnails of the first and the second image <NUM>, <NUM> with a link object.

According to the present disclosure, the user can capture an image even for a predetermined period of time prior to and subsequent to directly touching the capture button of the terminal camera. As a result, the user can capture his or her desired scene without missing.

Furthermore, images associated with one another, for example, images that have captured for the same object or images captured within a predetermined period of time, may be collectively displayed at once or successively displayed like video.

In addition, images to be displayed in a successively linked manner may be edited using a method of selecting images to be successively displayed, removing part of images being successively displayed, or the like.

As a result, it may be possible to enhance the user's convenience.

According to an embodiment of present disclosure, the foregoing method may be implemented as codes readable by a processor on a medium written by a program. Examples of the processor-readable media may include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device, and the like, and also include a device implemented in the form of a carrier wave (for example, transmission via the Internet).

Claim 1:
A mobile terminal (<NUM>) for displaying an image, comprising:
a camera (<NUM>) configured to capture an image;
a touch screen (<NUM>) configured to display the captured image;
a memory (<NUM>) configured to store the image captured by the camera (<NUM>); and
a controller (<NUM>) configured to:
execute an image capture mode to automatically capture images in a continuous manner prior to an input applied to a capture button,
in response to a first input at a first time point, control the camera (<NUM>) to capture a first image (<NUM>) and a first plurality of images (<NUM>, <NUM>), wherein the first plurality of images (<NUM>, <NUM>) are automatically captured for a predetermined time period prior to the first time point and for the predetermined time period subsequent to the first time point,
in response to a second input at a second time point subsequent to the first time point, control the camera (<NUM>) to capture a second image (<NUM>) and a second plurality of images (<NUM>, <NUM>), wherein the second plurality of images (<NUM>, <NUM>) are automatically captured for the predetermined time period prior to the second time point and for the predetermined time period subsequent to the second time point,
characterized in that when the first time point and the second time point where the capture button is pressed are within a previously set time period, store the first image (<NUM>), the first plurality of images (<NUM>, <NUM>), the second image (<NUM>) and the second plurality of images (<NUM>, <NUM>) linked to each other according to the captured time sequence in the memory (<NUM>),
in response to a touch and selection of a thumbnail of the first image (<NUM>) displayed on the touch screen (<NUM>), output the first image (<NUM>), the images of the first plurality of images (<NUM>, <NUM>) which have been automatically captured for the predetermined period subsequent to the first time point, the second image (<NUM>) and the second plurality of images (<NUM>, <NUM>) in one successively linked video according to the captured time sequence on the touch screen (<NUM>), and
when the first time point and the second time point are within the previously set time period and images commonly exist between the first plurality of images and the second plurality of images, display the common images between the first plurality of images and the second plurality of images only once during the output.