Patent Description:
Image display devices are devices for displaying and representing images, characters, or figures.

Image display devices have been typically used for displaying images of an original purpose. However, as advanced image display devices are recently emerged, various additional functions are provided through the image display device besides the image display function.

Since equipped with a function of allowing users to transmit and receive information with TVs, these image display devices provide various functions which meet the users' needs in comparison to the existing TVs unilaterally delivering information.

Thus the image display device is called as an interactive TV. The image display device may be connected to an internet line through a wired or wireless communication network and provide various functions such as web surfing and VOD viewing, social network service, or game.

In addition, the image display device may provide a function of receiving images or photos through a network or an external storage device and displaying them. Accordingly, the user may see the images or photos through a large screen of the image display device.

In addition, the image display device may operate various applications driven in a mobile terminal.

Various applications driven in the image display device include a social network service (SNS) or a game, and in particular, include a fitness application interworking with an interworking device capable of interworking with the image display device and helping user's exercise.

However, when this fitness application is driven in the image display device, viewing the advanced image display device may be hampered.

In addition, it is also cumbersome to connect, to the image display device, the interworking device interworking with the image display device at the time of driving the fitness application and drive a corresponding application by manipulating a separate remote controller.

<CIT> discloses a technique allowing a user to access an exercise program easily and quickly. A user presses a specific button on a TV remote to open an exercise interface and selects an exercise programs from the interface. Subsequently, the exercise program is displayed on the screen. The exercise program has a fixed time length and may be a video of an exercise coach. An additional device may be used to analyse the user's exercise.

Embodiments provide image display devices and operation methods thereof capable of providing an interface optimized to drive a necessary application in the image display device without hampering a user from viewing the image display device.

According to the present invention, an image display device is set forth in claim <NUM>. Preferred embodiments are provided in dependent claims.

According to an embodiment among various embodiments, an optimized interface between an interworking device interworking with a smart TV through an image display device and the image display device can be provided.

In addition, according to an embodiment among various embodiments, user's convenience can be increased by recommending applications related to events and previously created user information when various types of the events occur in addition to providing broadcast services through an image display device.

In the following description, usage of suffixes such as 'module', 'part' or 'unit' used for referring to elements is given merely to facilitate explanation of the present invention, without having any significant meaning by itself. It should be noted that 'module', 'part', and 'unit' can be substitutively, alternatively or mixedly used.

A screen display control method and an image display device using the same according to an embodiment will be described in detail with reference to the accompanying drawings.

An image display device according to embodiments is an intelligent image display device that, for example, a computer supporting function is added to a broadcast receiving function. The image display device may be equipped with a convenient to use interface such as a written type input device, touch screen, or spatial remote controller due to addition of the internet function while sticking by the broadcast receiving function. In addition, the image display device may also access the internet and a computer by a support of wired or wireless communication, and perform functions of email, web browsing, banking or game. For these various functions, a standardized general purpose OS may be used.

Therefore, an image display device described here may perform various user-friendly functions, because various applications may be freely added to or removed from a kernel of the general purpose OS. The image display device may be, as a detailed example, a network TV, a hybrid broadcast broadband (HBB) TV, a smart TV, an LED TV, or an OLED TV, and may also be applied to a smart phone in some cases.

<FIG> is a block diagram illustrating a configuration of an image display device according to an embodiment.

Referring to <FIG>, an image display device <NUM> may include a broadcast receiving unit <NUM>, an external device interface unit <NUM>, a storage unit <NUM>, a user input interface unit <NUM>, a controller <NUM>, a display unit <NUM>, an audio output unit <NUM>, and a power supply unit <NUM>. The broadcast receiving unit <NUM> may include a tuner <NUM>, a demodulation unit <NUM>, and a network interface unit <NUM>.

The external interface unit <NUM> may receive an application or an application list in an adjacent external device, and deliver it to the controller <NUM> or the storage unit <NUM>.

The network interface unit <NUM> may provide an interface for connecting the image display device to a wired/wireless network including the internet. The network interface unit <NUM> may transmit or receive data to or from another user or another electronic device through an accessed network or another network linked to the accessed network.

In addition, the network interface unit <NUM> may transmit some of content data stored in the image display device <NUM> to a selected user or a selected electronic device among other users or other electronic devices pre-registered for the image display device <NUM>.

The network interface unit <NUM> may access a certain web page through an accessed network or another network linked to the accessed network. In other words, the network interface unit <NUM> may access a certain web page through the network and transmit or receive data to or from a corresponding server.

In addition, the network interface unit <NUM> may receive content or data provided by a content provider or a network operator. In other words, the network interface unit <NUM> may receive content such as movie, advertisement, game, VOD, broadcast signal and information related thereto provided from the content provider or the network operator through the network.

In addition, the network interface unit <NUM> may receive firmware update information or update files provided by the network operator, and transmit data to the internet, content provider, or the network operator.

The network interface unit <NUM> may select and receive desired applications among applications opened in public through the network.

The storage unit <NUM> may store images, voices, or data signals stored and signal-processed by programs for signal-processing and controlling in the controller <NUM>.

In addition, the storage unit <NUM> may perform a function of temporarily storing images, voices, or data signals input from the external interface unit <NUM> or the network interface unit <NUM>, and may store information on images through a channel memory function.

The storage unit <NUM> may store an application or an application list input from the external interface unit <NUM> or the network interface unit <NUM>.

The image display device <NUM> may play, to the user, content files (a video file, a still image file, a music file, a document file, an application file, etc.) stored in the storage unit <NUM>.

The user input interface unit <NUM> may deliver a signal input by the user to the controller <NUM>, or deliver a signal from the controller <NUM> to the user. For example, the user input interface unit <NUM> may receive and process a control signal such as power on/off, channel selection, or screen setting from the remote controller <NUM>, or transmits a control signal from the controller <NUM> to the remote controller <NUM> according to various communication schemes such as Bluetooth, ultra wideband (WB), ZigBee, radio frequency (RF) communication, and infrared (IR) communication.

In addition, the user input interface unit <NUM> may deliver a control signal input through a power key, a channel key, a volume key, or a local key (not shown) for a setting value, etc..

An image signal image-processed by the controller <NUM> may be input to the display unit <NUM> and displayed as an image corresponding to the corresponding image signal. In addition, the image signal image-processed by the controller <NUM> may be input to an external output unit through the external device interface unit <NUM>.

A voice signal processed by the controller <NUM> may be audio-output to the audio output unit <NUM>. In addition, the voice signal processed by the controller <NUM> may also be input to the external output device through the external device interface unit <NUM>.

In addition, the controller <NUM> may control overall operation in the image display device <NUM>.

The controller <NUM> may also control the image display device <NUM> by means of user commands input through the user input interface unit <NUM> or internal programs, and access a network and allow the user to download a desired application or application list to the image display device <NUM>.

The controller <NUM> may allow user-selected channel information to be output together with the processed image or voice signal through the display unit <NUM> or the audio output unit <NUM>.

In addition, the controller <NUM> may allow an image signal or a voice signal input through the external device interface unit <NUM> from an external device, for example, a camera or a camcorder to be output to the display unit <NUM> or the audio output unit <NUM> according to an external device image playback command received through the user input interface unit <NUM>.

On the other hand, the controller <NUM> may control the display unit <NUM> so as to display an image, and control so that a broadcast image input through the tuner <NUM>, an external input image input through the external interface unit <NUM>, an image input through the network interface unit, or an image stored in the storage unit <NUM> is displayed on the display unit <NUM>. In this case, the image displayed on the display unit <NUM> may be a still image or a video, or a <NUM>-dimensinal (2D) or <NUM>-dimensional (3D) image.

The controller <NUM> may also control so that content stored in the image display device <NUM>, received content, or externally input content is played, and the content may have various types including a broadcast image, an externally input image, an audio file, a still image, an accessed web screen, and a document file.

The display unit <NUM> may convert an image signal, a data signal, or an OSD signal processed by the controller <NUM>, or an image signal, or a data signal received by the external device interface unit <NUM> into an RGB signal, and generate a driving signal.

On the other hand, the image display device <NUM> illustrated in <FIG> is merely an embodiment, and some of the illustrated elements may be integrated, added or omitted according to specification of the actually implemented image display device <NUM>.

In other words, in some cases, two or more elements may be integrated into one element, or one element may be divided into two or more elements. In addition, a function performed by each block is for explaining an embodiment, and detailed operations or devices thereof are not limit the scope of the present invention.

According to another embodiment, the image display device <NUM> may receive an image through the network interface unit <NUM> or the external device interface <NUM> and play the image without including the tuner <NUM> and the demodulation unit <NUM>, which is different from as shown in <FIG>.

For example, the image display device <NUM> may be implemented as divided into an image processing device such as a set top box for receiving a broadcast signal or contents according to various network service, and a content playing device playing contents input from the image processing device.

In this case, an image displaying method according to an embodiment to be described below may be executed by not only the image display device <NUM> as described above with reference to <FIG>, but also the image processing device such as the divided set top box or content playing device including the display unit <NUM> and audio output unit <NUM>.

Next, a remote controller according to an embodiment is described with reference to <FIG> and <FIG>.

<FIG> is a block diagram illustrating a remote controller and an interworking device, and <FIG> illustrates an exemplary configuration of a remote controller according to an embodiment.

First, as illustrated in <FIG>, the remote controller <NUM> may include a wireless communication unit <NUM>, a user input unit <NUM>, a sensor unit <NUM>, an output unit <NUM>, a power supply unit <NUM>, a storage unit <NUM>, and a controller <NUM>.

As illustrated in <FIG>, the wireless communication unit <NUM> transmits and receives a signal with any one of the above-described image display devices.

The remoter controller <NUM> may include an RF module <NUM> that is capable of transmitting and receiving a signal with the image display device <NUM> according to RF communication specification, and include an IR module <NUM> that is capable of transmitting and receiving a signal with the image display device <NUM> according to IR communication specification.

In addition, the remote controller <NUM> may transmit a signal having information on movement of the remote controller <NUM> therein to the image display device <NUM> through the RF module <NUM>.

Furthermore, the remote controller <NUM> may receive a signal transmitted by the image display device <NUM> through the RF module <NUM>, and transmit a command such as power on/off, channel change, or volume change to the image display device <NUM> through the IR module <NUM> in some cases.

The user input unit <NUM> may include a keypad, buttons, a touch pad, or a touch screen, etc. The user may manipulate the user input unit <NUM> and input commands related to the image display device <NUM> to the remote controller <NUM>. When the user input unit <NUM> includes a hard key button, the user may input commands related to the image display device <NUM> to the remote controller <NUM> through a push operation to the hard key button. Regarding this, description is made with reference to <FIG>.

Furthermore, the interworking device <NUM> shown in <FIG> indicates an external device interworking with the image display device of the embodiment and includes, but not limited to, both of a user's health information sensing device and a user's body information sensing device.

As illustrated in <FIG>, the remote controller <NUM> may include a plurality of buttons. The plurality of buttons may include a power button <NUM>, a channel button <NUM>, an emotion mode button <NUM> and a LIVE button <NUM>.

The power button <NUM> may be a button for turning on/off power of the image display device <NUM>.

The channel button <NUM> may be a button for receiving a broadcast signal of a specific broadcast channel.

The emotion mode button <NUM> may be a button for entering an emotion mode to be described later.

The LIVE button <NUM> may be a button for displaying a broadcast program in real time.

Description is made with reference to <FIG> again.

When the user input unit <NUM> includes a touch screen, the user may input commands related to the image display device <NUM> to the remote controller <NUM> by touching soft keys on the touch screen. In addition, the user input unit <NUM> may include various kinds of input units operable by the user including a scroll key or a jog key, etc., and the embodiment does not limit the scope of the present invention.

The sensor unit <NUM> may include a gyro sensor <NUM> or an acceleration sensor <NUM>, and the gyro sensor <NUM> may sense information on movement of the remote controller <NUM>.

For example, the gyro sensor <NUM> may sense information on the movement of the remote controller <NUM> on the basis of x, y, z axes, and the acceleration sensor <NUM> may sense information on a movement speed of the remote controller <NUM>. In addition, the remote controller <NUM> may further include a distance measuring sensor and sense a distance to the display unit <NUM> of the image display device <NUM>.

The output unit <NUM> may output images or voice signals corresponding to manipulation of the user input unit <NUM> or corresponding to a signal transmitted by the image display device <NUM>. Through the output unit <NUM>, the user may recognize whether the user input unit <NUM> is manipulated or whether the image display device <NUM> is controlled.

For example, the output unit <NUM> may include an LED module <NUM> turned on, a vibration module <NUM> generating vibration, a sound output module <NUM> outputting a sound, or a display module <NUM> outputting an image, when the user input unit <NUM> is manipulated or signals are transmitted and received with the image display device <NUM> through the wireless communication unit <NUM>.

In addition, the power supply unit <NUM> supplies power to the remote controller <NUM>. When the remote controller <NUM> is not moved for a predetermined time, the power supply unit <NUM> stops supplying power to the remote controller <NUM> and may reduce power waste. The power supply unit <NUM> may resume supplying power when a certain key prepared in the remote controller <NUM> is manipulated.

The storage unit <NUM> may store various kinds of programs necessary for controlling or operating the remote controller <NUM> or application data. When the remote controller <NUM> wirelessly transmits and receives signals with the image display device <NUM> through the RF module <NUM>, the remote controller <NUM> and the image display device <NUM> transmit and receive signals through a certain frequency band.

The controller <NUM> of the remote controller <NUM> may store, in the storage unit <NUM>, and refer to information on a frequency band through which signals are wirelessly transmitted and received with the image display device <NUM> paired with the remote controller <NUM>.

The controller <NUM> controls overall items related to controls of the remote controller <NUM>. The controller <NUM> may transmit, to the image display device <NUM> through the wireless communication unit <NUM>, signals corresponding to manipulation of a certain key of the user input unit <NUM> or corresponding to the movement of the remote controller <NUM>, which is sensed by the sensor unit <NUM>.

An operation method of the image display device <NUM> according to an embodiment is described with reference to <FIG>.

Hereinafter, "recommend an application", or "recommend a related application" may be used as having the same meaning as "output recommended application information".

<FIG> is a flowchart illustrating an operation method of the image display device <NUM> according to an embodiment of the present invention.

As illustrated in <FIG>, the controller <NUM> obtains user information through the user interface unit <NUM> (operation S401).

The user information may include user's health information. The user's health information includes, but not limited to, user's body information and user's exercise amount information.

The user's body information may include weight, height, fat mass, caloric intake, blood pressure, pulse, whether to have a disease, and/or whether to have an injury. The user's exercise amount information may include, but not limited to, a total target amount of exercise, a remaining target amount of exercise and/or an amount of exercise done by the user.

A method that the controller <NUM> obtains user's information may include, but not limited to, a method of obtaining the user's information through user's input by using the user interface <NUM>. The controller <NUM> accesses the interworking device <NUM> or an external input device (not shown) through the user interface unit <NUM> and obtains the input of the user information.

As shown in <FIG>, the controller <NUM> obtains the user information and then determines whether an event is obtained (operation S403).

As shown in <FIG>, the event is firstly obtained and then the user information may be obtained.

In other words, the controller <NUM> obtains the user information as shown in <FIG>, and then obtains the event. Alternatively, after obtaining the event and then the user information (operations S501 and s503), the controller <NUM> may recommend an application (operation S505) as shown in <FIG>. However, it is not limited hereto.

Hereinafter, the event is described in detail.

An example of the event may include the case where the interworking device <NUM> interworks with the image display device <NUM> in a state where power of the image display device <NUM> is turned on.

Another example of the event may include the case where the interworking device <NUM> interworks with the image display device <NUM> during receiving a LIVE TV signal in the image display device <NUM>. The reception of the LIVE TV signal may indicate that a corresponding image is played on the image display device <NUM> in a state of power on.

An example of the interworking device <NUM> may include a health management device (or exercise auxiliary device) related to a health management application. An example of the health management device may include, but not limited to, a stick <NUM>, a mat <NUM>, a shoe <NUM>, a bicycle <NUM>, a blood pressure monitor <NUM>, a weighing scale <NUM>, a thermometer <NUM>, a pedometer <NUM>, and/or a life-band.

Another example of the interworking device <NUM> may include a wearable glass, a wearable watch, a smart phone, and smart tablet equipment related to a health management application.

Another example of an event may include a case where a LIVE TV signal is received after reception of a mid-program ad signal is completed.

Another example of an event may include a case where a signal of a view-reserved program is received in a state where power of the image display device <NUM> is turned on.

Another example of an event may include a case where a preset preferred program signal is received in a state where power of the image display device <NUM> is turned on.

Another example of an event may include a case where a user's gesture obtained by the camera <NUM> connected to the image display device <NUM>.

Another example of an event may include a user's voice signal obtained through a microphone connected to the image display device <NUM>.

As illustrated in <FIG>, when an event is obtained, the controller <NUM> may output recommended application information on the display unit <NUM> on the basis of obtained user information or the event (operation S405).

The controller <NUM> may output the recommended application information on the basis of the obtained user information or event, or output the recommended application information on the basis of both the obtained user information and event. However, it is not limited hereto.

The recommend application information may include, but not limited to, a recommended application name list, a recommended application icon list and/or a recommended application execution screen.

<FIG> are flowcharts illustrating an operation method of the image display device <NUM> according to other embodiments.

As illustrated in <FIG>, when user information is obtained and then an event is obtained (operations S601, S604), the controller <NUM> may display a recommended application name list (operation S607).

As illustrated in <FIG>, when user information is obtained and then an event is obtained (operations S602, S605), the controller <NUM> may display a recommend application icon list (operation S608).

As illustrated in <FIG>, when user information is obtained and then an event is obtained (operations S603, S606), the controller <NUM> may display, but not limited to, a recommended application execution screen (operation S609).

As illustrated in <FIG>, when the user information and event are obtained (S701, S702), the controller <NUM> may recommend an application on the basis of the user information and event (operation S703).

As illustrated in <FIG>, when the user information and event are obtained (S704, S705), the controller <NUM> may recommend an application on the basis of the user information (operation S706).

As illustrated in <FIG>, when the event is obtained (S707), the controller <NUM> may recommend an application on the basis of, but not limited to, the event (operation S708).

Hereinafter, referring to <FIG>, description is made about an event obtaining method which is a basis of an operation of outputting recommended application information on the display unit <NUM>.

<FIG> are views representing an operation of sensing the interworking device <NUM> as an example of an event according to an embodiment.

The interworking device <NUM> described below may include communication units <NUM>, <NUM>, <NUM>, and <NUM>, and sensing units <NUM>, <NUM>, <NUM>, and <NUM>. The communication units <NUM>, <NUM>, <NUM>, and <NUM> in the interworking device <NUM> may transmit and receive communication signals with the network interface unit <NUM> in the image display device <NUM>, and in particular, transmit a sensing signal to the network interface unit <NUM> in the image display device <NUM>.

As an example that the image display device <NUM> obtains an event, there is a method of sensing a movement (acceleration movement or uniform velocity movement) through the sensing units <NUM>, <NUM>, <NUM>, and <NUM>.

As another example that the image display device <NUM> obtains an event, there is a method that the image display device <NUM> receives an input signal input to the interworking device <NUM> and obtains an event.

As illustrated in <FIG>, an example of the interworking device <NUM> may include a stick <NUM>.

The stick <NUM> may mean a moveable rod. The stick <NUM> is moveable back and forth and right and left based on a longitudinal direction of the stick <NUM>, and also moveable in the longitudinal direction, but is not limited hereto.

As illustrated in <FIG>, the stick <NUM> may include the communication unit <NUM> and the sensing unit <NUM>.

The sensing unit <NUM> may include a gyro sensor or an acceleration sensor. A method that the controller <NUM> of the image display device <NUM> obtains information on movement of the stick <NUM> through the gyro sensor or the acceleration sensor is identical to an operation of each sensor, and therefore detailed description thereabout is omitted.

The sensing unit <NUM> of the stick <NUM> may sense movement (or acceleration) of the stick <NUM> and generate a movement signal. The communication unit <NUM> of the stick <NUM> may transmit the generated movement signal to the image display device <NUM>.

The controller <NUM> of the image display device may output recommended application information related to the stick <NUM> on the basis of the movement signal of the stick <NUM>, which is obtained from the movement of the stick <NUM>.

An example of the recommended application related to the stick <NUM> may include an exercise application that receives an input signal through the stick <NUM> and is driven on the basis of the input signal received through the stick <NUM>. An example of the exercise application related to the stick <NUM> may include an exercise application using dumbbells or an exercise application requiring a motion from the user to clench his/her fist. The exercise application related to the stick <NUM> includes, but not limited to, an application or an exercise related application driven through the stick <NUM>.

As shown in <FIG>, another example of the interworking device <NUM> includes a mat <NUM>.

An exemplary type of the mat <NUM> may include, but not limited to, a rectangular, circular or regular polygon type. A material of the mat <NUM> may include, but not limited to, a plastic or a metal.

As shown in <FIG>, the mat <NUM> may include the communication unit <NUM> and the sensing unit <NUM>.

The sensing unit <NUM> in the mat <NUM> may sense pressure applied to the mat <NUM> and generate a mat pressure signal. The communication unit <NUM> in the mat <NUM> may transmit the mat pressure signal generated by the sensing unit <NUM> to the image display device <NUM>.

The controller <NUM> in the image display device <NUM> may output recommended application information related to the mat <NUM> on the basis of the mat pressure signal transmitted to the image display device <NUM> from the mat <NUM>.

The recommended application related to the mat <NUM> may include one or more applications driven by using the mat <NUM>.

An example of the application using the mat <NUM> may include, but not limited to, an exercise application requiring a motion done by the user standing on two legs or one leg on the mat <NUM> or a motion done by the user sitting down on the mat <NUM>.

As illustrated in <FIG>, another example of the interworking device <NUM> may include a shoe <NUM>.

An example of a kind of the shoe <NUM> may include, but not limited to, a sneaker or a slipper.

As illustrated in <FIG>, the shoe <NUM> may include the communication unit <NUM> and the sensing unit <NUM>.

The sensing unit <NUM> in the shoe <NUM> senses pressure through the sole of the shoe <NUM> and generates a shoe pressure signal. The communication unit <NUM> in the shoe <NUM> may transmit the shoe pressure signal generated in the sensing unit <NUM> to the image display device <NUM>.

The controller <NUM> in the image display device <NUM> may output recommended application information driven by using the shoe <NUM> on the basis of the shoe pressure signal transmitted from the shoe <NUM>.

The recommended application driven by using the shoe <NUM> may include all exercise applications requiring a motion performable in a state where the user wears the shoe <NUM>. Examples thereof may include, but not limited to, a running exercise application, a walking exercise application and a jumping rope exercise application.

As illustrated in <FIG>, another example of the interworking device <NUM> includes a bicycle <NUM>.

The bicycle <NUM> may include pedals through which a rotation input of the user is obtainable and wheels accelerated by the rotation input.

As shown in <FIG>, the bicycle <NUM> may include the communication unit and the sensing unit <NUM>.

The sensing unit <NUM> in the bicycle <NUM> may sense a rotation input applied to the pedals and generate a rotation signal. The communication unit <NUM> in the bicycle <NUM> may transmit the generated rotation signal to the image display device <NUM>.

The controller <NUM> in the image display device <NUM> may output recommended application information driven by using the bicycle <NUM> on the basis of the rotation signal transmitted from the bicycle <NUM> to the image display device <NUM>.

The recommended application driven by using the bicycle <NUM> may include all applications using the bicycle <NUM>. One example of the application using the bicycle <NUM> may include, but not limited to, an exercise application requiring a motion that the user rotates the pedals of the bicycle <NUM>.

As illustrated in <FIG>, the interworking device <NUM> may include body information sensing devices <NUM>, <NUM>, and <NUM>. The body information sensing devices may include the blood pressure monitor <NUM> (<FIG>), the weighing scale <NUM> (<FIG>), the thermometer <NUM> (Fig. 12c), and a body fat scale (not shown). The body information sensing devices <NUM>, <NUM>, and <NUM> may sense health information on the user and generate a body information signal.

Each of the body information sensing devices <NUM>, <NUM>, and <NUM> may transmit the sensed body information signal to the image display device <NUM> and the controller <NUM> of the image display device <NUM> may output information on a health information application for outputting body information on the basis of the received body information signal.

As illustrated in <FIG>, other examples of the interworking device <NUM> include exercise information sensing devices <NUM> and <NUM>.

The exercise information sensing devices <NUM> and <NUM> may include the pedometer <NUM> (<FIG>), the wearable watch and the life-band <NUM> (<FIG>). The exercise information sensing device may sense exercise information on the user through an exercise information sensing unit (not shown).

Each of the exercise information sensing devices <NUM> and <NUM> may transmit the sensed exercise information to the image display device <NUM> and the controller <NUM> of the image display device <NUM> may output an exercise information application for outputting performed exercise amount information or necessary exercise amount information on the basis of the transmitted exercise information, and at least one piece of exercise application information for fulfilling a necessary exercise amount on the basis of the necessary exercise amount.

As illustrated in <FIG>, the camera <NUM> connected to the image display device <NUM> may capture a gesture and transmit the captured gesture to the controller <NUM> of the image display device <NUM>.

The gesture may include, but not limited to, an arm motion, a hand motion, a leg motion, a finger motion, and a face change.

The controller <NUM> recognizes the captured gesture and determines whether the capture gesture is included in pre-set events. As the determined result, when the gesture is included in the preset event, the controller <NUM> may output recommended application information corresponding to the capture gesture on the basis of the capture gesture. The correspondence between the gesture and the recommended application may be set by the user, but is not limited hereto.

As an example of the correspondence between the gesture and the application, the walking gesture may correspond to an application that a walking motion is necessary among the exercise application.

As another example of the correspondence between the gesture and the application, a golf swing gesture may correspond to a gold exercise application or a golf game application.

<FIG> illustrates, as an example of an event, a view that a LIVE TV program starts to be received in an image display device <NUM>.

As illustrated in <FIG>, the image display device <NUM> may receive the LIVE TV program through the tuner <NUM> and the demodulation unit <NUM>. The controller <NUM> of the image display device <NUM> may output the received LIVE TV program to the display unit <NUM> and, at the same time, output recommended application information on the basis of information on the received TV program.

The above-described operation of the controller <NUM> performed during receiving the LIVE TV program may be applied to a start to receive a reserved or preferred program.

<FIG> illustrates, as an example of an event, a view that a mid-program ad signal starts to be received and output on the display unit during receiving the LIVE TV signal in the image display device <NUM>.

As illustrated in <FIG>, the image display device <NUM> may receive mid-program ads in the middle of receiving the TV program through the tuner <NUM> and the demodulation unit <NUM>. The controller <NUM> may output the received mid-program ads on the display unit <NUM> and, at the same time, obtain information on the received mid-program ads as an event.

The information on the mid-program ads may include duration of the mid-program ads. Furthermore, the information on the mid-program ads may include, but not limited to, all types of information which may be a basis for recommending, to the user, an exercise application.

When the mid-program ads are obtained as an event, the controller <NUM> may recommend an exercise application performable by the user during the mid-program ads being output. Regarding this will be described in detail later.

<FIG> illustrates, as an example of an event, a view of a start to receive a TV program again when the mid-program-ads are completed during receiving the mid-program ads in the image display device <NUM>.

As shown in <FIG>, the image display device <NUM> may receive a TV program in the middle of receiving the mid-program ads through the tuner <NUM> and the demodulation unit <NUM>. The controller <NUM> may output the received TV program on the display unit <NUM> and, at the same time, obtain, as an event, the information on the received TV program and information on the mid-program ads received before receiving the TV program.

<FIG> illustrates, as an example of an event, a view at a predetermined time before a start time of a reserved or preferred program arrives during executing an application in the image display device <NUM>.

As shown in <FIG>, the controller <NUM> may obtain all information on the reserved or preferred program and information on an application being executed. The information on the reserved or preferred program may include information that the reserved or preferred program starts after a predetermined time. The controller <NUM> may obtain, as an event, information that the reserved or preferred program starts after the predetermined time.

The controller <NUM> may recommend a related application on the basis of information on the application being executed or the information on the reserved or preferred program. Description regarding this will be described in detail later.

<FIG> is an example of an event, and illustrates a view at a predetermined time before a start time of the reserved or preferred program arrives in a LIVE TV mode in the image display device.

As shown in <FIG>, the controller <NUM> may obtain all information on the reserved or preferred program and information on a TV program being received. The information on the reserved or preferred program may include information that the reserved or preferred program starts after the predetermined time. The controller <NUM> may obtain, as an event, information that the reserved or preferred program starts after the predetermined time.

Information on the reserved or preferred program may include a kind of the reserved or preferred program, a remaining time to the start time of the reserved or preferred program, or information on the kind of the reserved or preferred program and information on the remaining time to the start time of the reserved or preferred program. The controller <NUM> may recommend, to the user, a necessary exercise application on the basis of information on the at least one reserved or preferred program.

In addition, the controller <NUM> may recommend, to the user, a necessary exercise application further on the basis of user information as well as the information on the reserved or preferred program and a TV program being received.

As an example, the controller <NUM> may recommend and display an application that the user may perform for a remaining time in order to fulfill a remaining exercise amount or burn remaining calories.

Hereinafter, referring to <FIG>, description is made about user's health information that is a basis of a recommended application.

An example of the user's health information may include user's body information or user's exercise information. The controller <NUM> may obtain the user's health information through, but not limited to, the health information sensing devices <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> or inputs obtained from the remote controller <NUM> or a separate device (not shown).

As an example of the user information, user's health information is mainly described in detail in the specification. The user information described herein may be used as having the same meaning as the user's body information. The exercise information described herein may be used as having the same meaning as exercise amount information, user's exercise information or user's exercise amount information.

When an event is obtained, the controller <NUM> may output recommended application information on the basis of any one or more of the event and the obtained user's health information.

<FIG> illustrates an exemplary first health information application representing user's health information including exercise information and body information as the user's health information.

As illustrated in <FIG>, the body information includes a height, a weight, a necessary amount of muscles, and a necessary amount of body fats <NUM>, and the health information includes daily calories burned <NUM>.

The controller <NUM> may obtain user's health information through the health information sensing devices <NUM>, <NUM>, <NUM>, <NUM>, and <NUM>, and display the obtained health information through a bar graph <NUM>, a histogram (not shown), or a circle graph (not shown).

The controller <NUM> may display the obtained body information and health information through a health information application, or obtain them through inputs in the health information application.

The controller <NUM> may display the remaining exercise amount to the user or recommend an exercise application <NUM> to the user on the basis of the obtained body information or exercise information.

As an example, the controller <NUM> may display the remaining exercise amount on the basis of the daily calories burned and recommend an exercise application for fulfilling the remaining exercise amount.

A method of outputting the exercise application information is the same as the method of outputting the recommended application information described in relation to <FIG>, and therefore detailed description regarding this is omitted.

<FIG> illustrates an exemplary application representing user's information including the exercise information and the body information as the user's health information according to an embodiment.

As shown in <FIG>, the controller <NUM> outputs the obtained health information in a bar graph type and a circle graph type.

The controller <NUM> may display a weight, a skeletal muscle mass, an amount of body fats, an obesity rate, fat distribution, and physical development for each body part. The controller <NUM> may display, to the user, a recommended calorie and recommended calories burned <NUM> on the basis of the obtained body information.

The controller <NUM> may display the obtained user's health information for each day.

<FIG> is an exemplary application representing user's health information on a plurality of users in the image display device <NUM>.

As illustrated in <FIG>, the controller <NUM> may output the obtained health information on the plurality of users <NUM> and display a ranking according to exercise achievement among the plurality of users. The controller <NUM> may display performances of the plurality of users for each kind of exercise in a circle graph.

Hereinafter, referring to <FIG>, a method of recommending an application is described on the basis of an operation of the interworking device <NUM>.

<FIG> illustrates an exemplary view that an application requiring a mat related operation is recommended on the basis of a mat <NUM>.

As illustrated <FIG>, when a mat sensing signal sensed through the mat <NUM> is obtained, the controller <NUM> recommends a first exercise application requiring an operation using the mat <NUM>.

The first exercise application using the mat <NUM> may include a yoga application.

<FIG> illustrates an exemplary view that an application requiring a stick related operation is recommended on the basis of a stick <NUM>.

As illustrated in <FIG>, when a stick sensing signal sensed through the stick <NUM> is obtained, a second exercise application is recommended which requires an operation using the stick <NUM>.

The second exercise application using the stick <NUM> may include a dumbbell exercise application.

<FIG> illustrates an exemplary view that a shoe related operation is recommended on the basis of the shoe <NUM>.

As shown in <FIG>, when a shoe sensing signal sensed through the shoe <NUM> is obtained, the controller <NUM> recommends an exercise application operated by using the shoe <NUM> or using pressure sensed through the shoe <NUM>.

The exercise application using the shoe <NUM> may include a walking exercise application or a running exercise application.

<FIG> illustrates an exemplary view that an application requiring a bicycle related operation is recommended on the basis of the bicycle <NUM>.

As illustrated in <FIG>, when a bicycle sensing signal sensed through the bicycle <NUM> is obtained, the controller <NUM> recommends a bicycle related application requiring an operation using the bicycle <NUM>.

The bicycle related application may include a bicycle exercise application or a bicycle race application.

<FIG> illustrates an exemplary view that an application related to each body information sensing device <NUM>, <NUM>, or <NUM> sensing user's body information is recommended.

As illustrated in <FIG>, when a body information signal is obtained through the body information sensing devices <NUM>, <NUM>, and <NUM> including the blood pressure monitor <NUM>, the weighing scale <NUM>, the thermometer <NUM>, or a body composition measuring module (not shown), the controller <NUM> recommends a body information application outputting the body information.

The body information application may include a disease diagnosing application or a body information display application.

<FIG> illustrates an exemplary view that an application related to each exercise information sensing device <NUM> or <NUM> sensing user's exercise information.

As illustrated in <FIG>, when an exercise information signal is obtained through the exercise information sensing devices <NUM> and <NUM> including the life-band <NUM>, the wearable watch (not shown), or the pedometer <NUM>, the controller <NUM> recommends an exercise information application outputting the exercise information.

The exercise information application may include an application displaying a performed exercise amount and a remaining exercise amount.

Besides operations illustrated in <FIG> and <FIG>, the controller <NUM> may recommend, but not limited to, one or more exercise applications necessary to the user on the basis of the obtained health information.

Hereinafter, referring to <FIG>, description is made about an operation method of the image display device <NUM> which outputs recommended application information as an event when a TV program starts to be received.

Description about the operation of outputting the recommended application at the time of a start to receive the TV program may also be applied to an operation method of outputting a recommended application at the time of start of a reserved or preferred program.

The controller <NUM> may obtain information on a TV program being received at the time when the TV program starts to be received, and output application information related to the TV program on the basis of the obtained TV program information.

<FIG> illustrates an operation of outputting application information related to sports program among TV program.

When the information on the sports program is obtained, the controller <NUM> may control so as to output a sport application related to the corresponding sports program.

For example, as illustrated in <FIG>, when a baseball broadcast program (sports program) is received, the controller <NUM> may output an exercise application (related sports application) requiring a motion performed in the baseball game.

An example of the exercise application related to a baseball game may include, but not limited to, a baseball game application.

<FIG> illustrates an exemplary view representing an operation of outputting application information related to a drama program among TV program.

The controller <NUM> may obtain information on the drama program and output application information related to a corresponding drama program.

For example, as illustrated in <FIG>, when information on the drama program is obtained, the controller <NUM> may output an internet application outputting internet search result or internet information including internet search content related to the drama information.

The controller <NUM> may display one or more pieces of the drama information on the display unit <NUM>. The drama information may include drama content, characters, synopsis, actors, directors, dramatists, audience evaluation, and viewer ratings.

For another example, when information on the drama program is obtained, the controller <NUM> may output the most frequently executed application among applications executed by the remote controller <NUM> or the external device (not shown) during receiving the corresponding drama program.

<FIG> illustrates an exemplary view representing an operation of outputting application information related to a news program among TV program.

When information on the news program, the controller <NUM> may output application information related to the corresponding news program.

As an example, as shown in <FIG>, when information on a news program is obtained, the controller <NUM> may output a web site including news contents of the corresponding news program through an internet application.

As another example, as shown in <FIG>, when information on a news program is obtained, the controller <NUM> may output search results of news contents of the corresponding news program.

Hereinafter, referring to <FIG>, description is made about a method of outputting recommended application information as an event at the time of a start to receive mid-program ads according to an example, which does not form part of the present invention but contains information useful for understanding the present invention.

<FIG> illustrates an operation of the image display device <NUM> obtaining a start of mid-program ads as an event and outputting recommended application information.

As illustrated in <FIG>, when the start of mid-program ads is obtained as an event during executing a LIVE TV mode, the controller <NUM> may calculate a completion time of the mid-program ads, and output an exercise application executable from a time of the calculation to the calculated completion time of the mid-program ads.

In outputting the exercise application executable between corresponding times, the controller <NUM> may output the application further on the basis of user's health information.

Hereinafter, referring to <FIG>, description is made about a method of outputting recommended application information when pluralities of events are obtained.

<FIG> illustrates an operation method of the image display device <NUM> when sensing the interworking device <NUM> is obtained as an event during displaying the LIVE TV mode.

When the sensing of the interworking device <NUM> is obtained as the event during receiving a TV program in the LIVE TV mode, the controller <NUM> outputs recommended application information on the basis of both of the interworking device <NUM> and information on the TV program being received.

The controller <NUM> collects one or more reference applications related to the sensed interworking device <NUM> and outputs recommended application information related to the TV program being received among the collected one or more reference applications.

For example, as illustrated in <FIG>, when the stick <NUM> (interworking device) is sensed during receiving a baseball broadcast program, the controller <NUM> may collect a dumbbell exercise application, a cheerleading exercise application, and a baseball game application (one or more collected reference applications related to the stick), and then output the cheerleading exercise application (recommended application) related to the baseball broadcast program (TV program being received).

<FIG> illustrates an operation method when sensing the interworking device <NUM> is obtained as an event during receiving mid-program ads.

When the sensing of the interworking device <NUM> is obtained as an event during receiving the mid-program ads, the controller <NUM> outputs recommended application information on the basis of the interworking device <NUM> and a completion time of the mid-program ads.

When the interworking device <NUM> is sensed and the completion time of the mid-program ads is calculated as a first time later, the controller <NUM> outputs an exercise application executable for the first time among applications related to the interworking device <NUM>.

For example, as illustrated in <FIG>, when the mat <NUM> (interworking device) is sensed at <NUM> minutes (the first time) before the completion time of mid-program ads, the controller <NUM> may output an exercise application executable for <NUM> minutes (the first time) among applications related to the mat <NUM> (interworking device).

When the interworking device <NUM> is sensed during receiving the mid-program ads, the controller <NUM> may output a related application on the basis of the interworking device <NUM> and a completion time of the mid-program ads, and further on the basis of the user's health information.

For example, when the mat <NUM> is sensed at <NUM> minutes (the first time) before the completion time of the mid-program ads, the controller <NUM> may output an exercise application that is related to the mat <NUM>, executable for <NUM> minutes (the first time), and able to fulfill a remaining exercise amount (user's health information) of the user.

<FIG> illustrates a case where the interworking device <NUM> is sensed before a predetermined time from a start time of a reserved or preferred program.

When the interworking device <NUM> is sensed before a second time from the start time of the reserved or preferred program, the controller <NUM> may recommend an application on the basis of the interworking device <NUM> and the second time remained to the start of the reserved or preferred program.

When the start time of the reserved or preferred program is calculated after the second time at the time of sensing the interworking device <NUM>, the controller <NUM> may output an exercise application executable for the second time among applications related to the interworking device <NUM>.

For example, as illustrated in <FIG>, when the stick <NUM> (the interworking device) is sensed before <NUM> minutes (the second time) from the start time of the reserved or preferred time, the controller <NUM> may output an exercise application executable for <NUM> minutes (the second time) among exercise applications related to the stick <NUM>.

When the interworking device <NUM> is sensed before the second time from the reserved or preferred program, the controller <NUM> may output a related application on the basis of interworking device <NUM> and the start time of the reserved or preferred program, and further on the basis of the user's health information.

For example, as shown in <FIG>, when the stick is sensed before <NUM> minutes (the second time) from the start time of the reserved or preferred program, the controller <NUM> may output an exerciser application for fulfilling a remained exercise amount on the basis of the exercise information on the user among one or more exercise applications that are related to the stick <NUM> and are executable for <NUM> minutes (the second time).

<FIG> illustrates an operation method in a case where a LIVE TV mode starts and a TV program is received at a completion time of mid-program ads during executing an application in mid-program ad time.

When the LIVE TV mode starts and a first TV program is received at the completion time of the mid-program ads in the middle of executing a reference application during receiving the mid-program ads, the controller <NUM> may output a first application related to the reference application executed during receiving the mid-program ads among a plurality of applications related to the first TV program.

For example, as illustrated in <FIG>, the controller <NUM> may output a cheerleading application (the first application) related to the reference application (the yoga exercise application) executed in the mid-program time between the cheerleading exercise application and a baseball game application (a plurality of applications related to the TV program) related to a sports program (the first TV program).

In addition, the controller <NUM> may display a popup menu, display a list of one or more recommended applications, obtain one selection among names of the one or more recommended applications, and output a selected third application.

<FIG> illustrates a case where a predetermined time arrives before the start time of the reserved or preferred program during executing an application.

When the reserved or preferred program is sensed to start after a preset first time during executing a first application, the controller <NUM> may output a second application on the basis of the first application and the first time.

For example, as illustrated in <FIG>, when a reserved program is sensed to start after <NUM> minutes (a first time) during executing a yoga application (the first application), the controller <NUM> may output an application (the second application) that is related to the yoga application (the first application) and executable for <NUM> minutes (the first time).

In addition, when a reserved or preferred program is sensed to start after the preset first time during executing the first application, the controller <NUM> may output the second application on the basis of the first application, information on the reserved or preferred program, and the first time.

In addition, the controller <NUM> may display at least one second application, obtains a selection on one third application among the second applications, and then output the selected third application.

<FIG> illustrates a case where a second TV program, which is a reserved or preferred program, starts during executing a first TV program in a LIVE TV mode.

The controller <NUM> may obtains a selection on one of the first and second TV programs and output an exercise application related to the selected program.

For example, as illustrated in <FIG>, when a reserved program (the second TV program) starts during executing a baseball program (the first TV program), the controller <NUM> may obtain an user's selection between the baseball program and the reserved program through the popup window <NUM> and output an exercise application related to the selected program.

In outputting the recommended application at the time of obtaining the plurality of events, the controller <NUM> may also output the recommended application further on the basis of, but not limited to, user's health information.

Hereinafter, referring to <FIG>, description is made about an operation method of the image display device <NUM> outputting recommended application information or recommending an application.

<FIG> illustrates an exemplary screen that shows an operation of displaying animation of an application to be recommended and executes a recommended application at the time of selecting animation.

The controller <NUM> outputs one or more animations <NUM> of one or more applications related to an event or user's health information.

For example, as illustrated <FIG>, the controller <NUM> may output an avatar <NUM> (animation) doing yoga gestures related to the yoga application (the first application) in relation to the sensed mat <NUM> (event) to the display unit <NUM> in the image display device <NUM>.

When a selection of the first animation is obtained among the one or more animations <NUM>, the controller <NUM> may execute the first application corresponding to the selected first animation and output an execution screen of the first application.

For example, as illustrated in <FIG>, the controller <NUM> may execute the yoga application (the first application) corresponding to the selected avatar doing yoga gestures and output an execution screen of the yoga application on the display unit <NUM>.

<FIG> illustrates an exemplary view representing an operation of the image display device <NUM> displaying a name list of recommended applications and outputting an application corresponding to a selected name as a method of outputting recommended application information.

As illustrated in <FIG>, the controller <NUM> displays a name list <NUM> of one or more applications on the basis of events or user information. When a selection of a name of one first application is obtained among the one or more application names, the controller <NUM> may execute the first application corresponding to the selected first application name and output an execution screen of the first application on the display unit <NUM>.

<FIG> are exemplary views representing operations of the image display device <NUM> displaying an icon list of recommended applications as a method of outputting recommended application information.

As illustrated in <FIG>, the controller <NUM> arranges and displays one or more recommended application icons related to the event (the mat <NUM> or the stick <NUM>) in the list <NUM> of the one or more application icons on a top portion <NUM> of the icon list <NUM>.

In addition, the controller <NUM> may arrange and display recommended application icons having higher priorities among the one or more recommended application icons in order from the leftmost sides <NUM>, <NUM>, and <NUM> of the top portion <NUM>.

For example, as illustrated in <FIG>, the controller <NUM> may preferentially arrange and display exercise application icons for fulfilling a remained exercise amount based on the user information among the one or more recommended application icons in order from the leftmost sides <NUM>, <NUM>, and <NUM> of the top portion <NUM>.

The controller <NUM> may visually differentiate one or more recommended application icons related to an event (the mat <NUM> or the stick <NUM>) from other icons among the one or more application icons, and display them.

For example, as illustrated in <FIG>, the controller <NUM> may light-emitting-display <NUM> surrounding areas of the recommended application icons.

For another example, as illustrated in <FIG>, the controller may enlarge and display <NUM> the recommended application icons in a certain magnification or more (e.g., <NUM> times)
For another example, as illustrated in <FIG>, the controller <NUM> may display <NUM> only the recommended application icons and may not display or may shade, with the same color as that of the background, other icons on the icon list.

<FIG> illustrate a case of displaying an execution screen of the recommended application as another example of outputting the recommended application information.

As an example of displaying the execution screen, as illustrated in <FIG>, the controller <NUM> may execute a recommended application and display an execution screen of the recommended application in full screen <NUM>.

As another example of display the execution screen, as illustrated in <FIG>, the controller <NUM> may execute one or more recommended applications, and display respective execution screens of the recommended applications on a first divided screen <NUM> and a second divided screen <NUM> into which an entire screen is divided by the number of the recommended applications.

As another example of displaying the execution screen, as illustrated in <FIG>, the controller <NUM> may execute a recommended application, and partially display an execution screen of the executed application in a thumbnail image <NUM> in the entire screen.

As another example of displaying the execution screen, as illustrated in <FIG>, the controller <NUM> may execute one or more recommended applications, and display respective execution screens of the executed recommended applications in, but not limited to, first to third thumbnail images <NUM>, <NUM>, and <NUM>.

According to an embodiment, the above-described method can also be embodied as computer readable codes on a computer readable recording medium. The computer readable recording medium is any data storage device that can store data which can be thereafter read by a computer system. Examples of the computer readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices, and also include implementation in a carrier wave (such as data transmission through the Internet) type.

Claim 1:
An image display device (<NUM>) comprising:
a display unit (<NUM>);
a network interface unit (<NUM>) configured to provide an interface for connecting the image display device to a wired/wireless network, and further configured to receive content or data provided by a content provider or network operator, wherein the content or data is at least one of movie, advertisement, game, VOD, broadcast signal and information related thereto; and
a controller (<NUM>) configured to control the display unit (<NUM>) to display an image,
wherein the controller (<NUM>) is further configured to:
detect occurrence of an event, the event being a start of a mid-program advertisement;
output the received mid-program advertisement on the display unit (<NUM>);
calculate a completion time of the mid-program advertisement;
identify a recommended application from among a plurality of applications executable at the image display device based on the event; and
output, on the display unit (<NUM>), application information of the recommended application until the completion time of the mid-program advertisement, wherein the application information includes one of a name, an icon and an execution screen of the recommended application,
wherein the recommended application output by the controller (<NUM>) is an exercise application executable for a length of the completion time of the mid-program advertisement,
wherein the controller (<NUM>) is further configured to communicate with an interworking device (<NUM>) during receiving the mid-program advertisement, wherein the interworking device (<NUM>) is configured to sense movement of the interworking device,
wherein when sensing the interworking device (<NUM>), the controller (<NUM>) is further configured to output the recommended application information on the basis of the interworking device (<NUM>) and the completion time of the mid-program advertisement.