Display device and operation method therefor

An operation method for a display device is disclosed. An operation method for a display device according to an embodiment of the present invention comprises the steps of: displaying a pointer on a screen; receiving information on a movement of a remote control device; acquiring the coordinates of the pointer moving in response to a movement of the remote control device, on the basis of the information on a movement of the remote control device; when, on the basis of the acquired coordinates of the pointer, the pointer moves from an area in the screen to an area outside the screen, changing an input, which is provided to the display device, to an external input; and displaying an image using the external input.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is the National Phase of PCT International Application No. PCT/KR2016/002943, filed on Mar. 23, 2016, which claims priority under 35 U.S.C. 119(a) to Patent Application No. 10-2015-0149777, filed in Republic of Korea on Oct. 27, 2015, all of which are hereby expressly incorporated by reference into the present application.

TECHNICAL FIELD

The present invention relates to a display device and a method of operating the same and, more particularly, to a display device for switching to external input when coordinates of a pointer changed according to motion of a remote control device deviate from an area of a screen, and a method of operating the same.

BACKGROUND ART

Recently, a digital TV service using a wired or wireless communication network has come into wide use. The digital TV service may provide various services which cannot be provided by an existing analog broadcast service.

For example, an Internet protocol television (IPTV) service which is a digital TV service provides interactivity for enabling a user to actively select a type of a program to be viewed, a viewing time, etc. The IPTV service may provide various additional services, e.g., Internet search, home shopping, online games, etc. based on such interactivity.

Recently, there has been an increasing number of cases in which a TV is connected to a plurality of external devices to receive and display content from an external device connected to the TV or to display a screen of an external device.

Conventionally, when user input of switching to external input is received, a plurality of interfaces is displayed and, when a user selects a specific interface, switching to external input is realized by switching input to a connected external device through the interface selected by the user.

However, in recent trends in which various external devices may be connected to a TV, a user may not intuitively determine to which external device input is switched.

In addition, since the user has to switch a screen to a screen for displaying a plurality of external inputs through user operation and to perform user operation once again to select one of the plurality of external inputs, user's TV viewing may be disturbed and the user operation needs to be performed several times, for switching to external input.

In addition, in order to control an external device for providing external input upon switching to external input, operation may be performed through an input unit installed in the external device, using a remote controller capable of controlling the external device or using an integrated remote controller capable of controlling the external device as well as the TV.

DISCLOSURE

Technical Problem

An object of the present invention devised to solve the problem lies in a display device for switching to external input when coordinates of a pointer changed according to motion of a remote control device deviate from an area of a screen, and a method of operating the same.

An object of the present invention devised to solve the problem lies in a display device for switching to external input when coordinates of a pointer changed according to motion of a remote control device deviate from an area of a screen and controlling an external device for providing external input, and a method of operating the same.

Technical Solution

A method of operating a display device according to an embodiment of the present invention includes displaying a pointer on a screen, receiving information on motion of a remote control device, acquiring coordinates of the pointer moved in correspondence with the motion of the remote control device based on the information on the motion of the remote control device, switching input provided to the display device to external input when the pointer is moved from an area of the screen to an area outside the screen, based on the acquired coordinates of the pointer, and displaying an image using the external input.

A display device according to an embodiment of the present invention includes a display unit configured to display an image, a user input interface unit configured to receive information on motion of a remote control device, an external input interface unit configured to receive input provided to the display device, and a control unit configured to display a pointer on a screen, to acquire coordinates of the pointer moved in correspondence with the motion of the remote control device based on the information on the motion of the remote control device, to switch input provided to the display device to external input when the pointer is moved from an area of the screen to an area outside the screen, based on the acquired coordinates of the pointer and to display an image using the external input.

BEST MODE

Hereinafter, embodiments relating to the present invention will be described in detail with reference to the accompanying drawings. The suffixes “module” and “unit” for components used in the description below are assigned or mixed in consideration of easiness in writing the specification and do not have distinctive meanings or roles by themselves.

A display device according to an embodiment of the present invention, for example, as an artificial display device that adds a computer supporting function to a broadcast receiving function, can have an easy-to-use interface such as a writing input device, a touch screen, or a spatial remote controller as an internet function is added while fulfilling the broadcast receiving function. Then, with the support of a wired or wireless internet function, it is possible to perform an e-mail, web browsing, banking, or game function in access to internet and computers. In order for such various functions, standardized general purpose OS can be used.

Accordingly, since various applications are freely added or deleted on a general purpose OS kernel, a display device described in this present invention, for example, can perform various user-friendly functions. The display device, in more detail, can be network TV, HBBTV, smart TV, LED TV, OLED TV, and so on and in some cases, can be applied to a smartphone.

FIG. 1is a block diagram illustrating a configuration of a display device according to an embodiment of the present invention.

Referring toFIG. 1, the display device100may include a broadcast reception unit130, an external device interface unit135, a storage unit140, a user input interface unit150, a control unit170, a display unit180, an audio output unit185, a power supply unit190and a communication unit195.

The broadcast reception unit130can include a tuner131, a demodulation unit132, and a network interface unit133.

The tuner131can select a specific broadcast channel according to a channel selection command. The tuner131can receive broadcast signals for the selected specific broadcast channel.

The demodulation unit132can divide the received broadcast signals into video signals, audio signals, and broadcast program related data signals and restore the divided video signals, audio signals, and data signals to an output available form.

The external device interface unit135can receive an application or an application list in an adjacent external device and deliver it to the control unit170or the storage unit140.

The external device interface135can provide a connection path between the display device100and an external device. The external device interface135can receive at least one of image and audio output from an external device that is wirelessly or wiredly connected to the display device100and deliver it to the control unit.

The network interface unit133can provide an interface for connecting the display device100to a wired/wireless network including internet network. The network interface unit133can transmit or receive data to or from another user or another electronic device through an accessed network or another network linked to the accessed network.

Additionally, some content data stored in the display device100can be transmitted to a user or an electronic device, which is selected from other users or other electronic devices pre-registered in the display device100.

The network interface unit133can access a predetermined webpage through an accessed network or another network linked to the accessed network. That is, it can transmit or receive data to or from a corresponding server by accessing a predetermined webpage through network.

Then, the network interface unit133can receive contents or data provided from a content provider or a network operator. That is, the network interface unit133can receive contents such as movies, advertisements, games, VODs, and broadcast signals, which are provided from a content provider or a network provider, through network and information relating thereto.

Additionally, the network interface unit133can receive firmware update information and update files provided from a network operator and transmit data to an internet or content provider or a network operator.

The network interface unit133can select and receive a desired application among applications open to the air, through network.

The storage unit140can store signal-processed image, voice, or data signals stored by a program in order for each signal processing and control in the control unit170.

Additionally, the storage unit140can perform a function for temporarily store image, voice, or data signals output from the external device interface unit135or the network interface unit133and can store information on a predetermined image through a channel memory function.

The storage unit140can store an application or an application list inputted from the external device interface unit135or the network interface unit133.

The display device100can play content files (for example, video files, still image files, music files, document files, application files, and so on) stored in the storage unit140and provide them to a user.

The user input interface unit150can deliver signals inputted from a user to the control unit170or deliver signals from the control unit170to a user. For example, the user input interface unit150can receive or process control signals such as power on/off, channel selection, and screen setting from the remote control device200or transmit control signals from the control unit170to the remote control device200according to various communication methods such as Bluetooth, Ultra Wideband (WB), ZigBee, Radio Frequency (RF), and IR.

Additionally, the user input interface unit150can deliver, to the control unit170, control signals inputted from local keys (not shown) such as a power key, a channel key, a volume key, and a setting key.

Image signals that are image-processed in the control unit170can be inputted to the display unit180and displayed as an image corresponding to corresponding image signals. Additionally, image signals that are image-processed in the control unit170can be inputted to an external output device through the external device interface unit135.

Voice signals processed in the control unit170can be output to the audio output unit185. Additionally, voice signals processed in the control unit170can be inputted to an external output device through the external device interface unit135.

Besides that, the control module170can control overall operations in the display device100.

Additionally, the control unit170can control the display device100by a user command or internal program inputted through the user input interface unit150and download a desired application or application list into the display device100in access to network.

The control unit170can output channel information selected by a user together with processed image or voice signals through the display unit180or the audio output unit185.

Additionally, according to an external device image playback command received through the user input interface unit150, the control unit170can output image signals or voice signals of an external device such as a camera or a camcorder, which are inputted through the external device interface unit135, through the display unit180or the audio output unit185.

Moreover, the control unit170can control the display unit180to display images and control broadcast images inputted through the tuner131, external input images inputted through the external device interface unit135, images inputted through the network interface unit, or images stored in the storage unit140to be displayed on the display unit180. In this case, an image displayed on the display unit180can be a still image or video and also can be a 2D image or a 3D image.

Additionally, the control unit170can play content stored in the display device100, received broadcast content, and external input content inputted from the outside, and the content can be in various formats such as broadcast images, external input images, audio files, still images, accessed web screens, and document files.

The display unit180can convert image signals, data signals, or OSD signals, which are processed in the control unit170, or images signals or data signals, which are received in the external device interface unit135, into R, G, and B signals to generate driving signals.

The communication unit195can exchange information with another display device through wired or wireless communication. The communication unit195can include a short-range communication module. The short-range communication module may support short-range communication using at least one of Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies.

The communication unit195may be included in the control unit170.

Furthermore, the display device100shown inFIG. 1is just one embodiment of the present invention and thus, some of the components shown can be integrated, added, or omitted according to the specification of the actually implemented display device100.

That is, if necessary, two or more components can be integrated into one component or one component can be divided into two or more components and configured. Additionally, a function performed by each block is to describe an embodiment of the present invention and its specific operation or device does not limit the scope of the present invention.

According to another embodiment of the present invention, unlikeFIG. 1, the display device100can receive images through the network interface unit133or the external device interface unit135and play them without including the tuner131and the demodulation unit132.

For example, the display device100can be divided into an image processing device such as a set-top box for receiving broadcast signals or contents according to various network services and a content playback device for playing contents inputted from the image processing device.

In this case, an operating method of a display device according to an embodiment of the present invention described below can be performed by one of the display device described with reference toFIG. 1, an image processing device such as the separated set-top box, and a content playback device including the display unit180and the audio output unit185.

The display device100may include an external input interface unit (not shown) for performing the functions of the external device interface unit135and the communication unit173. That is, the display device100may communicate with an external device connected through the external input interface unit (not shown) or wirelessly communicate with an external device through the external input interface unit (not shown).

Then, referring toFIGS. 2 and 3, a remote control device is described according to an embodiment of the present invention.

FIG. 2is a block diagram illustrating a remote control device according to an embodiment of the present invention andFIG. 3is a view illustrating an actual configuration of a remote control device according to an embodiment of the present invention.

First, referring toFIG. 2, a remote control device200can include a fingerprint recognition unit210, a wireless communication unit220, a user input unit230, a sensor unit240, an output unit250, a power supply unit260, a storage unit270, a control unit280, and a voice acquisition unit290.

Referring toFIG. 2, the wireless communication unit225transmits/receives signals to/from an arbitrary any one of display devices according to the above-mentioned embodiments of the present invention.

The remote control device200can include an RF module221for transmitting/receiving signals to/from the display device100according to the RF communication standards and an IR module223for transmitting/receiving signals to/from the display device100according to the IR communication standards. Additionally, the remote control device200can include a Bluetooth module225for transmitting/receiving signals to/from the display device100according to the Bluetooth communication standards. Additionally, the remote control device200can include an NFC module227for transmitting/receiving signals to/from the display device100according to the Near Field Communication (NFC) communication standards and a WLAN module229for transmitting/receiving signals to/from the display device100according to the Wireless LAN (WLAN) communication standards

Additionally, the remote control device200can transmit signals containing information on a movement of the remote control device200to the display device100through the wireless communication unit220.

Moreover, the remote control device200can receive signals transmitted from the display device100through the RF module221and if necessary, can transmit a command on power on/off, channel change, and volume change to the display device100through the IR module223.

The user input unit230can be configured with a keypad button, a touch pad, or a touch screen. A user can manipulate the user input unit230to input a command relating to the display device100to the remote control device200. If the user input unit230includes a hard key button, a user can input a command relating to the display device100to the remote control device200through the push operation of the hard key button. This will be described with reference toFIG. 3.

Referring toFIG. 3, the remote control device200can include a plurality of buttons. The plurality of buttons can include a fingerprint recognition button212, a power button231, a home button232, a live button233, an external input button234, a voice adjustment button235, a voice recognition button236, a channel change button237, a check button238, and a back button239.

The fingerprint recognition button212can be a button for recognizing a user's fingerprint. According to an embodiment of the present invention, the fingerprint recognition button212can perform a push operation and receive a push operation and a fingerprint recognition operation. The power button231can be button for turning on/off the power of the display device100. The power button232can be button for moving to the home screen of the display device100. The live button233can be a button for displaying live broadcast programs. The external input button234can be button for receiving an external input connected to the display device100. The voice adjustment button235can be button for adjusting the size of a volume output from the display device100. The voice recognition button236can be a button for receiving user's voice and recognizing the received voice. The channel change button237can be a button for receiving broadcast signals of a specific broadcast channel. The check button238can be a button for selecting a specific function and the back button239can be a button for returning to a previous screen.

If the user input unit230includes a touch screen, a user can touch a soft key of the touch screen to input a command relating to the display device100to the remote control device200. Additionally, the user input unit230can include various kinds of input means manipulated by a user, for example, a scroll key and a jog key, and this embodiment does not limit the scope of the present invention.

The sensor unit240can include a gyro sensor241or an acceleration sensor243and the gyro sensor241can sense information on a movement of the remote control device200.

For example, the gyro sensor241can sense information on an operation of the remote control device200on the basis of x, y, and z axes and the acceleration sensor243can sense information on a movement speed of the remote control device200. Moreover, the remote control device200can further include a distance measurement sensor and sense a distance with respect to the display unit180of the display device100.

The output unit250can output image or voice signals corresponding to a manipulation of the user input unit235or corresponding to signals transmitted from the display device100. A user can recognize whether the user input unit235is manipulated or the display device100is controlled through the output unit250.

For example, the output unit250can include an LED module251for flashing, a vibration module253for generating vibration, a sound output module255for outputting sound, or a display module257for outputting an image, if the user input unit235is manipulated or signals are transmitted/received to/from the display device100through the wireless communication unit225.

Additionally, the power supply unit260supplies power to the remote control device200and if the remote control device200does not move for a predetermined time, stops the power supply, so that power waste can be reduced. The power supply unit260can resume the power supply if a predetermined key provided at the remote control device200is manipulated.

The storage unit270can store various kinds of programs and application data necessary for a control or operation of the remote control device200. If the remote control device200transmits/receives signals wirelessly through the display device100and the RF module221, the remote control device200and the display device100transmits/receives signals through a predetermined frequency band.

The control unit280of the remote control device200can store, in the storage unit270, information on a frequency band for transmitting/receiving signals to/from the display device100paired with the remote control device200and refer to it.

The control unit280controls general matters relating to a control of the remote control device200. The control unit280can transmit a signal corresponding to a predetermined key manipulation of the user input unit235or a signal corresponding to a movement of the remote control device200sensed by the sensor unit240to the display device100through the wireless communication unit225.

Additionally, the voice acquisition unit290of the remote control device200can obtain voice.

The voice acquisition unit290can include at least one microphone291and obtain voice through the microphone291.

FIG. 4is a view of utilizing a remote control device according to an embodiment of the present invention.

FIG. 4Aillustrates that a pointer205corresponding to the remote control device200is displayed on the display unit180.

A user can move or rotate the remote control device200vertically or horizontally. The pointer205displayed on the display unit180of the display device100corresponds to a movement of the remote control device200. Since the corresponding pointer205is moved and displayed according to a movement on a 3D space as show in the drawing, the remote control device200can be referred to as a spatial remote controller.

FIG. 4Billustrates that if a user moves the remote control device200, the pointer205displayed on the display unit180of the display device100is moved to the left in correspondence thereto.

Information on a movement of the remote control device200detected through a sensor of the remote control device200is transmitted to the display device100. The display device100can calculate the coordinates of the pointer205from the information on the movement of the remote control device200. The display device100can display the pointer205to match the calculated coordinates.

FIG. 4Cillustrates that while a specific button in the remote control device200is pressed, a user moves the remote control device200away from the display unit180. Thus, a selection area in the display unit180corresponding to the pointer205can be zoomed in and displayed largely.

On the other hand, if a user moves the remote control device200close to the display unit180, a selection area in the display unit180corresponding to the pointer205can be zoomed out and displayed reduced.

On the other hand, if the remote control device200is away from the display unit180, a selection area can be zoomed out and if the remote control device200is close to the display unit180, a selection area can be zoomed in.

Additionally, if a specific button in the remote control device200is pressed, the recognition of a vertical or horizontal movement can be excluded. That is, if the remote control device200is moved away from or close to the display unit180, the up, down, left, or right movement cannot be recognized and only the back and forth movement can be recognized. While a specific button in the remote control device200is not pressed, only the pointer205is moved according to the up, down, left or right movement of the remote control device200.

Moreover, the moving speed or moving direction of the pointer205can correspond to the moving speed or moving direction of the remote control device200.

Furthermore, a pointer in this specification means an object displayed on the display unit180in correspondence to an operation of the remote control device200. Accordingly, besides an arrow form displayed as the pointer205in the drawing, various forms of objects are possible. For example, the above concept includes a point, a cursor, a prompt, and a thick outline. Then, the pointer205can be displayed in correspondence to one point of a horizontal axis and a vertical axis on the display unit180and also can be displayed in correspondence to a plurality of points such as a line and a surface.

Next, a display system according to an embodiment of the present invention will be described with reference toFIG. 5.

FIG. 5is a view illustrating a display system including a display device and an external device according to an embodiment of the present invention.

The display device100may be connected to a plurality of external devices510,520,530,540,550,560and570through the external device interface unit135. To this end, the external device interface unit may include various input ports such as HDMI, USB, Composite, Component, optical, RF, RS232, etc.

In addition, the display device100may communicate with the plurality of external devices510,520,530,540,550,560and570through the communication unit195.

Although the plurality of external devices510,520,530,540,550,560and570are described as being a USB510, a PC520, an external hard drive530, a Blu-ray player540, a set-top box550, a digital camera560and a laptop570inFIG. 5, the present invention is not limited thereto and the plurality of external devices may include all devices connected to the display device100to provide external input to the display device100, such as a game console, a camcorder, a smartphone, a tablet PC, an MP3 player, an audio player, a DVD player and a video player.

The display device100may receive and display external input from the plurality of external devices510,520,530,540,550,560and570through the external device interface unit135or the communication unit195.

For example, if the display device100receives the external input from the PC520, the control unit170may control the display unit180to receive the image displayed on the PC from the PC520and to display the received image.

As another example, when the display device100receives external device from the USB510, the control unit170may control the display unit180or the audio output unit185to receive content stored in the USB510from the USB510and to output the received content.

As another example, when the display device100receives external input from the set-top box550, the control unit170may receive video or audio output from the set-top box550and output the received video through the display unit180or output the received audio through the audio output unit185.

Although the external input is described as being received from the plurality of external devices510,520,530,540,550,560and570communicating with the display device100inFIG. 5, the present invention is not limited thereto. Specifically, the “external input” described in the present specification may include not only those received from an external device directly connected to the display device100but also a broadcast input through the tuner131or content input through the network interface unit.

FIG. 6is a view illustrating a method of operating a display device according to an embodiment of the present invention.

InFIG. 6, the method of operating the display device according to the embodiment of the present invention may include step S610of detecting a plurality of external devices communicating with the display device, step S620of receiving user input of mapping at least one of an angle and a boundary corresponding to each of the plurality of external devices to each of the plurality of detected external devices, step S630of mapping and storing at least one of the angle and the boundary to each of the plurality of detected external devices based on the user input, step S640of displaying at least one of the angle and the boundary corresponding to each of the plurality of external devices, step S650of displaying a pointer on a screen, step S660of receiving information on motion of a remote control device, step S670of acquiring coordinates the pointer corresponding to motion of the remote control device based on the information on motion of the remote control device, and step S680of switching input provided to the display device to external input when the pointer deviates from an area corresponding to the screen based on the acquired coordinates of the pointer.

Prior to the description of step S610of detecting the plurality of external devices, a plurality of directions or a plurality of boundaries, to which the plurality of external device may be mapped, will be described.

FIGS. 7 to 8are views illustrating boundaries of a screen, to which external devices may be mapped, directions, to which external devices may be mapped, and boundaries and directions, to which external devices may be mapped.

FIG. 7is a view illustrating a plurality of boundaries of an area of a screen according to an embodiment of the present invention.

InFIG. 7a, a boundary between an area of a screen710of the screen and an area other than the area of the screen is denoted by a dotted line.

All boundaries between the area of the screen710and the area other than the area of the screen may include a plurality of boundaries711,712,713and714to which external device may be mapped.

Specifically, all boundaries between the area of the screen710and the area other than the area of the screen include the plurality of boundaries711,712,713and714obtained by dividing all boundaries between the area of the screen710and the area other than the area of the screen.

Here, the plurality of boundaries711,712,713and714, to which the external device may be mapped, may include four boundaries such as a boundary711of an “upper” direction in the area of the screen, a boundary712of a “right” direction in the area of the screen, a boundary713of a “lower” direction in the area of the screen and a boundary714of a left direction in the area of the screen in all boundaries of the area of the screen, as shown inFIG. 7a.

However, the present invention is not limited thereto. For example, as shown inFIG. 7b, a plurality of boundaries721,722,723,724,725,726,727,728,729and730, to which the plurality of external devices may be respectively mapped, may include a plurality of boundaries721,722and723of an “upper” direction in the area of the screen, a plurality of boundaries724and725of a “right” direction in the area of the screen, a plurality of boundaries726,727and728of a “lower” direction in the area of the screen and a plurality of boundaries729and730of a “left” direction in the area of the screen.

That is, the plurality of boundaries721,722,723,724,725,726,727,728,729and730, to which the plurality of external devices may be respectively mapped, may include at least one boundary of a first direction in the area of the screen, at least one boundary of a second direction in the screen direction, at least one boundary of a third direction in the area of the screen and at least one boundary of a fourth direction in the area of the screen.

Although the plurality of boundaries, to which the plurality of external devices may be respectively mapped, is described as including all boundaries between the area of the screen and the area other than the area of the screen inFIGS. 7aand 7b, the present invention is not limited thereto. Specifically, the plurality of boundaries, to which the plurality of external devices may be respectively mapped, may include only some of all boundaries between the area of the screen and the area other than the area of the screen.

For example, as shown inFIG. 7c, the plurality of boundaries741,742,743,744,745,746,747,748,749and750, to which the plurality of external devices may be respectively mapped, may include a boundary of a “right” direction in the area of the screen, a boundary of a “lower” direction in the area of the screen and a boundary of a “left” area in the area of the screen but may not include a boundary of an “upper” direction in the area of the screen.

As another example, some of the boundaries of the “right” direction in the area of the screen may configure the boundaries, to which the external device may be mapped, but the other of the boundaries of the “right” direction in the area of the screen may not configure the boundaries, to which the external device may be mapped.

FIG. 8is a view illustrating a plurality of directions, to which external devices may be mapped, according to an embodiment of the present invention.

When the pointer displayed on the screen deviates from the area of the screen according to motion of the remote control device, all directions, in which the pointer deviates from the area of the screen, may include a plurality of directions, to which the plurality of external devices may be respectively mapped.

For example, the pointer may deviate from the area of the screen in all directions within 360 degrees relative to a specific angle.

As shown inFIG. 8a, all directions in which the pointer deviates from the area of the screen may include a plurality of directions811,812,813and814, to which the plurality of external devices may be respectively mapped.

Here, the plurality of directions811,812,813and814, to which the plurality of external devices may be respectively mapped, may include an upper direction811(0 degrees relative to the upper direction) among all directions in which the pointer may deviate from the area of the screen, a right direction812(90 degrees relative to the upper direction) among all directions in which the pointer may deviate from the area of the screen, a lower direction813(180 degrees relative to the upper direction) among all directions in which the pointer may deviate from the area of the screen, and a left direction814(270 degrees relative to the upper direction) among all directions in which the pointer may deviate from the area of the screen, as shown inFIG. 8a.

The number of directions, to which the external devices may be mapped, is not limited. For example, as shown inFIG. 8b, the plurality of directions821,822,823,824,824,826,827and828, to which the plurality of external device may be mapped, may include eight directions, as shown inFIG. 8b.

In addition, a specific direction may correspond to an angle in a predetermined range. For example, the angle corresponding to the first direction821may be an angle between 337.5 degrees and 22.5 degrees and the angle corresponding to the second direction822may be an angle between 22.5 degrees and 67.5 degrees.

Although the angles between specific directions and directions adjacent thereto are described as being all equal in the present invention, the present invention is not limited thereto. For example, the angle between a first direction and a second direction adjacent to the first direction may be 45 degrees and the angle between the second direction and a third direction adjacent to the second direction may be 90 degrees.

FIG. 8cis a view illustrating boundaries and directions, to which the external devices may be mapped, according to an embodiment of the present invention.

All boundaries between an area of a screen810and an area other than the screen area may include a plurality of boundaries811,812,813and814.

All directions in which the pointer may deviate from the area of the screen810may include a plurality of directions (0 degrees, 45 degrees, 90 degrees, 135 degrees, 180 degrees, 225 degrees, 270 degrees and 315 degrees), to which the external devices may be mapped.

The external device may be mapped to one of the plurality of boundaries811,812,813and814of the area of the screen810and one of the plurality of directions (0 degrees, 45 degrees, 90 degrees, 135 degrees, 180 degrees, 225 degrees, 270 degrees and 315 degrees) in which the pointer deviates from the area of the screen810.

For example, a first external device may be mapped to the first boundary811of the plurality of boundaries811,812,813and814and the first direction831of the plurality of directions831,832and833in which the pointer may deviate from the area of the screen810through the first boundary811.

As another example, a second external device may be mapped to the first boundary811of the plurality of boundaries811,812,813and814and the third direction833of the plurality of directions831,832and833in which the pointer may deviate from the area of the screen810through the first boundary811.

As another example, a third external device may be mapped to the second boundary812of the plurality of boundaries811,812,813and918and the second direction835of the plurality of directions834,835and836in which the pointer may deviate from the area of the screen810through the second boundary812.

As described above, external devices may not be mapped to some of the boundaries of the area of the screen810.

The number of boundaries, to which the external devices may be mapped, the number of directions, to which the external devices may be mapped, and the number of boundaries and directions, to which the external devices may be mapped, may be determined according to user settings.

In addition, the length of the boundary, to which the external device may be mapped, the angle of the direction, to which the external device may be mapped, or the length of the boundary and the angle of the direction, to which the external device may be mapped, may be determined according to user settings.

The present invention provides various methods of mapping external devices, thereby providing an environment in which the external devices may be mapped to suit an actual arrangement environment of the external devices.

For example, the number of areas, to which the external devices may be mapped, may be changed and thus the user may flexibly set mapping areas according to the number of external devices.

In addition, the mapping areas may be appropriately set according to the locations of the external devices.

For example, if a PC, a laptop and a USB are located at the left side of a television and only a blu-ray player is located at the right side of the television, the user may set three mapping areas at a left boundary of an area of a screen and set only one mapping area at a right boundary of the area of the screen. In addition, by adjusting the length of the mapping area, the PC, the laptop and the USB may be mapped to a plurality of boundaries obtained by dividing the left boundary of the area of the screen into three and the blu-ray player may be mapped to the entire right boundary of the area of the screen.

In addition, if no external device is located at an upper side of the television, the user may not set the mapping area at the upper boundary of the area of the screen.

Returning toFIG. 3, the method of operating the display device according to the embodiment of the present invention may include step S610of detecting the plurality of external devices communicating with the display device. This will be described in detail with reference toFIG. 9.

FIG. 9is a view showing a display screen in a state of detecting a plurality of external devices communicating with a display device according to an embodiment of the present invention.

The control unit170may detect the plurality of external devices communicating with the display device100.

Specifically, if the plurality of external devices is connected to the display device100through the external device interface unit135or if the plurality of external devices communicates with the display device100through the communication unit195, the control unit170may receive identification information of each of the plurality of external devices from the plurality of devices.

In addition, the control unit170may acquire information on each of the plurality of external devices communicating with the display device100and display the acquired information910on each of the plurality of external devices as shown inFIG. 9, based on the identification information received from each of the plurality of external devices.

Meanwhile, the information910on each of the plurality of external devices may include at least one of a type of the external device and an icon corresponding to the external device. Specifically, the control unit170may determine and display the type of the external device based on the identification information received from the external device. In addition, the control unit170may display the icon corresponding to the external device, when the type of the external device is determined.

Although the icon is described as indicating the form or type of the external device in the present embodiment, the present invention is not limited thereto. For example, the icon may indicate the form of content output from the external device or a method of outputting content. For example, the icon corresponding to the blu-ray player may include a movie poster or a videotape. As another example, the icon corresponding to a digital camera may include a photograph.

The present invention provides an environment in which the user may easily confirm the mapping area of the external device.

Returning toFIG. 3, the method of operating the display device according to the embodiment of the present invention may include may include step S620of receiving user input of mapping at least one of the angle and the boundary corresponding to each of the plurality of external devices to each of the plurality of detected external devices and step S630of mapping and storing at least one of the angle and the boundary to each of the plurality of detected external devices based on the user input.

Step S620of receiving user input of mapping at least one of the angle and the boundary corresponding to each of the plurality of external devices to each of the plurality of detected external devices and step S630of mapping and storing at least one of the angle and the boundary to each of the plurality of detected external devices based on the user input will be described in detail with reference toFIG. 10.

FIG. 10is a view illustrating a method of mapping boundaries respectively corresponding to a plurality of external devices to the plurality of external devices according to an embodiment of the present invention.

The control unit170may receive user input of selecting one of the plurality of external devices.

InFIG. 10a, assume that the PC101is selected by the user input.

The control unit170may display areas1051,1502,1503,1504,1505,1506,1507,1508,1509and1560respectively corresponding to a plurality of boundaries1081,1082,1083,1084,1085,1086,1087,1088,1089and1090, to which the external devices may be mapped, on the screen of the display device100.

The control unit170may receive the information on motion of the remote control device200from the remote control device200. In addition, the control unit170may move and display the pointer to correspond to motion of the remote control device as shown inFIG. 10b.

As the pointer is moved after the PC1010is selected, the control unit170may move and display the icon1030of the PC to correspond to movement of the pointer.

When the pointer is moved to an area1059corresponding to the ninth boundary1089, the control unit170may map information on the ninth boundary1089of the plurality of boundaries1081,1082,1083,1084,1085,1086,1087,1088,1089and1090to the PC and store the information in the storage unit140.

In this case, the information on the ninth boundary1089stored in the storage unit140may be information on the coordinates corresponding to the ninth boundary1089. For example, if the coordinates corresponding to the ninth boundary1089are (x, y)=(0, 540 to 1080), the control unit170may map and store the coordinates 0 and 540 to 1080 corresponding to the ninth boundary1089to the PC.

If mapping is finished, as shown inFIG. 10c, the control unit170may display the area1059corresponding to the ninth boundary1089, to which the external device is mapped, to be distinguished from the other areas1051,1052,1053,1054,1055,1056,1057,1058and1060. For example, the control unit170may display the area1059corresponding to the ninth boundary1089, to which the external device is mapped, with a darker color than the other areas1051,1052,1053,1054,1055,1056,1057,1058and1060.

If mapping is finished, the control unit170displays the icon1030of the external device mapped to the ninth boundary1089in the area1059corresponding to the ninth boundary1089, to which the external device is mapped.

Although the external device is described as being mapped to the boundary when the pointer is moved to the areas1051,1502,1503,1504,1505,1506,1507,1508,1509and1560respectively corresponding to the plurality of boundaries1081,1082,1083,1084,1085,1086,1087,1088,1089and1090in the present embodiment, the present invention is not limited thereto.

For example, when the pointer displayed on the screen deviates from the screen through any one of the plurality of boundaries1081,1082,1083,1084,1085,1086,1087,1088,1089and1090, the control unit170may map the boundary, through which the pointer passes, of the plurality of boundaries1081,1082,1083,1084,1085,1086,1087,1088,1089and1090to the external device selected by the user and store the boundary in the storage unit140.

FIG. 11is a view illustrating a method of mapping directions corresponding to a plurality of external devices to the plurality of external devices according to an embodiment of the present invention.

The control unit170may receive user input of selecting one of the plurality of external devices.

InFIG. 11a, assume that a PC1110is selected by user input.

The control unit170may display Uls1151,1152,1153,1154,1155,1156,1157and1158indicating a plurality of directions, to which the external devices may be mapped, on the screen of the display device100.

The control unit170may receive information on motion of the remote control device200from the remote control device200. In addition, the control unit170may move and display the pointer to correspond to motion of the remote control device, as shown inFIG. 11b.

As the pointer is moved after the PC1010is selected, the control unit170may move and display the icon1030of the PC to correspond to movement of the pointer.

As shown inFIG. 11c, when the pointer deviates from the area of the screen in the same direction as the UI1156indicating the sixth direction, the control unit170may map the sixth direction of the plurality of directions, to which the external devices may be mapped, to the PC and store the sixth direction in the storage unit140.

In this case, information on the sixth direction stored in the storage unit140may be information on an angle corresponding to the sixth direction. For example, the angle θ of the sixth direction is 225 degrees relative to the upper direction of the screen, the control unit170may map and store 225 degrees which is the angle θ corresponding to the sixth direction to the PC.

If mapping is finished, as shown inFIG. 11d, the control unit170may display the UI1156indicating the sixth direction, to which the external device is mapped, to be distinguished from the UIs1151,1152,1153,1154,1155,1157and1158indicating the other directions. For example, the control unit170may display the UI1156indicating the sixth direction, to which the external device is mapped, with a dark color than the UIs1151,1152,1153,1154,1155,1157and1158indicating the other directions.

If mapping is finished, the control unit170may display the icon1130of the external device mapped to the sixth direction along with the UI1156indicating the sixth direction, to which the external device is mapped.

In the present embodiment, when the pointer deviates from the area of the screen in a state of selecting a specific external device, the direction is mapped to the selected external device. However, the present invention is not limited thereto and, when the pointer is moved in a specific direction in a state of selecting a specific external device (that is, even when the pointer does not deviate from the area of the screen), the specific direction may be mapped to the specific external device.

FIG. 12is a view illustrating a method of mapping boundaries and directions to external device according to an embodiment of the present invention.

The control unit170may receive user input of selecting one of the plurality of external devices.

InFIG. 12a, assume that a PC1210is selected by user input.

The control unit170may display areas1250,1260,1270and1280respectively corresponding to the plurality of boundaries, to which the external devices may be mapped, and UIs1251,1252,1253,1261,1262,1263,1271,1272,1273,1281,1282and1283indicating the plurality of directions, to which the external devices may be mapped, on the screen of the display device100.

Among others, the first area1250corresponds to the boundary located in the “upper” direction of the area of the screen and the first UI1251, the second UI1252and the third1253indicate the directions mapped along with the boundary located in the “upper” direction of the area of the screen.

Similarly, the second area1260corresponds to the boundary located in the “right” direction of the area of the screen and the fourth UI1261, the fifth UI1262and the sixth UI1263indicate the directions mapped along with the boundary located in the “upper” direction of the area of the screen.

The control unit170may receive information on motion of the remote control device200from the remote control device200. In addition, the control unit170may move and display the pointer to correspond to motion of the remote controller, as shown inFIG. 12b.

As the pointer is moved after the PC1210is selected, the control unit170may move and display the icon of the PC to correspond to movement of the pointer.

As shown inFIG. 12c, when the pointer deviates from the screen through the boundary located in the “left” direction of the area of the screen and deviates from the area of the screen in the same direction as the seventh UI1281indicating the seventh direction, the control unit170may map the boundary located in the “left” direction of the area of the screen and the seventh direction to the PC and store the boundary and the direction in the storage unit140.

The information on the specific boundary and the information on the specific direction stored in the storage unit140may be information on the coordinates of the specific boundary and the angle corresponding to the specific direction.

For example, if the coordinates of the boundary located in the “left” direction of the area of the screen are (x, y)=(0, 0 to 1080) and the angle of the seventh direction is 225 degrees relative to the upper direction of the screen, the control unit170may map and store the coordinates (0, 0 to 1080) of the boundary located in the “left” direction of the area of the screen and225corresponding to the seventh direction to the PC.

If mapping is finished, as shown inFIG. 12d, the control unit170may display the boundary of the “left” direction, to which the external device is mapped, and the UI1281indicating the seventh direction to be distinguished from the other Uls.

If mapping is finished, the control unit170may display the icon1230of the external device mapped to the boundary of the “left” direction and the seventh direction along with the boundary of the “left” direction, to which the external device is mapped, and the UI1281indicating the seventh direction.

The external devices located around the TV are generally located at fixed places. Accordingly, the user may map a specific external device to a boundary or direction corresponding to an area in which the specific external device is located. Therefore, the user may intuitively switch external input, by moving the pointer in a direction in which the external device is actually located, upon switching of external input.

In addition, when a place where the external device is located is changed, the mapping area is changed, such that the user may intuitively switch external input by moving the pointer in a direction in which the external device is actually located, upon switching of external input.

Although the mapping method of the external device according to the movement direction and the movement area of the pointer is described inFIGS. 10 to 12, the mapping method of the external device is not limited thereto. For example, when a specific external device is selected, the control unit170may display a list of a plurality of boundaries, to which the specific external device may be mapped, a plurality of directions, to which the specific external device may be mapped or a plurality of boundaries and directions, to which the specific external device may be mapped. When the user selects at least one of the specific boundaries and the specific directions included in the list, the control unit170may map at least one of the specific boundary and the specific direction to the specific external device and store the specific boundary and the specific direction in the storage unit140.

Returning toFIG. 6, the method of operating the display device according to the present invention may include step S640of displaying at least one of the angle and the boundary corresponding to each of the plurality of external devices.

This will be described in detail with reference toFIG. 13.

FIGS. 13 to 15are views illustrating a method of displaying at least one of boundaries and directions, to which a plurality of external devices is mapped, according to an embodiment of the present invention.

FIG. 13is a view showing a plurality of boundaries, to which a plurality of external devices is respectively mapped, according to an embodiment of the present invention.

If input of confirming the mapping state of each of the plurality of external devices is received, the control unit170may display an area corresponding to the boundary, to which each of the plurality of external devices is mapped.

Specifically, the control unit170may display a plurality of areas1314,1315,1316,1317,1318,1319and1320respectively corresponding to the plurality of boundaries1354,1355,1356,1357,1358,1359and1360, to which the plurality of external devices is mapped, among the boundaries between the area of the screen and the area other than the area of the screen.

In addition, the control unit170may display a plurality of icons1331,1332,1333,1334,1335,1336and1337respectively corresponding to the plurality of boundaries1354,1355,1356,1357,1358,1359and1360, to which the plurality of external devices is mapped, along with the plurality of areas1314,1315,1316,1317,1318,1319and1320respectively corresponding to the plurality of boundaries1354,1355,1356,1357,1358,1359and1360, to which the plurality of external devices is mapped. Here, each of the plurality of1331,1332,1333,1334,1335,1336and1337may be an icon indicating each of the plurality of external devices.

For example, if a PC is mapped to the fourth boundary1354, the control unit170may display the fourth area1314corresponding to the fourth boundary1354. In addition, the control unit170may display an icon1331indicating the PC along with the fourth area1314corresponding to the fourth boundary1354.

Meanwhile, although, when input of confirming the boundary, to which each of the plurality of external devices is mapped, is received, the area corresponding to the boundary, to which each of the plurality of external devices is mapped, is described as being displayed inFIG. 13, the present invention is not limited.

Specifically, the control unit170may display areas1311,1312,1313,1314,1315,1316,1317,1318,1319and1320respectively corresponding to the plurality of boundaries1351,1352,1353,1354,1355,1356,1357,1358,1359and1360, to which the plurality of external devices may be respectively mapped. That is, the control unit170may display the areas1314,1315,1316,1317,1318,1319and1320respectively corresponding to the boundaries1354,1355,1356,1357,1358,1359and1360, to which the external devices are mapped, and the areas1311,1312and1313respectively corresponding to the boundaries1351,1352and1353, to which the external devices are not mapped, among the plurality of boundaries1351,1352,1353,1354,1355,1356,1357,1358,1359and1360, to which the plurality of external devices may be respectively mapped.

The control unit180may display the areas1314,1315,1316,1317,1318,1319and1320respectively corresponding to the boundaries1354,1355,1356,1357,1358,1359and1360, to which the external devices are mapped, and the areas1311,1312and1313respectively corresponding to the boundaries1351,1352and1353, to which the external devices are not mapped, to be distinguished therebetween. For example, the control unit170may display the areas1314,1315,1316,1317,1318,1319and1320respectively corresponding to the boundaries1354,1355,1356,1357,1358,1359and1360, to which the external devices are mapped, with a darker color than the areas1311,1312and1313respectively corresponding to the boundaries1351,1352and1353, to which the external devices are not mapped,

FIG. 14is a view showing a plurality of directions, to which a plurality of external devices is respectively mapped, according to an embodiment of the present invention.

When input of confirming the mapping state of each of the plurality of external devices is received, the control unit170may display UIs1412,1413,1414,1415,1416,1417and1418corresponding to the plurality of directions, to which the plurality of external devices is respectively mapped.

In addition, the control unit170may display a plurality of icons1431,1432,1433,1434,1435,1436and1437respectively corresponding to the plurality of external devices along with the UIs1412,1413,1414,1415,1416,1417and1418corresponding to the plurality of directions, to which the plurality of external devices is respectively mapped. Here, the UIs412,1413,1414,1415,1416,1417and1418corresponding to the plurality of directions, to which the plurality of external devices is respectively mapped, may be displayed to correspond to the plurality of icons1431,1432,1433,1434,1435,1436and1437respectively corresponding to the plurality of external devices. Here, the plurality of icons1331,1332,1333,1334,1335,1336and1337may be icons respectively indicating the plurality of external devices.

For example, if a USB is mapped to an eighth direction, the control unit170may display the UI1418corresponding to the eighth direction. In addition, the control unit170may display the icon1437indicating the USB mapped to the eighth direction to correspond to the UI1418corresponding to the eighth direction.

Although the direction, to which each of the plurality of external devices is mapped, is described as being displayed in theFIG. 14, the present invention is not limited thereto.

Specifically, the control unit170may display the UIs1411,1412,1413,1414,1415,1416,1417and1418corresponding to the plurality of directions, to which the plurality of external devices may be respectively mapped. That is, the control unit170may display the UIs1412,1413,1414,1415,1416,1417and1418corresponding to the directions, to which the external devices are mapped, and the UI1411corresponding to the direction, to which the external device is not mapped, among the plurality of directions which the plurality of external devices may be respectively mapped.

The control unit170may display the UIs1412,1413,1414,1415,1416,1417and1418corresponding to the directions, to which the external devices are mapped, and the UI1411corresponding to the direction, to which the external device is not mapped, to be distinguished therebetween. For example, the control unit170may display the UIs1412,1413,1414,1415,1416,1417and1418corresponding to the directions, to which the external devices are mapped, with a darker color than the UI1411corresponding to the direction, to which the external device is not mapped.

FIG. 15is a view showing a plurality of boundaries and directions, to which a plurality of external devices is respectively mapped, according to an embodiment of the present invention.

When input of confirming the mapping state of each of the plurality of external devices is received, the control unit170may display areas and directions corresponding to boundaries, to which the plurality of external devices is respectively mapped.

Specifically, the control unit170may display a plurality of areas1520,1530and1540respectively corresponding to the plurality of boundaries1572,1573and1574, to which the plurality of external devices is mapped, among the boundaries between the area of the screen and the area other than the area of the screen, and UIs1522,1523,1531,1532,1533,1541and1543indicating a plurality of directions, to which the plurality of external devices is mapped.

Among UIs1522,1523,1531,1532,1533,1541and1543indicating the plurality of directions, to which the plurality of external devices is mapped, the seventh UI1531, the eighth UI1532and the ninth UI1533indicate three directions mapped along with the third boundary1573.

As another example, among the UIs1522,1523,1531,1532,1533,1541and1543indicating the plurality of directions, to which the plurality of external devices is mapped, the tenth UI1541and the twelfth UI1543indicate two directions mapped along with the fourth boundary1574.

For example, a laptop is mapped to the same direction as the second boundary and the fifth UI1522and the USB is mapped to the same direction as the fourth boundary1574and the twelfth UI1543.

In addition, the control unit170may display icons corresponding to the plurality of external devices along with UIs indicating the boundaries and directions, to which the plurality of external devices is mapped.

For example, the control unit170may display the fourth boundary1574and an icon1557indicating the external device mapped to the twelfth direction along with the fourth boundary1574and the UI1543indicating the twelfth direction.

Although, when input of confirming the boundary, to which each of the plurality of external devices is mapped, is received, the boundary and direction, to which each of the plurality of external devices is mapped, is described as being displayed inFIG. 15, the present invention is not limited thereto.

Specifically, the control unit170may display the plurality of areas1510,1520,1530and1540respectively corresponding to the plurality of boundaries1571,1572,1573and1574, to which the plurality of external devices may be mapped, among the area of the screen and the area other than the area of the screen, and UIs1511,1512,1513,1521,1522,1523,1531,1532,1533,1541,1542and1543indicating the plurality of directions, to which the plurality of external devices is mapped.

The control unit170may display the areas1520,1530and1540corresponding to the boundaries1572,1573and1574, to which the external devices are mapped, and UIs1522,1523,1531,1532,1533,1541and1543corresponding to the directions, to which the external devices are mapped, to be distinguished from the area1510corresponding to the boundary1571, to which the external device is not mapped, and the UIs1511,1512,1513,1521and1542corresponding to the directions, which the external devices are not mapped.

Although the plurality of icons respectively corresponding to the plurality of external devices is described as being displayed inFIGS. 13 to 15, the present invention is not limited thereto and the types of the plurality of external devices may be displayed.

The present invention provides an environment in which the area corresponding to the external device is capable of being easily confirmed. That is, the user may confirm the area (the boundary, the direction or the boundary and the direction) corresponding to the external device to change the mapping area. In addition, the user may easily switch input to a desired external device.

Returning toFIG. 6, the method of operating the display device according to the embodiment of the present invention may include step S650of displaying the pointer on the screen and step S660of receiving information on motion of the remote control device.

The remote control device200may receive input of displaying the pointer, and the control unit180may receive a command for displaying the pointer from the remote control device200through the user input interface unit150.

In addition, the control unit170may control the display unit180to display the pointer, when the command for displaying the pointer is received.

Meanwhile, the remote control device200may sense motion of the remote control device200and transmit information on the motion of the remote control device200to the display device100.

Meanwhile, the method of operating the display device according to the embodiment of the present invention may include step S670of acquiring the coordinates of the pointer corresponding to motion of the remote control device based on the information on motion of the remote control device.

This will be described in detail with reference toFIG. 16.

FIG. 16is a view illustrating a method of acquiring the coordinates of the pointer corresponding to motion of a remote control device according to an embodiment of the present invention.

The coordinates of the pointer corresponding to motion of the remote control device may include the coordinates of an area1610on the screen of the display device100and the coordinates of a virtual area1620other than the screen the display device100.

Specifically, if the pointer1630is located in the area1610of the screen of the display device100, the control unit170may calculate the coordinates of the pointer1630moved in correspondence with motion of the remote control device200based on information on motion of the remote control device200. In addition, the control unit170may display the pointer1630on the screen based on the calculated coordinates of the pointer1630.

Meanwhile, the pointer1640may be located in the area1620other than the screen of the display device100. Here, the pointer1640may be a virtual pointer which is not a pointer displayed on the screen.

In this case, the control unit170may acquire the virtual coordinates of a virtual pointer1640moved in correspondence with motion of the remote control device200based on the information on motion of the remote control device200.

Meanwhile, the control unit170may determine whether the pointer1630deviates from the area1610of the screen based on the coordinates of the pointer.

For example, if the coordinates of the pointer moved in correspondence with motion of the remote control device200deviates from the coordinates of the area1610of the screen, the control unit170may determine that the pointer1630deviates from the area1610of the screen.

As another example, if the coordinates of the pointer moved in correspondence with motion of the remote control device200is changed from the coordinates of the area1610of the screen to the virtual coordinates of the area1620other than the screen, the control unit170may determine that the pointer1630deviates from the area1610of the screen.

Returning toFIG. 6, the method of operating the display device according to the embodiment of the present invention may include step S680of switching external input when the pointer deviates from the area corresponding to the screen based on the acquired coordinates of the pointer. This will be described in detail with reference toFIGS. 17 to 27.

FIGS. 17 to 18are views illustrating a method of switching input provided to the display device to external input when a pointer deviates from an area of a screen according to an embodiment of the present invention.

Here, input provided to the display device may be input provided by an external device, such as a USB, a PC, an external hard drive, a blu-ray player, a set-top box, a digital camera, a laptop, a game console, a camcorder, a smartphone, a tablet PC, an MP3 player, an audio/DVD player, a video player, etc. connected to the display device100.

In addition, input provided to the display device may be broadcast content provided by a broadcast provider and received through the tuner131or content provided by a content provider and received through the network interface unit133.

The control unit170may output video using input provided to the display device. For example, if input is provided by a set-top box (that is, the set-top box outputs a broadcast image), the control unit170may output the broadcast image using input provided by the set-top boxy. As another example, if input is provided from a laptop to the display device100, the control unit170may output an image on the screen of the laptop using input provided by the laptop (e.g., the image on the screen of the laptop). As another example, if input is provided from a USB to the display device100, the control unit170may output the image of content stored in the USB using input provided by the USB (e.g., the content stored in the USB).

Meanwhile, “external input” described in the present specification may further include at least one of broadcast content input through the tuner131and content input through the network interface unit, in addition to input provided by an external device, such as a USB, a PC, an external hard drive, a blu-ray player, a set-top box, a digital camera, a laptop, a game console, a camcorder, a smartphone, a tablet PC, an MP3 player, an audio/DVD player, a video player, etc. connected to the display device100.

Accordingly, external input may be switched to input provided by one of external devices in a state in which broadcast content input through the tuner131is displayed and external input may be switched to broadcast content received through the tuner131in a state in which an image corresponding to input provided by one of the external devices is displayed.

Meanwhile, inFIGS. 17 and 18, assume that the USB is mapped to the first boundary1711of the area of the screen, the laptop is mapped to the second boundary1712of the area of the screen, the blu-ray player is mapped to the third boundary1713of the area of the screen, and the PC is mapped to the fourth boundary1714of the area of the screen.

When the pointer deviates from the area of the screen, the control unit170may switch input provided to the display device100to external input. Specifically, when the pointer deviates from the area of the screen based on the coordinates of the pointer, the control unit170may switch input provided to the display device100and used to output an image to external input.

That is, when the pointer displayed on the screen is moved from the area of the screen to the area outside the screen (that is, a virtual coordinate area), the control unit170may switch input provided to the display device to external input.

In this case, the control unit170may switch input provided to the display device to input provided by the external device corresponding to a specific boundary1711located at a point1721where the pointer1720deviates from the area of the screen among a plurality of boundaries1711,1712,1713and1714of the area of the screen.

For example, as shown inFIG. 17a, when the pointer1720deviates from the area of the screen at the specific point1721of the first boundary1711, the control unit170may switch input provided to the display device100to input provided by the USB as the external device corresponding to the first boundary1711.

Meanwhile, when input provided to the display device is switched to external input, the control unit170may display the screen switched to the external input.

Specifically, when input provided to the display device is switched to input provided by a specific external device among a plurality of external devices, the control unit170may display an image in a state in which input is switched to the specific external device.

For example, inFIG. 17a, the image of broadcast content provided by a broadcast provider and received through the tuner131is displayed. If input provided to the display device is switched to input provided by the USB, the control unit170may display an image1750in a state in which input provided to the display device is switched to input provided by the USB as shown inFIG. 17b.

In addition, when input provided to the display device is switched to input provided by the USB, the control unit170may receive content stored in the USB from the USB and control the display unit180to display the image of the received content.

As another example, inFIG. 18a, input provided to the display device is broadcast provided by a broadcast provider and received through the tuner131, and the control unit170displays the image of the broadcast content.

Meanwhile, when the pointer1820deviates from the area of the screen at a specific point1821of the fourth boundary1814, the control unit170may switch input provided to the display device100to input provided by the PC which is the external device corresponding to the fourth boundary1814.

Meanwhile, when input provided to the display device is switched to external input, the control unit170may display an image received from external input. Specifically, when input provided to the display device100is switched to input provided by a specific external device, the control unit170may receive an image from the specific external device. In addition, the control unit170may receive the received image.

For example, when external input is switched to input provided by the PC, the control unit170may receive an image from the PC and display the image received from the PC, as shown inFIG. 18b.

FIG. 19is a view illustrating a method of switching to external input when each of a plurality of external devices is mapped to a plurality of boundaries of an area of a screen.

InFIG. 19, a laptop is mapped to a first boundary1930among the plurality of boundaries of the area of the screen and a digital camera is mapped to a second boundary1940.

Meanwhile, when the pointer1910deviates from the area of the screen through the first boundary1930, the control unit170may switch input to input provided by the laptop which is the external device corresponding to the first boundary1930.

Meanwhile, the pointer1910may deviate from the area of the screen in various directions. That is, the pointer1910may deviate from the area of the screen in a first direction1921, a second direction1922or a third direction1923. When the pointer1910deviates from the area of the screen in the first direction1921, the second direction1922or the third direction1923, the pointer1910deviates from the area of the screen through the first boundary1930.

Accordingly, when the pointer1910deviates from the area of the screen in the first direction1921, the second direction1922or the third direction1923, the control unit170may switch input provided to the display device100to input provided by the laptop which is the external device corresponding to the first boundary1930.

Meanwhile, when the pointer1910deviates from the area of the screen in a fourth direction1924, the pointer1910may deviate from the area of the screen through the second boundary1940.

Accordingly, when the pointer1910deviates from the area of the screen in the fourth direction1924, the control unit170may switch input provided to the display device100to input provided by the digital camera which is the external device corresponding to the second boundary1940.

FIG. 20is a view illustrating a method of switching to external input when each of a plurality of external devices is mapped to a plurality of directions in which a pointer deviates from an area of a screen.

InFIG. 20, a USB is mapped to a seventh direction2060among the plurality of directions, in which the pointer deviates from the area of the screen, and a PC is mapped to a sixth direction2050among the plurality of directions, in which the pointer deviates from the area of the screen.

Meanwhile, if the pointer1910deviates from the area of the screen in the seventh direction, the control unit170may switch input provided to the display device100to input provided by the USB which is the external device corresponding to the seventh direction.

For example, if a first pointer2010deviates from the area of the screen in the seventh direction2032, the control unit170may switch input provided to the display device100to input provided by the USB which is the external device corresponding to the seventh direction2060.

As another example, if a second pointer2020deviates from the area of the screen in the seventh direction2031, the control unit170may switch input provided to the display device100to input provided by the USB which is the external device corresponding to the seventh direction2060.

Meanwhile, if the first pointer2010deviates from the area of the screen in the sixth direction2033, the control unit170may switch input provided to the display device100to input provided by the PC which is the external device corresponding to the sixth direction2050.

That is, in the embodiment ofFIG. 20, switching to external input may be performed only by the direction in which the pointer deviates from the area of the screen, regardless of the boundary of a point at which the pointer deviates from the area of the screen.

FIG. 21is a view illustrating a method of switching to external input when each of a plurality of external devices is mapped to a plurality of boundaries and directions of an area of a screen.

InFIG. 21, a laptop is mapped to a second boundary2150of a plurality of boundaries and a fifth direction2152of a plurality of directions, a digital camera is mapped to the second boundary2150of the plurality of boundaries and a sixth direction2153of the plurality of directions, a set-top box is mapped to a third boundary2160of the plurality of boundaries and a seventh direction2161of the plurality of directions, a blu-ray player is mapped to the third boundary2160of the plurality of boundaries and an eighth direction2162of the plurality of directions, an external hard drive is mapped to the third boundary2160of the plurality of boundaries and a tenth direction2171of the plurality of directions, a PC is mapped to a fourth boundary2170of the plurality of boundaries and a tenth direction2171of the plurality of directions, and a USB is mapped to the fourth direction2170of the plurality of boundaries and a twelfth direction2172of the plurality of directions.

Meanwhile, when the pointer deviates from the area of the screen through a specific boundary of the plurality of boundaries of the area of the screen and the pointer deviates from the area of the screen in a specific direction, the control unit170may switch input provided to the display device100to input provided by the external device corresponding to the specific boundary and the specific direction.

For example, if a first pointer2110deviates from the area of the screen through a third boundary2160and the first pointer2110deviates from the area of the screen in an eighth direction2111, the control unit170may switch input provided to the display device100to input provided by the blu-ray player which is the external device corresponding to the third boundary2161and the eighth direction2162.

As another example, when the first pointer2110deviates from the area of the screen through the third boundary2160and the first pointer2110deviates from the area of the screen in a ninth direction2112, the control unit170may switch input provided to the display device100to input provided by an external hard drive which is the external device corresponding to the third boundary2161and the ninth direction2163.

As another example, when the second pointer2120deviates from the area of the screen through the fourth boundary2170and the second pointer2120deviates from the area of the screen in a tenth direction2121, the control unit170may switch input provided to the display device100to input provided by the PC which is the external device corresponding to the fourth boundary2170and the tenth direction2171.

As another example, when the second pointer2120deviates from the area of the screen through the fourth boundary2170and the second pointer2120deviates from the area of the screen in a twelfth direction2122, the control unit170may switch input provided to the display device100to input provided by the USB which is the external device corresponding to the fourth boundary2170and the twelfth direction2172.

Meanwhile, a third pointer2130deviates from the area of the screen through an upper boundary of the area of the screen but there is no external device mapped to the upper boundary of the area of the screen. Accordingly, even when the third pointer2130deviates from the area of the screen through the upper boundary of the area of the screen in a plurality of directions2131,2132and2133, the control unit170may not switch input provided to the display device100.

Meanwhile, the fourth pointer2140deviates from the area of the screen through a second boundary2150and deviates from the area of the screen in a fourth direction2141. Meanwhile, although the laptop and the digital camera are mapped to the second boundary2150, the direction in which the pointer deviates from the area of the screen and the direction to which the laptop and the digital camera are mapped are different. Accordingly, the control unit170may not switch input provided to the display device100.

Meanwhile, when the pointer deviates from the area of the screen but there is no external device mapped to the boundary or direction in which the pointer deviates from the screen, the control unit170may output a message indicating that there is no external device corresponding to the boundary or direction in which the pointer deviates from the screen.

FIGS. 22 to 24are views illustrating various methods of determining whether a pointer deviates from an area of a screen according to an embodiment of the present invention.

FIG. 22is a view illustrating a method of determining whether a pointer deviates from an area of a screen when a user shakes a remote control device according to an embodiment of the present invention.

The control unit170may acquire the coordinates of the pointer based on motion of the remote control device and determine whether the pointer deviates from the area of the screen.

Meanwhile, when a pointer2210moves to correspond to shaking of the remote control device based on the boundary of the area of the screen, the control unit170may determine that the pointer deviates from the area of the screen.

Specifically, as shown inFIG. 22, when the pointer moves from the area of the screen to a virtual area located outside the screen due to first movement2221of the pointer2210, the pointer moves from the virtual area located outside the screen to the area of the screen due to second movement2222of the pointer2210and the pointer moves from the area of the screen to the virtual area located outside the screen again due to third movement2223of the pointer2210, the control unit170may determine that the pointer deviates from the area of the screen.

FIG. 23is a view illustrating a method of determining whether a pointer deviates from an area of a screen according to a movement distance of the pointer according to an embodiment of the present invention.

The control unit170may acquire the coordinates of the pointer based on motion of the remote control device200and determine the movement distance when the pointer moves once.

Specifically, when the user moves the remote control device200upward once, the control unit170moves the pointer upward once based on motion of the remote control device200and displays the pointer. In this case, the control unit170may determine the movement distance when the pointer moves once. Here, the movement distance of the pointer may include not only a movement distance of the pointer in the area of the screen but also a movement distance of the pointer in the virtual area outside the screen.

Meanwhile, if the movement distance of the pointer is equal to or greater than a specific distance, the control unit170may determine that the pointer deviates from the area of the screen.

For example, when the specific distance is b and a pointer2310moves by a distance a shorter than the distance b as shown inFIG. 23a, the control unit170may determine that the pointer does not deviate from the area of the screen.

As another example, if the specific distance is b and the pointer2310moves by a distance c longer than the distance b as shown inFIG. 23b, the control unit170may determine that the pointer deviates from the area of the screen.

FIG. 24is a view illustrating a method of determining whether a pointer deviates from an area of a screen according to the movement speed of the pointer according to an embodiment of the present invention.

The control unit170may acquire the movement speed of the pointer based on the movement distance of the pointer and the movement time of the pointer according to motion of the remote control device200.

Here, the movement distance of the pointer may include not only a movement distance of the pointer in the area of the screen but also a movement distance of the pointer in the virtual area outside the screen.

Meanwhile, if the movement speed of the pointer is equal to or greater than a specific speed, the control unit170may determine that the pointer deviates from the area of the screen.

For example, as shown inFIG. 24a, when the pointer2410moves at a specific speed or less and deviates from the area of the screen, the control unit170may determine that the pointer2410does not deviate from the area of the screen.

As another example, as shown inFIG. 24b, when the pointer2410moves at a speed exceeding the specific speed and deviates from the area of the screen, the control unit170may determine that the pointer2410deviates from the area of the screen.

Conventionally, for switching to external input, an external input button was pressed to confirm a list of interfaces (e.g., a USB terminal, a first HDMI terminal, etc.) capable of receiving external input was confirmed and then a specific interface was selected.

In the present invention, external devices capable of providing external input are displayed through icons indicating the external devices and the types of the external devices, such that the user may more intuitively determine a desired external device.

In addition, unlike the conventional method of pressing the specific button and selecting the specific interface to switch to external input, an environment capable of switching to external input by a simple operation of moving the pointer to the outside of the area of the screen is provided.

In addition, in the present invention, since the user may map an external device to a desired area and move the pointer to an area, in which the external device is located, to switch input, an environment in which switching to external input may be intuitively performed is provided.

FIG. 25is a view illustrating a display screen when input provided to a display device is switched to external input, according to an embodiment of the present invention.

As shown inFIG. 25a, if a pointer2510deviates from a boundary2521of an area of a screen corresponding to a PC in a state in which input (broadcast content) provided by a broadcast provider and received through the tuner131is displayed, the control unit170may switch input provided to the display device100to input provided by the PC.

Meanwhile, when input provided to the display device100is switched to input provided by the PC, the control unit170may receive input provided by the PC. That is, as shown inFIG. 25b, an image may be received from the PC and the received image may be displayed. In this case, the image received from the PC may be equal to the image displayed on the screen of the PC.

When input provided to the display device100is switched to input provided by a specific external device, the control unit170may display an icon indicating the specific external device in an area corresponding to a boundary, to which the specific external device is mapped.

For example, when input provided to the display device100is switched to input provided by the PC, the control unit170may display an icon2530indicating the PC in the area corresponding to the boundary2521, to which the PC is mapped.

The present invention is not limited thereto and the icon2530indicating the PC may be displayed in one area of the screen. For example, the icon2530indicating the PC may be displayed in the upper right area2540of the screen so as not to disturb user's viewing.

Meanwhile, the icon indicating the external device for providing input to the display device100may be periodically displayed. For example, the control unit170may display the icon2530indicating the PC when input provided to the display device100is switched to input provided by the PC, stop display of the icon2530indicating the PC, and repeatedly display the icon2530indicating the PC at a predetermined time interval.

Meanwhile, the icon indicating the external device for providing input to the display device100may be displayed according to user input. For example, when user input of confirming the external device for currently providing input to the display device is received, the control unit170may display the icon2530indicating the PC in one area of the screen.

FIG. 26is a view illustrating a method of operating an external device when input provided to a display device is switched to external input, according to an embodiment of the present invention.

As shown inFIG. 26a, when a pointer2610deviates from a boundary2621of an area of a screen corresponding to a PC in a state in which input (broadcast content) provided by a broadcast provider and received through the tuner131is displayed, the control unit170may switch input provided to the display device100to input provided by the PC.

In addition, the control unit170may receive and display an image from the PC, as shown inFIG. 26b.

Meanwhile, although a plurality of external devices520,530,540,550,560and570are mapped to the boundaries of the area of the screen or directions in which the pointer deviates from the screen, some of the plurality of mapped external devices520,530,540,550,560and570may be powered on and the remaining external devices may be powered off.

Meanwhile, when the pointer2610deviates from the boundary of the area of the screen corresponding to a specific external device but the specific external device is powered off, the control unit170may transmit a power ON command to the specific external device and switch input provided to the display device100to input provided by the specific external device. Specifically, the control unit170may determine whether communication with the specific external device is possible through the communication unit173or the external device interface unit135and transmit the power ON command to the specific external device when the specific external device is powered off and thus communication with the specific external device is impossible.

For example, as shown inFIG. 26a, when the pointer2610deviates from the boundary2621of the area of the screen corresponding to the PC but the PC520is powered off, the control unit170may transmit the power ON command to the PC through the external device interface unit135or the communication unit173.

Meanwhile, when the power ON command is received from the display device100, the control unit of the PC520may power the PC520on and provide input to the display device100.

In this case, the control unit170may output an image using input provided by the PC520.

Meanwhile, the plurality of external devices520,530,540,550,560and570may include light output units521,531,541,551,561and571, respectively. Here, each of the light output units521,531,541,551,561and571may include an LED.

Meanwhile, when input provided to the display device100is switched to input provided by a specific external device, the control unit170may transmit a light output command to the specific external device. For example, when input provided to the display device100is switched to input provided by the PC, the control unit170may transmit the light output command to the PC.

Meanwhile, when the light output command is received from the display device100, the control unit of the PC520may control the light output unit521to output a light signal.

Meanwhile, the control unit170may periodically transmit the light output command to the specific external device and the control unit of the specific external device may periodically output the light signal.

In addition, when user input of confirming the external device for providing input to the display device is received, the control unit170may transmit the light output command to the specific external device.

Although the light output command is described as being transmitted in the present embodiment, the present invention is not limited thereto. For example, in the case of the USB510which does not include the control unit, the control unit170of the display device100may directly control the light output unit511of the USB510to output the light signal.

In the present invention, the user can easily confirm the external device for providing external input in a state of being switched to external input.

FIG. 27is a view illustrating a process of displaying a pointer, acquiring coordinates of the pointer based on motion of a remote control device and switching to external input when the pointer deviates from an area of a screen, according to an embodiment of the present invention.

As shown inFIG. 27a, the remote control device200may receive input to a specific button210. Here, input to the specific button210may be user input of displaying a pointer and confirming the mapping states of a plurality of external devices.

Meanwhile, the remote control device200may transmit a signal corresponding to the specific button210to the display device100.

Meanwhile, when the signal corresponding to the specific button210is received from the remote control device200, the control unit170may display a pointer2710on the screen. In addition, when the signal corresponding to the specific button210is received from the remote control device200, the control unit170may display at least one of the boundaries and directions respectively corresponding to the plurality of external devices.

For example, as shown inFIG. 27b, the control unit170may display areas2721,2722,2723,2724,2725,2726and2727respectively corresponding to a plurality of boundaries, to which the plurality of external devices is mapped.

In addition, the control unit170may display a plurality of icons2741,2742,2743,2744,2745,2746and2747respectively indicating the plurality of external devices along with the areas2721,2722,2723,2724,2725,2726and2727respectively corresponding to the plurality of boundaries, to which the plurality of external devices is mapped.

Meanwhile, although the areas corresponding to the boundaries, to which the plurality of external devices is mapped, are described as being displayed inFIG. 27b, the present invention is not limited thereto.

Specifically, the control unit180may display areas2721,2722,2723,2724,2725,2726,2727,2728and2729respectively corresponding to the plurality of boundaries, to which the plurality of external devices may be respectively mapped.

Meanwhile, the control unit170may display the areas2721,2722,2723,2724,2725and2726corresponding to the boundaries, to which the external devices are mapped, and the areas2727,2728and2729corresponding to the boundaries, to which the external devices are not mapped, to be distinguished therebetween.

FIG. 27cis a view showing movement of a remote control device and movement of a pointer corresponding to movement of the remote control device.

Here, movement of the remote control device200may be movement in a state of maintaining input to the specific button. Specifically, the user may move the remote control device200in a state of maintaining input to the specific button210of the remote control device200. In this case, the remote control device200may transmit, to the display device100, information on motion of the remote control device200in a state of maintaining input to the specific button210.

When the information on motion of the remote control device200in a state of maintaining input to the specific button210is received, the control unit170of the display device100may determine whether the pointer deviates from the area of the screen based on the information on motion of the remote control device200in a state of maintaining input to the specific button210.

Specifically, the control unit170of the display device100may receive the information on motion of the remote control device200in a state of maintaining input to the specific button210and acquire the coordinates of the pointer2710based on the information on motion of the remote control device200. In addition, when the coordinates of the pointer2710deviate from the area of the screen, the control unit170may switch input provided to the display device100to external input.

Meanwhile, although the plurality of external devices is described as being mapped to the plurality of boundaries of the area of the screen in the present embodiment, the present invention is not limited thereto. For example, the control unit170may display the directions in which the pointer deviated from the area of the screen, to which the plurality of external devices is mapped. As another example, the control unit170may display the boundaries of the area of the screen and the directions in which the pointer deviates from the area of the screen, to which the plurality of external devices is mapped.

In the present invention, external input may be switched to an external device by a simple operation. For example, the conventional method of switching to external input is performed by (1) selecting an external input button and displaying a list of external devices, (2) moving the remote control device, and (3) pressing a button in order to select an external device included in the list. In contrast, in the present invention, external input is switched by (1) the user pressing an external input button to confirm the mapping area of an external device and (2) moving the remote control device in a state of pressing the external input button, thereby providing a simpler operation environment. In addition, since the mapping areas of the external devices may be simultaneously confirmed, it is possible to improve input switching accuracy.

Meanwhile, although operation in a state of maintaining input to the specific button is described in the present embodiment, the present invention is not limited thereto.

For example, the pointer may be displayed when first input is received and input may be switched to input provided by the external device corresponding to a direction (or the boundary or the boundary and the direction), in which the pointer deviates from the screen, when the pointer deviates from the screen.

As another example, the pointer may be displayed when first input is received, icons indicating the plurality of external devices may be displayed when second input is received and input may be switched to input provided by the external device corresponding to a direction (or the boundary or the boundary and direction), in which the pointer deviates from the screen), when the pointer deviates from the screen.

As another example, the pointer and the icons indicating the plurality of external devices may be displayed when first input is received and input may be switched to input provided by the external device corresponding to the direction (or the boundary or the boundary and direction), in which the pointer deviates from the screen, when the pointer deviates from the area of the screen in a specific direction (or a specific boundary or the specific boundary and direction).

FIG. 28is a view illustrating a method of distinguishably displaying an external device corresponding to a specific boundary such that a pointer deviates from an area of a screen through the specific boundary.

In the above-described embodiments, when the pointer deviates from the area of the screen, input provided to the display device100is immediately switched to external input. However, in the present embodiment, when the pointer deviates from the area of the screen and user input of switching to the external input is received, input provided to the display device100is switched to external input.

InFIG. 28a, the plurality of external devices510,520,530,540,550,560and570mapped to the boundaries of the area of the screen of the display device100are shown. In this case, the plurality of external devices may include light output units511,521,531,541,551,561and571.

Meanwhile, when a pointer2810deviates from the area of the screen through a specific boundary among the boundaries of the area of the screen, the control unit170may transmit a light output command to the external device corresponding to the specific boundary. For example, as shown inFIG. 28a, when the pointer2810deviates from the area of the screen through a boundary2821corresponding to the PC520, the control unit170may transmit the light output command to the PC520. In this case, the control unit of the PC520may control the light output unit521of the PC520to output the light signal.

As another example, as shown inFIG. 28b, when the pointer2810deviates from the area of the screen through a boundary2822corresponding to the blu-ray player540, the control unit170may transmit the light output command to the blu-ray player540. In this case, the control unit of the blu-ray player540may control the light output unit541of the blu-ray player540to output the light signal.

Meanwhile, when user input is received in a state in which the pointer deviates from the area of the screen, the control unit170may switch input to input provided by the external device corresponding to the boundary, through which the pointer deviates from the area of the screen. For example, when a user request for switching input in a state in which the pointer2810deviates from the area of the screen through the boundary2822corresponding to the blu-ray player540such that the light output unit541of the blu-ray player540outputs the light signal, the control unit170may switch input provided to the display device100to input provided by the blu-ray player540.

FIG. 29is a view illustrating a method of switching input again in a state of switching input provided to a display device to external input.

The control unit170may switch input provided to the display device again in a state in which input provided to the display device is switched to external input.

Specifically, the control unit170may receive information on second movement of the remote control device in a state in which input provided to the display device is switched to external input.

In addition, the control unit170may acquire the coordinates of the pointer moved in correspondence with second motion of the remote control device based on the information on second movement of the remote control device.

When the pointer moved in correspondence with second motion is moved from the area outside the screen to the area of the screen or the pointer moved in correspondence with second motion is moved from the area of the screen to the area outside screen based on the coordinates of the pointer moved in correspondence with second motion of the remote control device, input provided to the display device may be switched to second external input and an image may be displayed using the second external input.

Meanwhile, when input provided to the display device is input provided by a specific external device, the control unit170may perform control to switch input provided to the display device to basic input.

For example, as shown inFIG. 29, when a virtual pointer2910located outside the area of the screen is moved to the area of the screen according to motion of the remote control device, the control unit170may switch input provided to the display device to basic input.

In this case, basic input may be input provided by the broadcast provider, that is, broadcast content.

For example, when the display device100displays broadcast content using external input (broadcast content) received from a set-top box and the virtual pointer2910located outside the area of the screen is moved to the area of the screen according to motion of the remote control device, the control unit170may switch input provided to the display device to input provided by the set-top box. When input is switched, the control unit170may display an image using input (broadcast content) provided by the set-top box.

As another example, when the display device100displays broadcast content using a broadcast signal received through the tuner131and the virtual pointer2910located outside the area of the screen is moved to the area of the screen according to motion of the remote control device, the control unit170may display broadcast content using the broadcast signal received through the tuner131.

Meanwhile, when the virtual pointer2910located outside the area of the screen is moved to the area of the screen according to motion of the remote control device and the virtual pointer2910is moved to the area of the screen through the boundary corresponding to the external device for providing input to the display device100, the control unit170may switch input provided to the display device to basic input.

For example, inFIG. 29, external input is input provided by the PC. In this case, the pointer2910is moved to the area of the screen according to motion of the remote control device200and the pointer2910is moved to the area of the screen through the boundary corresponding to the PC for currently providing input to the display device100. In this case, the control unit170may switch input provided to the display device to basic input and display an image using basic input.

Meanwhile, if input provided to the display device is input provided by a specific external device, the control unit170may perform control to switch input provided to the display device to input provided by an external device different from the specific external device.

For example, inFIG. 29, input provided by the display device100is input provided by the PC, and the image of the PC is displayed. Meanwhile, a second pointer2920is moved from the area of the screen to the area outside the screen and the second pointer2920is moved to the area outside the screen through the boundary corresponding to the USB among the boundaries of the area of the screen.

In this case, the control unit170may switch input provided to the display device from input provided by the PC to input provided by the USB. In addition, the control unit170may display an image using input provided by the USB.

Meanwhile, a plurality of boundaries for dividing all or some of the boundaries of the area of the screen may include a boundary2943corresponding to broadcast content. Meanwhile, the control unit170may display an area2950corresponding to the boundary2943corresponding to the broadcast content.

Meanwhile, when a third pointer2930is moved from the area of the screen to the area outside the screen and the third pointer2930is moved from the area of the screen to the area outside the screen through the boundary2943corresponding to the broadcast content, the control unit170may switch input provided to the display device100to the broadcast content provided by the broadcast provider and display the broadcast content.

Meanwhile, when the third pointer2930is moved from the area of the screen to the area outside the screen through the boundary2943corresponding to the broadcast content, the control unit170may display the broadcast content using the broadcast signal received through the tuner131. The present invention is not limited thereto and, when the third pointer2930is moved from the area of the screen to the area outside the screen through the boundary2943corresponding to the broadcast content, the control unit170may switch input provided to the display device100to input provided by the set-top box connected to the display device. In addition, the control unit170may receive and display the broadcast content from the set-top box.

FIG. 30is a view illustrating a method of mapping a new external device when the new external device is detected, according to an embodiment of the present invention.

InFIG. 30a, currently, the plurality of external devices510,520,530,540,550,560and570exists around the display device100and specific boundaries of the area of the screen (or specific directions in which the pointer deviates from the area of the screen or specific boundaries of the area of the screen and specific directions in which the pointer deviates from the area of the screen) are mapped to the plurality of external devices510,520,530,540,550,560and570.

Meanwhile, when a new external device580accesses the display device100, the control unit170may detect the new external device580through the communication unit173. Meanwhile, although the new external device580is a mobile phone and the control unit170detects the new external device580through wireless communication using the communication unit173in the present embodiment, the present invention is not limited thereto. For example, when a new external device such as a camcorder is connected to the display device100through a connection terminal of the external device interface unit135, the control unit170may detect the new external device using identification information received from the camcorder.

Meanwhile, when the new external device580is detected, the control unit170may display a message indicating that the new external device is detected and information3010on the new external device, as shown inFIG. 30b.

In addition, the control unit170may display a plurality of areas3081,3082,3083,3084,3085,3086,3087,3088,3089and3090respectively corresponding to a plurality of boundaries3071,3072,3073,3074,3075,3076,3077,3078,3079and3080, to which external devices may be mapped. Here, the plurality of boundaries3071,3072,3073,3074,3075,3076,3077,3078,3079and3080, to which the external devices may be mapped, may configure all or some of the boundaries of the area of the screen.

Meanwhile, the control unit170may display a plurality of areas3084,3085,3086,3087,3088,3089and3090corresponding to boundaries3074,3075,3076,3077,3078,3079and3080, to which the external devices are mapped, among the plurality of boundaries3071,3072,3073,3074,3075,3076,3077,3078,3079and3080, to which the external devices may be mapped, to be distinguished from the plurality of areas3081,3082and3083corresponding to the boundaries3071,3072and3073, to which the external devices are not mapped. For example, the control unit170may highlight the plurality of areas3081,3082and3083corresponding to the boundaries3071,3072and3073, to which the external devices are not mapped, or display the plurality of areas3081,3082and3083corresponding to the boundaries3071,3072and3073, to which the external devices are not mapped, with a darker color than the plurality of areas3084,3085,3086,3087,3088,3089and3090corresponding to the boundaries3074,3075,3076,3077,3078,3079and3080, to which the external devices are mapped.

Meanwhile, the boundaries, to which the external devices may be mapped, may be corrected. Specifically, when input of correcting the boundaries, to which the external devices may be mapped, is received, the control unit170may correct the number of boundaries, to which the external devices may be mapped, or a ratio of the length of each of the plurality of boundaries, to which the external devices may be mapped, to the total length of the boundaries.

For example, when user input of further adding one to the number of left boundaries of the area of the screen is received, as shown inFIG. 30c, the control unit170may add a new boundary3092, to which an external device may be mapped, to the left boundary of the area of the screen and change the lengths of the existing boundaries3079and3080.

In addition, the control unit170may display areas3089and3090corresponding to the existing boundaries3079and3080having the changed lengths and an area3091corresponding to the newly added boundary3092.

Meanwhile, as shown inFIG. 30d, when user input of selecting the newly detected external device is received and a pointer3020is moved to one boundary3092among the boundaries, to which the external devices are not mapped, according to motion of the remote control device200, the control unit170may map and store the new external device580to the boundary3092, through which the pointer is moved.

Meanwhile, although the new external device is mapped to one of the plurality of boundaries of the area of the screen inFIG. 30, the present invention is not limited thereto. For example, the new external device may be mapped to one of the plurality of directions, in which the pointer deviates from the area of the screen, and the new external device may be mapped to one of the plurality of boundaries of the area of the screen and one of the plurality of directions, in which the pointer deviates from the screen.

According to the present invention, it is possible to automatically detect the new external device and to provide an area, to which the new external device may be mapped, to the user.

In addition, according to the present invention, it is possible to provide an environment in which the user may flexibly change the mapping area and to provide an environment in which an external may be mapped to suit arrangement of the external devices.

FIG. 31is a view illustrating a method of operating a display device according to another embodiment of the present invention.

In the above-described embodiments, input provided to the display device is switched to external input when the pointer is moved from the area of the screen to the area outside the screen. The present invention is not limited thereto and input provided to the display device may be switched to external input when the pointer is moved to a specific area of the area of the screen.

Specifically, the area of the screen may include a first area3130and a second area3140divided by a specific boundary3110of the screen.

Here, the specific boundary3110of the screen may correspond to the boundary of the area of the screen described with reference toFIGS. 5 to 30.

That is, the whole or part of a specific boundary3110of the screen may include a plurality of boundaries, to which external devices may be mapped, and a plurality of external devices may be respectively mapped to the plurality of boundaries. In this case, when a pointer3120is moved from the first area3130to the second area3140according to motion of the remote control device200and the pointer3120is moved from the first area3130to the second area3140through a specific point of a specific boundary3110, the control unit170may switch external input to input provided by the external device corresponding to the boundary including the specific point, through which the pointer3120passes. For example, when the pointer is moved to the second area3140through the left boundary of the first area3130and a PC is mapped to the left boundary of the first area3030, the control unit170may switch input provided to the display device100to input provided by the PC.

As another example, when a plurality of external devices is mapped to a plurality of directions in which the pointer deviates from the specific boundary3110and the pointer3120is moved from the first area3130to the second area3140according to motion of the remote control device200, the control unit170may switch external input to input provided by the external device corresponding to the direction in which the pointer3120deviates from the specific boundary3110.

As another example, when the external device is mapped to the boundary and direction in which the pointer deviates from the specific boundary3110and the pointer3120is moved from the first area3130to the second area3140according to motion of the remote control device200, the control unit170may switch external input to input provided by the external device corresponding to the boundary and direction in which the pointer3120deviates from the specific boundary3110.

FIG. 32is a view illustrating an operation method when one boundary corresponds to a plurality of external devices.

In the above-described embodiments, one external device is mapped to one boundary. For example, inFIG. 31, only the PC is mapped to the left boundary of the first area3130.

The present invention is not limited thereto and a plurality of external devices may be mapped to one boundary.

For example, as shown inFIG. 32, if the area of the screen includes a first area3250and a second area3260divided by a specific boundary3240of the screen, a USB, a PC and a mobile phone may be mapped to the left boundary3241of the first area3250.

Meanwhile, when a pointer3220is moved from the first rea3250to the second area3260according to motion of the remote control device200and the pointer3220is moved through the left boundary3241of the first area3250, the control unit170may display a list of external devices (the USB, the PC and the mobile phone) mapped to the left boundary3241of the first area3250.

When input of selecting one of the plurality of external devices (the USB, the PC and the mobile phone) is received, the control unit170may switch input provided to the display device to input provided by the external device selected by the user and display an image using input provided by the selected external device.

FIG. 33is a view illustrating a method of operating a display device according to another embodiment of the present invention.

InFIG. 33, the USB, the PC and the mobile phone are mapped to the left boundary of the first area as described with reference toFIG. 32. However, unlikeFIG. 32, the left boundary of the first area may include a boundary corresponding to the USB, a boundary corresponding to the PC and a boundary corresponding to the mobile phone.

Meanwhile, as shown inFIG. 32, when the pointer3220is moved from the first area3250to the second area3260according to motion of the remote control device200and the pointer3220is moved through the left boundary3241of the first area3250, the control unit170may display areas3321,3322and3323respectively corresponding to the plurality of boundaries included in the left boundary3241of the first area3250and a plurality of icons3331,3332and3333indicating a plurality of devices respectively corresponding to the plurality of boundaries.

Meanwhile, when used input is received a pointer3310is moved to the area3321corresponding to the USB or the icon3310indicating the USB according to motion of the remote control device200or user input is received after movement to the icon3310indicating the USB in a state in which the areas3321,3322and3323respectively corresponding to the plurality of boundaries and a plurality of icons3331,3332and3333indicating the plurality of devices are displayed, the control unit170may switch input provided to the display device to input provided by the USB and display an image using input provided by the USB.

FIG. 34is a view illustrating a mapping method of an external device according to another embodiment of the present invention.

InFIG. 34a, the display device100may communicate with a plurality of external devices. In addition, the control unit170may acquire the locations of the plurality of external devices.

Specifically, the control unit170may display a list of external devices which may communicate with the display device100.

Meanwhile, when input of selecting a specific external device from among a plurality of external devices is received, the control unit170may output a command for directing the remote control device to the specific external device selected by the user.

Meanwhile, when the user of the remote control device200directs the remote control device200to the specific external device according to the command for directing the remote control device200to the specific external device, the control unit170may acquire information on the location of the specific external device relative to the display device100.

For example, when a PC is selected from among a plurality of external devices and the remote control device200is directed to an area3410in which the PC is located, the control unit170may calculate the coordinates of a virtual pointer3420corresponding to motion of the remote control device and determine that the PC is located at the left side of the display device based on the calculated coordinates of the virtual pointer3240.

In this case, the control unit170may map and store the PC to the left boundary of the screen of the display device. In addition, when input of confirming the mapping state of the external device is received, the control unit170may display an area3430corresponding to the left boundary, to which the PC is mapped, and an icon3440indicating the PC, as shown inFIG. 34b.

Meanwhile, inFIG. 34, the display device determines the location of the external device relative to the display device and maps the external device to the boundary of the area of the screen in the direction in which the external device is located.

The present invention is not limited thereto and the location of the external device is mapped and input provided to the display device may be switched to input provided by the external device when the pointer is moved from the area of the screen to an area in which the external device is located.

This will be described in detail with reference toFIG. 35.

FIG. 35is a view illustrating a method of mapping the location of an external device and switching input according to movement of a pointer according to another embodiment of the present invention.

As described with reference toFIG. 34, when the user directs the remote control device200to the specific external device, the control unit170may acquire information on the location of the specific external device relative to the display device100. For example, when a PC is selected from among the plurality of external devices and the remote control device200is directed to an area in which the PC is located, the control unit170may calculate the coordinates of a virtual pointer corresponding to motion of the remote control device and acquire the coordinates of the area, in which the PC is located, based on the calculated coordinates of the virtual pointer.

Meanwhile, inFIG. 35a, broadcast content is currently displayed and a pointer3510is displayed.

Meanwhile, the coordinates of the pointer may be changed according to motion of the remote control device200. That is, when the remote control device200is moved from the area of the screen to the area outside the screen, the control unit170may acquire the coordinates of a virtual pointer3520corresponding to motion of the remote control device200.

Meanwhile, inFIG. 35b, the control unit170may determine whether the coordinates of the virtual pointer3520coincide with the coordinates of the area3530in which the PC520is located.

When the coordinates of the virtual pointer3520coincide with the coordinates of the area3530in which the PC520is located, the control unit170may output a light output command to the PC520. In this case, the control unit of the PC520, which has received the light output command, may control the light output unit521to output a light signal.

Meanwhile, when user input is received in a state in which the coordinates of the virtual pointer3520coincide with the coordinates of the area3530in which the PC520is located, the control unit170may switch input provided to the display device100to input provided by the PC and display an image using input provided by the PC, as shown inFIG. 35C.

FIG. 36is a flowchart illustrating a method of operating a display device according to another embodiment of the present invention.

InFIG. 36, the method of operating the display device according to the embodiment of the present invention may include step S3610of receiving a first control signal including information on motion of the remote control device from the remote control device, step S3620of switching input provided to the display device to external input when the pointer moved in correspondence with motion of the remote control device is moved from the area of the screen to the area outside the screen, step S3630of receiving a first image from a first external device for providing input to the display device when input is switched and displaying the first image, step S3640of receiving a second control signal from the remote control device, step S3650of transmitting a command to the first external device based on the second control signal, step S3660of receiving a second image from the first external device controlled according to the command and step S3670of displaying the second image.

The method described with reference toFIGS. 2 to 35is equally applied to step S3610of receiving the first control signal including information on motion of the remote control device from the remote control device and step S3620of switching input provided to the display device to external input when the pointer moved in correspondence with motion of the remote control device is moved from the area of the screen to the area outside the screen may use, a detailed description of which will be omitted.

Meanwhile, the method of operating the display device according to another embodiment of the present invention is divided into three embodiments and each step described with reference toFIG. 36will be described.

Specifically,FIGS. 37 to 45show an embodiment in which an external device is controlled by displaying a pointer corresponding to a remote control device on the display unit of the external device when the display unit is installed in the external device for providing input to the display device100andFIGS. 46 to 47show an embodiment in which an external device is controlled when a display unit is not installed in the external device for providing input to the display device100. In addition,FIGS. 48 to 50show an embodiment in which an external device is controlled using an image displayed on the display device100when a display unit is installed in the external device.

First, the embodiment ofFIGS. 37 to 45, that is, the embodiment in which the external device is controlled by displaying the pointer corresponding to the remote control device on the display unit of the external device when the display unit is installed in the external device for providing input to the display device100, will be described.

FIG. 37is a view illustrating a method of receiving and displaying an image from an external device for providing input to a display device according to an embodiment of the present invention.

The method of operating the display device according to the embodiment of the present invention may include step S3630of receiving a first image from a first external device for providing input to the display device when input is switched, and displaying the first image.

Specifically, when the pointer is moved from the area of the screen to the area outside the screen, input may be switched to input provided by an external device corresponding to a direction in which the pointer deviates from the area of the screen, an external device corresponding to a boundary, through which the pointer deviates from the area of the screen, or a boundary and direction in which the pointer deviates from the area of the screen. If the external device is a first external device, the control unit170may switch input provided to the display device100to input provided by the first external device570among the plurality of external devices communicating with the display device.

Here, assume that the first external device is a laptop.

In this case, the control unit170may receive an image from the first external device570and control the display unit180to display the received image3710.

Here, the image received from the first external device570may be an image3760displayed on the screen of the first external device570. That is, the image3710displayed on the display device100may be equal to the image3760displayed on the first external device.

FIG. 38is a view illustrating a method of displaying an image received from an external device and a pointer or another image.

As shown inFIG. 38, the control unit170may control the display unit180to display a pointer3810along with the image3710received from the first external device570. Here, the pointer3810may be moved in correspondence with motion of the remote control device200.

In addition, the control unit170may display another image3820along with the image3710received from the first external device570.

The other image3820may be an image received from a server, such as a web browser image, as shown inFIG. 38a.

The present invention is not limited thereto and the other image3820may include all images such as broadcast content received through the tuner131, an image received from another external device and an OSD menu generated by the display device100.

Returning toFIG. 36, the method of operating the display device according to the embodiment of the present invention may include step S3640of receiving the second control signal from the remote control device and step S3650of transmitting the command to the first external device based on the second control signal. This will be described in detail with reference toFIGS. 39 and 40.

FIGS. 39ato 39dare views illustrating a method of receiving the second control signal from the remote control device and transmitting the command to the first external device based on the second control signal according to an embodiment of the present invention.

InFIG. 39a, the control unit170may receive a control signal from the remote control device200. Here, the control signal received from the remote control device200may include information on motion of the remote control device200.

In this case, the control unit170may display a pointer3810moved in correspondence with motion of the remote control device200. For example, when the remote control device200is moved in a state of displaying the pointer3810as shown inFIG. 39a, the pointer3810may be moved and displayed in correspondence with motion of the remote control device200as shown inFIG. 39b.

Meanwhile, the control unit170may determine whether the pointer is moved from the area of the screen to the area outside the screen based on information on motion of the remote control device200.

In addition, when the pointer is moved from the area of the screen to the area outside the screen, the control unit170may acquire the coordinates of a pointer3911in an area3910corresponding to the screen of the first external device570, as shown inFIG. 39c. Here, the pointer3911moved to the area outside the screen does not mean the pointer displayed on the screen but means a virtual pointer.

In addition, the control unit170may transmit a command to the first external device570. Specifically, the control unit170may transmit the coordinates of the pointer3911in the area3910corresponding to the screen of the first external device570to the first external device570. In addition, the control unit170may transmit, to the first external device570, a command for displaying a pointer at the coordinates on the screen of the first external device570corresponding to the coordinates of the pointer3911in the area3910corresponding to the screen of the first external device570.

Meanwhile, when the command for displaying the pointer on the screen of the first external device570and the coordinates of the pointer3911in the area3910corresponding to the screen of the first external device570are received, the control unit of the first external device570may display a pointer3961based on the coordinates of the pointer3911in the area3910corresponding to the screen of the first external device570.

Here, the location of the pointer391in the area3910corresponding to the screen of the first external device570may correspond to the location of the pointer3961on the screen of the first external device570. For example, if the coordinates of the pointer3911in the area3910corresponding to the screen of the first external device570are (x, y)=(30,270), the coordinates of the pointer3961displayed on the screen of the first external device570may be equally (x, y)=(30,270).

In addition, as shown inFIG. 39d, when the pointer3911in the area3910corresponding to the screen of the first external device570is moved, the control unit170of the display device100may transmit the changed coordinates of the pointer3911in the area3910corresponding to the screen of the first external device570to the first external device570.

In this case, the first external device570may display the pointer3961at a location corresponding to the location of the pointer3911in the area3910corresponding to the screen of the first external device570.

For example, if the coordinates of the pointer3911in the area3910corresponding to the screen of the first external device570are (x, y)=(690,270), the coordinates of the pointer3961displayed on the screen of the first external device570may be equally (x, y)=(690,270).

FIGS. 40ato 40eare views illustrating an area corresponding to a screen of a first external device according to various embodiments of the present invention.

InFIG. 40a, the area corresponding to the screen of the first external device570may be an area having a point, through which the pointer deviates from the screen, as the center of one side thereof. For example, when the pointer8310deviates from the screen through a specific point4010, the center of one side4021of the area4020corresponding to the screen of the first external device570may be a specific point4010, through which the pointer8310deviates from the screen. In addition, the width of the area4020corresponding to the screen of the first external device570may be equal to that of the screen of the first external device570, and the height of the area4020corresponding to the screen of the first external device570may be equal to that of the screen of the first external device570.

In addition, although one side4021of the area4020corresponding to the screen of the first external device570is described as being in contact with the display device100in the present embodiment, the present invention is not limited thereto. For example, the center of one side4021of the area4020corresponding to the screen of the first external device570may be located at a point deviating from the specific point4010, through which the pointer8310deviates from the screen, by a specific distance in a direction horizontal to the ground.

InFIG. 40b, the area corresponding to the screen of the first external device570may be formed at a location corresponding to the boundary, to which the first external device570is mapped. For example, if the first external device570corresponds to a boundary a of a plurality of boundaries of the area of the screen (that is, if the first external device570is mapped to the boundary a), the area4020corresponding to the screen of the first external device570may be located in an area deviating from the boundary a by a specific distance in a direction horizontal to the ground. The present invention is not limited thereto and, as shown inFIG. 40b, the area4020corresponding to the screen of the first external device570may be formed such that one side4021of the area4020corresponding to the screen of the first external device570is in contact with the boundary a.

InFIG. 40c, if the first external device570corresponds to a specific direction of a plurality of direction in which the pointer deviates from the area of the screen (that is, if the first external device570is mapped to a specific direction), the area corresponding to the screen of the first external device570may be located in a specific direction from the display device100. For example, if the first external device570is mapped to a direction b among the plurality of directions in which the pointer deviates from the area of the screen, the area4020corresponding to the screen of the first external device570may be located in the direction b of the display device100.

InFIG. 40d, if the first external device570corresponds to a specific boundary of the plurality of the boundaries of the screen and a specific direction of the plurality of directions in which the pointer deviates from the screen (that is, if the first external device570is mapped to the specific boundary and the specific direction), the area corresponding to the screen of the first external device570may be located at the specific boundary in the specific direction. For example, if the first external device570is mapped to a boundary c and a direction d, the area4020corresponding to the screen of the first external device570may be formed at a location corresponding to the boundary c in a direction corresponding to the direction d.

Meanwhile, inFIG. 34, the method of acquiring the coordinates of the specific external device by directing the remote control device200to the specific external device was described.

In this case, as shown inFIG. 40e, the area corresponding to the screen of the first external device570may be an area centered on the coordinates of the first external device570.

For example, when the coordinates of the specific external device are acquired by directing the pointer of the remote control device200to a specific point4051, the area4020corresponding to the screen of the first external device570may be an area centered on the specific point4051.

Meanwhile, in addition to the description ofFIGS. 40ato 40e, the area corresponding to the screen of the first external device may be formed in an arbitrary area among the areas outside the screen of the display device100.

Meanwhile, as shown inFIGS. 40ato 40e, the size of the area corresponding to the screen of the first external device570may be equal to that of the screen of the first external device570.

Specifically, the control unit170may receive information on the size of the screen of the first external device570from the first external device570.

In addition, based on the information on the size of the screen of the first external device570, the control unit170may set the area corresponding to the first external device570having the same size (that is, the same width and the same height) as the screen of the first external device570.

Meanwhile, although the size of the area corresponding to the screen of the first external device570is described as being equal to that of the screen of the first external device570, the present invention is not limited thereto. This will be described in detail with reference toFIG. 41.

FIG. 41is a view illustrating an area corresponding to a screen of a first external device and a coordinate transformation method.

The size of the area corresponding to the screen of the first external device570may be different from that of the screen of the first external device570. For example, as shown inFIG. 41, the size of the area4020corresponding to the screen of the first external device570may be equal to that of the screen of the display device100.

Meanwhile, the control unit170may receive information on the size of the screen of the first external device570from the first external device570.

Specifically, the control unit170may receive the information on the size of the screen of the first external device570, when the display device100and the first external device570are connected.

Meanwhile, the control unit170may transform the coordinates of the pointer in the area4020corresponding to the screen of the first external device570into the coordinates of the pointer on the screen of the first external device570, based on the information on the size of the screen of the first external device570.

Specifically, as shown inFIG. 41, if the size of the area4020corresponding to the screen of the first external device570is equal to the size of the screen of the display device100, the control unit170may transform the coordinates of the pointer in the area4020corresponding to the screen of the first external device570into the coordinates of the pointer on the screen of the first external device570, based on the size of the screen of the display device100and the size of the screen of the first external device570.

For example, assume that the width of the screen of the display device100is three times the width of the screen of the first external device570and the height of the screen of the display device100is 2.5 times the height of the screen of the first external device570.

In this case, if the coordinates of the pointer4110in the area4020corresponding to the screen of the first external device570are (x, y)=(90,540), the control unit170may transform the x coordinate in the area4020corresponding to the screen of the first external device570into the x coordinate of the screen of the first external device570using a ratio of the width of the screen of the first display device100to the width of the screen of the first external device570and transform the y coordinate in the area4020corresponding to the screen of the first external device570into they coordinate of the screen of the first external device570using a ratio of the height of the screen of the first display device100to the height of the screen of the first external device570.

Therefore, the control unit170may acquire the transformed coordinates (x, y)=(90,540) and transmit the transformed coordinates to first external device570, and the first external device570, which has received the transformed coordinates, may display a pointer4120at a point corresponding to the transformed coordinates.

In addition, when the pointer4110in the area4020corresponding to the screen of the first external device570is moved such that the coordinates of a new pointer4115are (x, y)=(960,270), the control unit170may acquire and transmit the transformed coordinates (x, y)=(320,108) to the first external device570, and the first external device570may display a new pointer4125at a point corresponding to the transformed coordinates.

Meanwhile, although the coordinates are described as being transformed based on the size of the screen of the display device100and the size of the screen of the first external device570in the present embodiment, the present invention is not limited thereto.

Specifically, when the display device100and the first external device570are connected, the control unit170may receive information on resolution of the display unit of the first external device570from the first external device570.

Alternatively, the control unit170may acquire information on the resolution of the first external device570based on the resolution of the image received from the first external device570when the image is received from the first external device570.

In this case, the control unit170may transform the coordinates of the pointer in the area4020corresponding to the screen of the first external device570into the coordinates of the pointer on the screen of the first external device570based on the resolution of the display unit180of the display device100and the resolution of the display unit of the first external device570. This transformation method is equal to the transformation method using the size of the screen and a detailed description thereof will be omitted.

Meanwhile, although the size of the area4020corresponding to the screen of the first external device570is described as being equal to that of the screen of the display device100in the present embodiment, the present invention is not limited thereto and the size of the area4020corresponding to the screen of the first external device570may be different from that of the size of the screen of the display device100.

Even in this case, the control unit170may transform the coordinates of the pointer in the area4020corresponding to the screen of the first external device570into the coordinates of the pointer on the screen of the first external device570, based on the size of the area4020corresponding to the screen of the first external device570and the size of the screen of the first external device570, as described above.

Specifically, the control unit170may transform the x coordinate of the pointer in the area4020corresponding to the screen of the first external device570into the x coordinate of the pointer on the screen of the first external device570using a ratio of the width of the area4020corresponding to the screen of the first external device570to the width of the screen of the first external device570, and the control unit170may transform they coordinate of the pointer in the area4020corresponding to the screen of the first external device570into they coordinate of the pointer on the screen of the first external device570using a ratio of the height of the area4020corresponding to the screen of the first external device570to the height of the screen of the first external device570

Returning toFIG. 36, the method of operating the display device100according to the embodiment of the present invention may include step S3660of receiving the second image from the first external device controlled according to the command and step S3670of displaying the second image.

This will be described in detail with reference toFIG. 42.

FIG. 42is a view illustrating a method of, at a display device, receiving and displaying an image displayed on a screen of a first external device.

As described with reference toFIG. 37, when input provided to the display device100is switched to input provided by the first external device, the first external device570may provide an image to the display device100and the display device100may receive and display the image from the first external device570.

As described with reference toFIG. 37, the display device100may receive and display the image displayed on the screen of the first external device570.

Meanwhile, as described with reference toFIGS. 39 to 41, the first external device570may receive the coordinates of the pointer and display the pointer4210at the location corresponding to the received coordinates.

In this case, the first external device570may transmit an image4210including the pointer4211to the display device100.

In this case, the control unit170of the display device100may receive the image4210including the pointer4211from the first external device570. In addition, the control unit170may control the display unit180to display the received image4220.

That is, since the display device100displays the image4210including the pointer4211without change, a pointer4221corresponding to the pointer4211displayed on the first external device570is displayed on the screen of the display device100without change.

FIGS. 43 to 44are views illustrating a method of selecting an area where a pointer is located on a screen of a first external device according to an embodiment of the present invention.

As shown inFIG. 43, a pointer4312displayed on the screen of the first external device is located in a specific area of the screen of the first external device.

In this case, the user may click a button for selecting the area where the pointer4312is located, which is included in the remote control device200.

Specifically, the remote control device200may include a button corresponding to an input device of each of the plurality of external devices. For example, if the first external device570is a laptop, the remote control device200may include buttons corresponding to the buttons (at least one of a left click button, a right click button and a wheel button) of a mouse which is an input device of the first external device570.

That is, the button for selecting the area, in which the pointer4312is located, on the remote control device200may be a button corresponding to the left click button of the mouse which is the input device of the first external device570.

Meanwhile, the remote control device200may transmit a control signal corresponding to input of selecting the area, in which the pointer4312is located, to the display device100.

Meanwhile, when the control signal corresponding to input of selecting the area, in which the pointer4312is located, is received from the remote control device200, the control unit170of the display device100may transmit a command for selecting the area, in which the pointer4312is located, to the first external device570based on the received control signal.

Meanwhile, the control unit of the first external device570may control the first external device570based on the command for selecting the area, in which the pointer4312is located.

For example, when the command for selecting the area, in which the pointer4312is located, is received, the control unit of the first external device570may perform operation of selecting the area, in which the pointer4312is located. That is, the first external device570may perform the same operation as operation of selecting the area, in which the pointer4312is located, through the left click button of the mouse.

In this case, a web browsing icon4311is displayed in the area, in which the pointer4312is located. Accordingly, when the area, in which the pointer4312is located, is selected, the control unit of the first external device570may control the first external device570by executing a web browser.

In addition, the control unit of the first external device570may control the first external device570, by displaying an image4410of the executed web browser, as shown inFIG. 44.

In addition, the control unit of the first external device570may transmit, to the display device100, an image4410displayed on the first external device570controlled based on the command for selecting the area, in which the pointer4312is located.

Meanwhile, the control unit170of the display device100may receive an image4420provided by the first external device570controlled based on the command for selecting the area, in which the pointer4312is located, and display the received image4420.

Meanwhile, although movement of the pointer and selection of the area, in which the pointer is located, are described in the present embodiment, the present invention is not limited thereto.

Specifically, the remote control device200may include a button corresponding to a button of another input device (or an input unit) excluding the mouse among the input devices (or the input units) of the laptop. For example, the remote control device200may include a button corresponding to a power button configuring the input unit installed in the laptop. Meanwhile, when the pointer corresponding to motion of the remote control device200deviates from the screen of the display device100to be located in the area corresponding to the screen of the first external device570such that the pointer is displayed on the screen of the laptop, the remote control device200may receive input of selecting the button of the remote control device200corresponding to the power button of the laptop. In addition, the control unit170of the display device100may receive a control signal corresponding to selected input from the remote control device200. In addition, the control unit170of the display device100may transmit a control command corresponding to the selected input to the laptop and the laptop may power the laptop off according to the received control command.

As another example, if the external device is a blu-ray player, a button corresponding to the button of the remote control device which is the input device of the blu-ray player or a button corresponding to the button installed in the blu-ray player may be included in the remote control device200of the display device100. Using the same method as the above-described method, the blu-ray player may be controlled using the remote control device200of the display device100.

For example, when input of selecting the button of the remote control device200corresponding to a fast forward button of the blu-ray player is received, the remote control device200may transmit a control signal corresponding to the selected input to the display device100. Meanwhile, the control unit170of the display device100may transmit a control command corresponding to the selected input to the blu-ray player, and the blu-ray player may perform fast forward operation with respect to the currently output video according to the received control command.

In addition, when the blu-ray player performs fast forward operation, video (fast forwarding video) provided by the blu-ray player for performing fast-forwarding operation may be transmitted to the display device100, and the control unit170of the display device100may display the fast-forwarding video.

In addition, although the button of the remote control device200corresponding to the left click button of the mouse which is the input device of the laptop is described as being selected to control the laptop in the present embodiment, the present invention is not limited thereto. For example, the button of the remote control device200corresponding to the right click button of the mouse or the button of the remote control device200corresponding to the wheel button of the mouse may be selected to control the laptop.

In addition, the button installed in the remote control device200to correspond to the button included in the input device of the external device may be provided separately from the button for controlling the display device100.

The present invention is not limited thereto and the button provided in the remote control device200for controlling the display device100may be the same button as the button provided in the remote control device200to control the first external device570. That is, control of the display device100and control of the first external device570may be performed using user input to the same button.

Specifically, the control unit100of the display device100may determine whether a control mode using the remote control device200is a mode for controlling the first external device570or a mode for controlling the display device100.

More specifically, the control unit100of the display device100may determine that input to the button provided in the remote control device200is input of controlling the display device100when the pointer corresponding to motion of the remote control device200is located in the area of the screen of the display device100. That is, when the pointer corresponding to motion of the remote control device200is located in the area of the screen of the display device100and a control signal is received from the remote control device200, the control unit170of the display device100may control the display device100based on the received control signal.

In addition, when the pointer corresponding to motion of the remote control device200deviates from the screen of the display device100to be located in the area corresponding to the screen of the first external device570such that the pointer is displayed on the screen of the first external device570, the control unit170of the display device100may determine that input to the button provided in the remote control device200is input of controlling the first external device570. That is, when the pointer is displayed on the screen of the first external device570and a control signal is received from the remote control device200, the control unit170of the display device100may transmit a control command corresponding to the received control signal to the first external device570to control the first external device570.

For example, when the pointer corresponding to motion of the remote control device200is located in the area of the screen of the display device100and a volume up button provided in the remote control device200is selected by the user, the control unit170of the display device100may raise the volume of the display device100. In contrast, when the pointer is displayed on the screen of the first external device570and the volume up button provided in the remote control device200is selected by the user, the control unit170of the display device100may transmit a volume up command to the first external device570. In this case, the first external device570may raise the volume of the first external device570according to the received command.

As another example, a specific button provided in the remote control device200may function as a button for changing the channel of the display device100when the pointer is located in the area of the screen of the display device100and as a button for controlling the brightness of the image displayed on the first external device570when the pointer is displayed on the screen of the first external device570.

Meanwhile, although the button corresponding to the button included in the input device (the input unit) of the external device is described as being provided in the remote control device200, the present invention is not limited thereto. For example, if the first external device570is a laptop, a UI corresponding to the button included in a keyboard which is an input device of the laptop may be displayed on the display device100. That is, the UI corresponding to the button included in the input device of the external device may be displayed on the display device100, and the external device may be controlled by selecting the UI displayed on the display device100. This will be described in detail below.

FIGS. 45ato 45bare views illustrating an operation method when a pointer moved to an area outside a screen moves back to an area of the screen according to an embodiment of the present invention.

Currently, a pointer4441is located in an area outside the screen of the display device100and is located in an area4430corresponding to the screen of the first external device570. Accordingly, the pointer4411is displayed in the area of the screen of the first external device570corresponding to the location of a virtual pointer4441in the area4430corresponding to the screen of the first external device570.

In addition, as described with reference toFIG. 44, the display device100is changed to the mode for controlling the first external device570. Therefore, it is determined that the control signal received by the remote control device200is a signal for controlling the first external device570, and a control command corresponding to the control signal received by the remote control device200is being transmitted to the first external device570.

Meanwhile, when the virtual pointer4441located in the area outside the screen is moved to the area of the screen again, the control unit170of the display device100may display a pointer4442corresponding to motion of the remote control device200on the screen of the display device100, as shown inFIG. 45b.

Meanwhile, as the pointer corresponding to motion of the remote control device200is moved from the area outside the screen to the area of the screen or as the pointer4442corresponding to motion of the remote control device200is displayed on the screen of the display device100, the control unit170of the display device100may change the operation mode from the mode for controlling the first external device570to the operation mode for controlling the display device100.

Specifically, when the pointer corresponding to motion of the remote control device200is moved from the area4430outside the screen of the display device100to the area of the screen of the display device100, the control unit170of the display device100may determine that input to the button provided in the remote control device200is input of controlling the display device100. That is, when the control signal is received from the remote control device200, the control unit170may control the display device100based on the received signal.

In this case, all operations for controlling the display device100using the remote control device200may be performed. In addition, operation of switching the external device for providing input to the display device100described with reference toFIGS. 2 to 35may also be performed.

Meanwhile, although the control method when the external device for providing input to the display device100is switched to the first external device is described in the embodiments ofFIGS. 37 to 45, the present invention is not limited thereto.

For example, as described with reference toFIGS. 2 to 35, when the pointer is moved from the area of the screen to the area outside the screen such that the external device for providing input to the display device100is switched to the first external device, the control unit170of the display device100may control the first external device described with reference toFIGS. 37 to 45while the external device for providing input to the display device100is switched to the first external device.

In the present invention, it is possible to control all external devices for providing input to a TV only using the remote controller of the TV without operating an external device through an input unit installed in the external device, operating the external device using a remote controller capable of controlling the external device or operating the external device using an integrated remote controller capable of controlling not only the TV but also the external device.

In addition, in the present invention, it is possible to intuitively control the external device for providing input to the display device, by directly displaying the pointer moved in correspondence with the remote controller of the TV on the external device for providing input to the display device.

In addition, in the present invention, since the external device for providing input to the TV is changed and, at the same time, the pointer is displayed on the external device to control the external device, it is possible to easily perform input switching and control of the external device through only one operation.

In addition, in the present invention, it is possible to easily control the pointer displayed on the external device having a relatively small screen using the remote controller for controlling the TV having a relatively large screen, by providing coordinates transformed in consideration of the resolution or size of the screen when the display device provides the coordinates of the pointer to the external device.

In addition, in the present invention, when the external device is controlled by operating the remote controller of the TV, the image provided by the controlled external device is displayed on the TV. Therefore, the user can confirm the control situation through the screen of the external device and confirm the control situation of the external device through the screen of the TV.

Referring toFIGS. 36, 46 and 47again, a method of controlling an external device when a display unit is not installed in the external device for providing input to the display device100will be described.

InFIG. 36, all the methods described with reference toFIGS. 2 to 35are equally applied to step S3610of receiving the first control signal including information on motion of the remote control device from the remote control device and step S3620of switching input provided to the display device to external input when the pointer moved in correspondence with motion of the remote control device is moved from the area of the screen to the area outside the screen, a detailed description of which will be omitted.

Meanwhile, the method of operating the display device according to another embodiment of the present invention may include step S3630of receiving the first image from the first external device for providing input to the display device when input is switched, and displaying the first image.

This will be described in detail with reference toFIG. 46.

FIG. 46is a view illustrating operation when an external device for providing input to a display device100to a second external device which does not include a display device.

Specifically, when the pointer is moved from the area of the screen to the area outside the screen, input may be switched to input provided by an external device corresponding to a direction in which the pointer deviates from the area of the screen, an external device corresponding to a boundary, through which the pointer deviates from the area of the screen, or an external device corresponding to a boundary and direction, in which the pointer deviates from the area of the screen. In this case, if the external device is a second external device550, the control unit170may switch input provided to the display device100to input provided by the second external device550among the plurality of external devices communicating with the display device.

Here, assume that the second external device is a set-top box.

The second external device220may output an image to the display device100and the control unit170of the display device100may control the display unit180to receive the image output from the second external device550and to display the received image4610.

Meanwhile, the second external device550is a set-top box which does not include a display unit and may only output an image.

Returning toFIG. 36, the method of operating the display device according to the embodiment of the present invention may include step S3640of receiving a second control signal from the remote control device, step S3650of transmitting a command to the first external device based on the second control signal, step S3660of receiving a second image from the first external device controlled according to the command and step S3670of displaying the second image.

The control unit170may receive a control signal corresponding to input of controlling the second external device550from the remote control device200.

Specifically, the remote control device200may include a button corresponding to a button configuring the input device (or the input unit) of the second external device550.

For example, if the input device of the second external device550is a second remote control device, the button corresponding to the button of the second remote control device which is the input device of the second external device550may be included in the remote control device200. As another example, if an input unit including a button is installed in the second external device550, the button corresponding to the button included in the input unit of the second external device500may be included in the remote control device200.

Meanwhile, the button provided in the remote control device200in order to control the display device100and the button of the remote control device200corresponding to the button of the second remote control device may be equal to each other.

Meanwhile, the control unit170of the display device100may determine whether the control mode using the remote control device200is a mode for controlling the second external device550or a mode for controlling the display device100.

Specifically, if the pointer corresponding to motion of the remote control device200is located in the area of the screen of the display device100, the control unit100of the display device100may determine that input to the button provided in the remote control device200is input of controlling the display device100.

In contrast, if the pointer corresponding to motion of the remote control device200is located in the area outside the screen of the display device100, the control unit100of the display device100may determine that input to the button provided in the remote control device200is input of controlling the second external device550.

When the control mode using the remote control device200is the mode for controlling the second external device550and user input of selecting a specific button of the plurality of buttons of the remote control device200respectively corresponding to the plurality of buttons of the second remote control device is received, the remote control device200may transmit a control signal corresponding to the user input of selecting the specific button to the display device100.

In addition, when the control signal corresponding to the user input of selecting the specific button is received from the remote control device200, the control unit170of the display device100may transmit a control command corresponding to the user input of selecting the specific button to the second external device550and the second external device550may control the second external device according to the received control command.

For example, when user input of selecting a specific button of the remote control device100corresponding to a channel change button of the second remote control device is received, the remote control device200may transmit a control signal corresponding to the user input of selecting the specific button to the display device100. In this case, the control unit170may transmit a control command for changing the channel to the second external device550based on the received control signal.

Meanwhile, the control unit of the second external device500may control the second external device500according to the received control command. For example, the control unit of the second external device550may receive broadcast content of the changed channel according to the received channel change command and provide the broadcast image of the changed channel to the display device100.

Meanwhile, the control unit170of the display device100may receive the controlled image (the broadcast image of the changed channel) based on the control command for controlling the second external device550and control the display unit180to display the received image.

FIGS. 47ato 47bare views illustrating a method of controlling an external device when a second external device does not include a display device, according to another embodiment of the present invention.

When specific input is received in a state in which input provided to the display device100is switched to input provided by the second external device550, the control unit170of the display device100may display one or more Uls4711,4712,4713,4714and4715for controlling the second external device550.

Specifically, when the remote control device200receives specific input of controlling the second external device550, the remote control device200may transmit a signal corresponding to the specific input to the display device100.

When the signal corresponding to the specific input is received, the control unit170of the display device100may display one or more Uls4711,4712,4713,4714and4715for controlling the second external device550.

Here, one or more Uls4711,4712,4713,4714and4715for controlling the second external device550may correspond to the buttons installed in the input device of the second external device500.

For example, if the remote controller of the set-top box includes a power button, a channel change button, a volume button, a menu button and an exit button, one or more Uls4711,4712,4713,4714and4715for controlling the second external device550may correspond to the power button, the channel change button, the volume button, the menu button and the exit button provided in the remote controller of the set-top box, respectively.

Meanwhile, as shown inFIG. 47b, when a specific UI4712is selected from among one or more Uls4711,4712,4713,4714and4715by user input as a pointer4720is moved, the control unit100of the display device100may transmit a control command corresponding to the selected specific UI4712to the second external device550. For example, if a channel up UI is selected, the control unit100of the display device100may transmit a channel up command to the second external device550.

Meanwhile, the control unit of the second external device550may control the second external device550based on the command received from the display device100. For example, when the channel up command is received from the display device100, the control unit of the second external device550may receive broadcast content corresponding to a channel of a higher number. In addition, the second external device500may transmit the broadcast content corresponding to the channel of the higher number to the display device100, and the control unit170of the display device100may control the display unit180to display the image of the received broadcast content.

The present invention provides an environment in which the external device can be easily controlled using the remote controller of the TV even when the external device does not include a display unit.

Referring toFIGS. 36 and 48 to 50again, the method of controlling the external device using the image displayed on the display device100when the display unit is installed in the external device according to another embodiment of the present invention will be described.

InFIG. 36, all the methods described with reference toFIGS. 2 to 35are equally applied to step S3610of receiving the first control signal including the information on motion of the remote control device from the remote control device and step S3620of switching input provided to the display device to external input when the pointer moved in correspondence with motion of the remote control device is moved from the area of the screen to the area outside the screen, a detailed description of which will be omitted.

FIG. 48is a view illustrating operation when a third external device for providing input to a display device100is a mobile phone.

The method of operating the display device according to another embodiment of the present invention may include step S3630of receiving a first image from a third external device for providing input to the display device when input is switched and displaying the first image.

Specifically, the control unit170may receive an image from the third external device580(mobile phone) and control the display unit180to display the received image4820.

Here, the image received from the third external device580may be an image4810displayed on the screen of the third external device580. That is, the image4820displayed on the display device100and the image4810displayed on the third external device580may be equal to each other

Accordingly, if the image4810displayed on the third external device580includes one or more icons4811,4812,4813,4814,4815,4816,4817,4818and, the image4820displayed on the display device100may also include one or more icons4821,4822,4823,4824,4825,4826,4827,4828and4829.

Meanwhile, the control unit170of the display device100may display an UI4830corresponding to a button installed in the third external device580.

For example, the third external device580is a mobile phone. When a first button capable of raising the volume, a second button capable of lowering the volume and a third button capable of turning on/off the power are included, the control unit170may display a first UI4831corresponding to the first button, a second UI4832corresponding to the second button and a third UI4833corresponding to the third button.

FIG. 49is a view illustrating a method of receiving user input of selecting a specific area on a screen of a display device.

The method of operating the display device according to the embodiment of the present invention may include step S3640of receiving a second control signal from the remote control device.

Specifically, as shown inFIG. 49, the control unit170of the display device100may display a pointer4910moved in correspondence with motion of the remote control device.

In addition, when user input of selecting an area, in which the pointer4910is located, is received, the remote control device200may transmit a signal corresponding to the user input of selecting the area, in which the pointer4910is located, to the display device100.

In addition, the control unit170may receive the signal corresponding to the user input of selecting the area, in which the pointer4910is located, from the remote control device200.

Meanwhile, the method of operating the display device according to the embodiment of the present invention may include step of S3650of transmitting a command to an external device based on a second control signal.

Specifically, based on the signal corresponding to the user input of selecting the area, in which the pointer4910is located, the control unit170of the display device100may transmit a command for selecting an area corresponding to the area, in which the pointer4910is located, to the third external device580.

In this case, the command for selecting an area corresponding to the area, in which the pointer4910is located, may be information on the coordinates of the pointer4910in the image4820displayed on the display device100or information on coordinates obtained by transforming the coordinates of the pointer4910in the image4820displayed on the display device100into coordinates corresponding to the screen size of the third external device580.

Meanwhile, when user input of selecting a first UI4831from among a first UI4931, a second UI4832and a third UI4833corresponding to the buttons installed in the third external device580is received, the control unit170of the display device100may transmit a command indicating that the button corresponding to the first UI4831has been selected to the third external device580.

FIG. 50is a view showing a third external device580, which has received a command, and a display device.

When a command for selecting the area corresponding to the area, in which the pointer4910is located, is received, the third external device580may perform operation of selecting the area corresponding to the area, in which the pointer4910is located.

For example, inFIG. 49, an icon4821corresponding to a messenger application is displayed in the area, in which the pointer4910is located. An icon4811corresponding to the messenger application is also displayed in the area of the screen of the third external device580.

In this case, when the command for selecting the area corresponding to the area, in which the pointer4910is located, is received, the third external device580may perform operation of selecting the area corresponding to the area, in which the pointer4910is located, that is, operation of selecting the icon4811corresponding to the messenger application. Accordingly, the third external device580may execute the messenger application and display an execution image5010of the executed messenger application.

In addition, the third external device580may transmit the execution image5010of the messenger application to the display device100.

In addition, when a command indicating that the button corresponding to a first UI4831has been selected from among a first UI4831, a second UI4832and a third UI4833corresponding to the buttons installed in the third external device580is received, the third external device580may perform operation corresponding to the received command.

That is, when the command indicating that the button corresponding to the first UI4831has been is received, the third external device580may control the third external device580according to the received command. For example, when the button corresponding to the first UI4831is a volume up button, the control unit of the third external device580may raise the volume of the sound output from the third external device580.

Meanwhile, the method of operating the display device according to the embodiment of the present invention may include step S3660of receiving a second image from the external device controlled according to the command and step S3670of displaying the second image.

That is, the display device100may receive an image (the execution image of the messenger application) transmitted by the third external device580controlled by the command for selecting the area corresponding to the area, in which the pointer4910is located.

In addition, the display device100may display the received execution image5020of the messenger application.

Meanwhile, although the mobile phone is described in the present embodiment, the present invention is not limited thereto. For example, the present embodiment is applicable to the case where the external device for providing input to the display device100is a laptop.

For example, if an image displayed on the laptop includes a specific icon, the image received from the laptop and displayed on the display device100may also include the specific icon.

In this case, when user input of selecting an area in which the specific icon is located is received, the control unit170of the display device100may transmit a command for selecting the area corresponding to the area, in which the specific icon is located, to the laptop, and the laptop may perform operation of selecting the area corresponding to the area, in which the specific icon is located. For example, if the specific icon is a web browser icon, the laptop may execute a web browser and display the execution image of the web browser.

As another example, a UI corresponding to a button included in the input device of the laptop, for example, a button included in a keyboard, may be displayed on the display device100.

In addition, when user input of selecting a specific UI from among a plurality of Uls respectively corresponding to a plurality of buttons included in a keyboard is received, the display device100may transmit a command indicating that the specific UI has been selected to the laptop.

In this case, the laptop, which has received the command, may perform operation corresponding to the received command. For example, when a UI corresponding to a “K” button” is selected in a state in which a text input window is activated, the laptop may display the letter “K” in the text input window.

In the present invention, although an external device for providing input to a display device includes a display unit, an image displayed on the external device and a UI corresponding to a button of the external device may be displayed on the display device. Accordingly, the present invention may provide an environment in which the user may control the external device using the image displayed on the TV.

In particular, if the external device for providing input to the display device is an external device (a mobile phone, etc.) having a relatively small screen size, the image displayed on the mobile phone is displayed on the TV, thereby providing an environment in which the user may easily move a pointer on the screen of the TV using the remote controller.

Meanwhile, an application capable of supporting a common protocol in communication between the display device100and a plurality of external devices may be installed and executed in the display device100and the plurality of external devices.

Meanwhile, the control unit170is responsible for controlling the device and may be used interchangeably with a central processing unit, a microprocessor or a processor.

According to one embodiment of the present invention, the above-described method may be implemented as code that can be written to a processor-readable recording medium and can thus be read by a processor. Examples of the processor-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, optical data storage, and a carrier wave (e.g., data transmission over the Internet).

The display device according to the present invention should not be limited to configurations and methods of the above-described embodiments, and all or some of the embodiments may be selectively combined with one another to achieve various alterations.