Patent Description:
An image displaying apparatus is an apparatus having a function of displaying an image that a user can watch, and the user can watch various contents through the image displaying apparatus. For example, the image displaying apparatus may include a Television (TV) having a liquid crystal display (LCD) using liquid crystal, or having an OLED display using an organic light emitting diode (hereinafter, referred to as OLED), a notebook computer, and the like.

In recent years, as various components such as a camera and a microphone are provided in an image displaying apparatus, a user can use various components provided in the image displaying apparatus as needed. For example, a user may transmit an image captured by a camera provided in the image displaying apparatus or a voice recorded through a microphone to a server providing a streaming service, and a counterpart may receive the image or voice provided by the user in a streaming manner in real time. Through this, the user may conduct an online video conference with a specific counterpart, or may provide personal broadcasting to a large number of unspecified counterparts.

Meanwhile, in order to prevent an image or voice acquired through a camera or a microphone provided in the image displaying apparatus from leaking outside regardless of the user's intention and intruding upon privacy, the security function of the image displaying apparatus needs to be strengthened. Conventionally, a light incident on a camera is blocked or a portion of microphone to which a sound is input is blocked by simply using a physical configuration (e.g., a sticker), but there is a problem in that it is difficult to prevent the leakage of image or voice.

Furthermore, <CIT> relates to the use of a virtualization mechanism to block the operation of I/O devices such as a camera. The virtualization mechanism is a technique used to restrict the operation of I/O devices from being directly controlled by the operating system domain. Specifically, the virtualization mechanism consists of a machine virtualization mechanism that separates/isolates the operating system domain and the peripheral control domain from each other and the I/O virtualization mechanism for translating/forwarding request of the operating system domain.

<CIT> discloses a privacy mode designed to protect the user's privacy by securely disabling sensors such as cameras and microphones when privacy mode is activated. The core concept involves using a trusted execution environment (TEE) to control and verify the state of these sensors. When privacy mode is enabled, the TEE disables the specified sensors based on pre-configured settings. This involves setting hardware control lines to a disabled state, which cuts off power or access to the sensors.

In addition, when a security mode is set, the power supply to a camera, or the like may be stopped to fundamentally block the generation of data. However, when a user forgets about setting of the security mode, or when the third user wants to use the camera, there is a possibility that it may be mistaken for a product defect of the image displaying apparatus, and this may cause unnecessary requests for repairs to the service center.

It is an object of the present disclosure to provide an image display apparatus and method thereof that may prevent external leakage of image and/or voice, and reduce the possibility of a user's misunderstanding regarding product defects.

This object is solved by the present invention as defined in the independent claims.

The effect of the image displaying apparatus and the operation method thereof according to the present disclosure is as follows.

According to at least one embodiment of the present disclosure, it is also possible to reduce the possibility that a user may misrecognize as a defective product, while preventing the external leakage of image and/or voice when setting the security mode.

The additional range of applicability of the present disclosure will become apparent from the following detailed description. The detailed description and specific embodiments such as preferred embodiments of the present disclosure are merely given by way of example. The scope of protection is defined by the claims.

The above and other objects, features and advantages of the present disclosure will be more apparent from the following detailed description in conjunction with the accompanying drawings, in which:.

Exemplary embodiments of the present disclosure are described with reference to the accompanying drawings in detail. The same reference numbers are used throughout the drawings to refer to the same or like parts. Detailed descriptions of well-known functions and structures incorporated herein may be omitted to avoid obscuring the subject matter of the present disclosure.

The suffixes "module" and "unit" in elements used in description below are given only in consideration of ease in preparation of the specification and do not have specific meanings or functions. Therefore, the suffixes "module" and "unit" may be used interchangeably.

In the present application, it will be further understood that the terms "comprises", includes," etc. specify the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

In addition, although the terms "first," "second," etc., may be used herein to describe various components, these components should not be limited by these terms. These terms are only used to distinguish one component from another component.

<FIG> and <FIG> are diagrams illustrating an image displaying apparatus according to various embodiments of the present disclosure.

The image displaying apparatus <NUM> may be an apparatus that processes and outputs an image. The image displaying apparatus <NUM> is not particularly limited as long as it can output a screen on which an image is displayed, such as a television (TV), a notebook computer, a smart phone, and a tablet computer.

The image displaying apparatus <NUM> may receive and process a broadcast signal, and output a signal-processed broadcast image. When the image displaying apparatus <NUM> receives the broadcast signal, the image displaying apparatus <NUM> may correspond to a broadcast reception apparatus. In this case, the image displaying apparatus <NUM> may receive a broadcast signal wirelessly through an antenna, or may receive a broadcast signal by a wire through a cable. For example, the image displaying apparatus <NUM> may receive a terrestrial broadcast signal, a satellite broadcast signal, a cable broadcast signal, an Internet Protocol Television (IPTV) broadcast signal, and the like.

Referring to <FIG>, the image displaying apparatus <NUM> may include a display apparatus <NUM>, a processing apparatus <NUM>, and/or a remote control apparatus <NUM>. The image displaying apparatus <NUM> may further include a camera <NUM> for acquiring an image.

The display apparatus <NUM> may include a display <NUM> and may output an image based on an image signal received from the processing apparatus <NUM>. For example, the display apparatus <NUM> may store an image received from the processing apparatus <NUM>, and output the stored image according to the screen size of the display apparatus <NUM> and the number of frames that can be displayed per second.

The display apparatus <NUM> is not particularly limited as long as it can output a screen corresponding to an image signal, such as a TV, a monitor, or a projector.

The processing apparatus <NUM> is not particularly limited as long as it can transmit a signal including RGB data corresponding to an image to the display apparatus <NUM>, such as a computer.

The remote control apparatus <NUM> may be connected to the display apparatus <NUM> and/or the processing apparatus <NUM> in a wired/wireless manner to provide various control signals. In this case, the remote control apparatus <NUM> may include an apparatus that establishes a wired/wireless network with the display apparatus <NUM> and/or the processing apparatus <NUM>, and transmits various control signals through the established network, or receives signals related to various operations.

For example, various input apparatuses such as a mouse 400a, a keyboard 400b, a space remote control 400c, a trackball, a joystick, and the like may be used as the remote control apparatus <NUM>. The remote control apparatus <NUM> may be named as an external device, an input apparatus, an input unit, and the like, and hereinafter, it is clarified beforehand that it may be used interchangeably as needed.

Referring to <FIG>, the image displaying apparatus <NUM> may be an electronic apparatus including a display <NUM>, a processing apparatus (e.g., the processing apparatus <NUM> of <FIG>), an input apparatus <NUM> and/or a camera <NUM>.

For example, the image displaying apparatus <NUM> may be a notebook computer including all of a display <NUM>, a keyboard 400b, a touchpad 400d, and a camera <NUM>. <FIG> is an example of an internal block diagram of the image displaying apparatus of <FIG>.

Referring to <FIG>, the image displaying apparatus <NUM> may include a network interface unit <NUM>, an external apparatus interface unit <NUM>, a storage unit <NUM>, a sensor unit <NUM>, an image acquisition unit <NUM>, an input unit <NUM>, a display <NUM>, an audio output unit <NUM>, a power supply unit <NUM>, and/or a controller <NUM>.

The network interface unit <NUM> may provide an interface for connecting the image displaying apparatus <NUM> to a wired/wireless network including an Internet network. For example, the network interface unit <NUM> may receive content or data provided by the Internet, a content provider, or a network operator, through a connected network.

Meanwhile, the network interface unit <NUM> may include a communication module (not shown) for connection with a wired/wireless network.

The external apparatus interface unit <NUM> may transmit or receive data to or from a connected external apparatus. To this end, the external apparatus interface unit <NUM> may include an A/V input/output unit (not shown).

The external apparatus interface unit <NUM> may be connected to an external apparatus such as a Digital Versatile Disk (DVD), Blu-ray, game apparatus, camera, smart phone by wire/wireless, and may perform input/output operation with the external apparatus.

In addition, the external apparatus interface unit <NUM> may establish a communication network with various remote control apparatuses <NUM> as shown in <FIG> and <FIG>, and may receive a control signal related to the operation of the image displaying device <NUM> from the remote control apparatus <NUM>, or transmit data related to the operation of the image displaying apparatus <NUM> to the remote control apparatus <NUM>.

The A/V input/output unit may receive image and voice signals from an external apparatus.

The external apparatus interface unit <NUM> may include a wireless communication unit (not shown) for short-range wireless communication with other electronic apparatus.

Through such a wireless communication unit (not shown), the external apparatus interface unit <NUM> may exchange data with an adjacent mobile terminal through short-range wireless communication.

The storage unit <NUM> may store a program for processing and controlling each signal in the controller <NUM>, and may store a signal-processed image, voice, or data signal.

For example, the storage unit <NUM> may store application programs designed for the purpose of performing various tasks that can be processed by the controller <NUM>, and upon request of the controller <NUM>, selectively provide some of the stored application programs.

The program stored in the storage unit <NUM> is not particularly limited as long as it can be executed by the controller <NUM>.

<FIG> illustrates an embodiment in which the storage unit <NUM> is provided separately from the controller <NUM>, but the scope of the present disclosure is not limited thereto, and at least a portion of the storage unit <NUM> may be included in the controller <NUM>.

The storage unit <NUM> may include at least one of a volatile memory (e.g., DRAM, SRAM, SDRAM, etc.), a non-volatile memory (e.g., a flash memory), a hard disk drive (HDD), and a solid state drive (SSD).

The sensor unit <NUM> may measure a physical quantity or detect an operating state of the image displaying apparatus <NUM> to convert the measured or detected information into an electrical signal.

The sensor unit <NUM> may include a proximity sensor, a temperature/humidity sensor, an illuminance sensor, and the like.

The image acquisition unit <NUM> may acquire an image around the image displaying apparatus <NUM>. For example, the image acquisition unit <NUM> may include at least one camera (e.g., the camera <NUM> of <FIG>).

At least one camera <NUM> included in the image acquisition unit <NUM> may be a digital camera. The digital camera may include at least one optical lens, an image sensor (e.g., CMOS image sensor) configured to include a plurality of photodiodes (e.g., pixel) on which an image is formed by light passing through the optical lens, and a digital signal processor (DSP) that configures an image based on a signal output from the photodiodes. The digital signal processor may generate a moving image formed of frames composed of still images, as well as a still image.

The image acquired through the image acquisition unit <NUM> may be stored in the storage unit <NUM>. The image acquired through the image acquisition unit <NUM> may be transmitted to the controller <NUM>.

The input unit <NUM> may include an input apparatus (e.g., a key, a touch panel, etc.) capable of receiving a user input. The input unit <NUM> may include an input apparatus provided in the remote control apparatus <NUM>.

The input unit <NUM> may include at least one microphone. The microphone may receive a sound, and may transmit a signal corresponding to the received sound to the controller <NUM>.

The input unit <NUM> may receive a user input through an input apparatus, and may transmit a command corresponding to the received user input to the controller <NUM>.

The display <NUM> may convert an image signal, a data signal, an OSD signal, and a control signal processed by the controller <NUM>, or an image signal, a data signal, and a control signal received from the external apparatus interface unit <NUM> to generate a driving signal.

The display <NUM> may include a display panel (not shown) including a plurality of pixels.

The plurality of pixels provided in the display panel may include a RGB sub-pixel. Alternatively, the plurality of pixels included in the display panel may include a RGBW sub-pixel. The display <NUM> may convert an image signal, a data signal, an OSD signal, a control signal, etc. processed by the controller <NUM> to generate a driving signal for a plurality of pixels.

The display <NUM> may be a plasma display panel (PDP), a liquid crystal display (LCD), an organic light emitting diode (OLED), a flexible display, and the like, and may also be a three-dimensional (3D) display. The 3D display may be divided into a glasses-free type and a glasses type.

Meanwhile, the display <NUM> may be configured as a touch screen and used as an input apparatus in addition to an output apparatus.

The audio output unit <NUM> may include an audio apparatus such as a speaker and a buzzer, and may receive a signal processed by the controller <NUM> and output it as a voice. In addition, the voice signal processed by the controller <NUM> may be input to an external audio apparatus through the external apparatus interface unit <NUM>.

The power supply unit <NUM> may supply power to all components included in the image displaying apparatus <NUM>. In particular, power may be supplied to the controller <NUM>, the display <NUM>, and the audio output unit <NUM>, which may be implemented in the form of a system on chip (SOC).

The power supply unit <NUM> may include a converter (not shown) that converts AC power into DC power, a Dc/Dc converter (not shown) that converts the level of DC power, and the like.

The controller <NUM> may be connected to each component provided in the image displaying apparatus <NUM>. The controller <NUM> may, for example, transmit/receive signals to/from each component included in the image displaying apparatus <NUM> and may control the overall operation of each component.

The controller <NUM> may include at least one processor, and may control the overall operation of the image displaying apparatus <NUM> by using the at least one processor. Here, the processor may be a general processor such as a central processing unit (CPU). Obviously, the processor may be a dedicated device such as an ASIC or other hardware-based processor.

When the controller <NUM> includes a plurality of processors, the plurality of processors may be integrated on one chip or may be physically separated from each other.

The controller <NUM> may generate at least one virtual device. Here, the virtual device may refer to an apparatus which is configured and generated in software by using a resource of the image displaying apparatus <NUM>, with respect to a configuration that is a generation target, for example, a memory, a communication module, a camera <NUM>, a microphone, and the like. For example, when the camera <NUM> is determined as a generation target, the controller <NUM> may use the resource of the image displaying apparatus <NUM> to configure a driver, an interface, and the like for controlling input/output of signals with respect to a virtual device (hereinafter, a virtual camera) that is generated in correspondence with the camera <NUM>.

The controller <NUM> may determine a configuration that is a use target, among a plurality of configurations, and may register the determined configuration. For example, the controller <NUM> may determine a camera <NUM> that is a use target, among the plurality of cameras <NUM>, and may register the determined camera <NUM>. In this case, the controller <NUM> may control the power to be supplied to the camera <NUM> that is a use target, and may block the supply of power to the camera <NUM> that is not a use target.

The controller <NUM> may check a configuration registered as a use target. For example, the controller <NUM> may check a microphone registered as a use target, among the plurality of microphones. In this case, the controller <NUM> may control the microphone registered as a use target to receive a voice.

Meanwhile, the block diagram of the image displaying apparatus <NUM> shown in <FIG> is just a block diagram for an embodiment of the present disclosure, and each component of the block diagram may be incorporated, added, or omitted according to the specifications of the image displaying apparatus <NUM> actually implemented.

That is, two or more components may be combined into one component, or one component may be subdivided into two or more components as needed. In addition, the function performed by each block is for explaining the embodiment of the present disclosure, and the specific operation or apparatus does not limit the scope of the present disclosure.

<FIG> and <FIG> are flowcharts of a method of operating an image displaying apparatus according to an embodiment of the present disclosure, and <FIG> are diagrams for explaining the operation of the image displaying apparatus.

Referring to <FIG>, the image displaying apparatus <NUM> receives a command corresponding to a user's input through the input unit <NUM>, in operation S310.

The image displaying apparatus <NUM> checks whether the received command is a command corresponding to the execution of the camera <NUM>, in operation S320. For example, when a command for executing an application using a function of the camera <NUM> is received through the input unit <NUM>, the image displaying apparatus <NUM> may determine that the received command is a command corresponding to the execution of the camera <NUM>.

In operation S330, when the received command is not a command corresponding to the execution of the camera <NUM>, the image displaying apparatus <NUM> determines whether the received command is a command related to security of the image displaying apparatus <NUM>. For example, when a command for setting the mode of the image displaying apparatus <NUM> to a security mode, a command for releasing the security mode, and the like are received by a user through the input unit <NUM>, the image displaying apparatus <NUM> may determine that a security-related command is received.

In operation S340, when the received command is a command related to the security of the image displaying apparatus <NUM>, the image displaying apparatus <NUM> determines whether the command for setting the mode of the image displaying apparatus <NUM> to a security mode is received.

In operation S350, when the command for setting the mode of the image displaying apparatus <NUM> to a security mode is received, the image displaying apparatus <NUM> may release the registration of the camera <NUM> registered as a use target. In this case, the image displaying apparatus <NUM> may block the power supply to the camera <NUM>, when the use registration for the camera <NUM> is released.

The image displaying apparatus <NUM> generates a virtual camera that is a virtual device corresponding to the camera <NUM>, and register the generated virtual camera as a camera that is a use target, in operation S360.

Meanwhile, in operation S370, when the received command is not the command for setting the mode of the image displaying apparatus <NUM> to a security mode, the image displaying apparatus <NUM> determines whether a command for releasing the security mode is received.

In operation S380, when the command for releasing the security mode is received, the image displaying apparatus <NUM> releases the registration of the virtual camera registered as a use target. For example, when the use registration for the virtual camera is released, the image displaying apparatus <NUM> deletes data corresponding to the virtual camera so that resource is no longer allocated to the virtual camera configured in software.

The image displaying apparatus <NUM> registers the camera <NUM> as a use target, in operation S390. At this time, when the camera <NUM> is registered as a use target, the image displaying apparatus <NUM>, may supply power to the camera <NUM>, and may reactivate a driver, an interface, and the like that control the input and output of a signal for the camera <NUM>.

Meanwhile, referring to <FIG>, in operation S410, when the received command is a command corresponding to the execution of the camera <NUM>, the image displaying apparatus <NUM> checks a camera registered as a use target.

In operation S420, the image displaying apparatus <NUM> determines whether a camera registered as a use target is a virtual camera. For example, the image displaying apparatus <NUM> may determine whether the camera registered as a use target is a virtual camera, by checking an interface of the camera registered as a use target.

In operation S430, when the camera registered as a use target is a virtual camera, the image displaying apparatus <NUM> outputs a preset screen (hereinafter, referred to as a security screen) in response to the security mode, through the display <NUM>.

Referring to <FIG>, when the camera registered as a use target is a virtual camera, a security screen indicating that the camera <NUM> and/or the microphone cannot be used may be output through the display <NUM>.

Referring again to <FIG>, in operation S440, when the camera registered as a use target is a camera <NUM> that is not a virtual camera, the image displaying apparatus <NUM> determines whether the camera <NUM> is normally registered as a use target.

For example, the image displaying apparatus <NUM> may determine whether a driver, an interface, or the like of the camera <NUM> operates normally so that the camera <NUM> can be used.

In operation S450, when the camera <NUM> is normally registered as a use target, the image displaying apparatus <NUM> acquires an image through the camera <NUM>, and output a screen for the acquired image through the display <NUM>.

Meanwhile, in operation S460, when the camera <NUM> is not normally registered as a use target, for example, when the interface of the camera <NUM> does not operate normally, the image displaying apparatus <NUM> may output a screen related to an operation error of the camera <NUM> through the display <NUM>.

Referring to <FIG>, when the camera <NUM> is normally registered as a use target, an image including a user positioned in front of the display <NUM> that the camera <NUM> looks at may be acquired through the camera <NUM>, and a screen including the acquired image may be output through the display <NUM>.

Meanwhile, referring to <FIG>, when the camera <NUM> is not normally registered as a use target, a screen including a message instructing to check the connection state of the camera <NUM>, the state of the driver of the camera <NUM>, and the like may be output through the display <NUM>.

Referring again to <FIG>, in operation S470, the image displaying apparatus <NUM> may determine whether the execution of the camera registered as a use target is terminated. For example, the image displaying apparatus <NUM> may determine whether a command for terminating the execution of the camera is received through the input unit <NUM>.

When the execution of the camera is not terminated, the image displaying apparatus <NUM> may branch to operation S420, and output a screen corresponding to the camera registered as a use target through the display <NUM>.

The image displaying apparatus <NUM> may terminate a screen output through the display <NUM>, when the execution of the camera is terminated, in operation S480.

As described above, according to at least one embodiment of the present disclosure, when setting the security mode for the image displaying apparatus <NUM>, it is also possible to reduce the possibility that a user may misrecognize as a defective product, while preventing the external leakage of image and/or voice.

Claim 1:
An image displaying apparatus (<NUM>) comprising:
a camera (<NUM>) configured to acquire an image;
an input unit (<NUM>) configured to receive a command corresponding to a user's input;
a display (<NUM>); and
a controller (<NUM>),
characterised in that the controller (<NUM>) is configured to:
when a first command corresponding to setting a security mode is received, generate a virtual camera configured in software using a resource of the image displaying apparatus (<NUM>) and determine the virtual camera as a configuration to be used for acquiring an image,
when a second command corresponding to releasing the security mode is received, delete data corresponding to the virtual camera and determine the camera (<NUM>) as the configuration,
when a third command corresponding to executing the camera (<NUM>) is received, check which of the camera (<NUM>) and the virtual camera is determined as the configuration,
when the camera (<NUM>) is determined as the configuration, output, through the display (<NUM>), a first screen including the image acquired through the camera (<NUM>), and
when the virtual camera is determined as the configuration, output, through the display (<NUM>), a second screen corresponding to the security mode.