Patent Description:
Recently, a display apparatus having a light emitting diodes (LED) that is disposed on the side or rear side of a device and emits light in various colors is generally distributed. Such a display apparatus may increase the user's sense of immersion in the content by emitting light of a main color (ambient light) detected by the user through the content. More particularly, consumers who play games are very interested in display apparatuses that provide a lighting effect associated with game contents in order to maximize the satisfaction obtained through the game contents.

However, a prior art display apparatus does not take into consideration the different characteristics of the areas on the screen that the user watches for each game type and thus, there is a problem that the main color detected by the user through the content does not match the color of lighting provided through the LED. Accordingly, there has been a continuous need for a method of providing a lighting effect based on different characteristics of the areas on the screen that the user watches for each game type.

<CIT> discloses an ambient effects system and method of operation in which regions of a game or movie screen are analysed. The result of the analysis is then processed to determine a content related event. An ambient effects script is then selected or generated on the basis of the determination, and provided to the system to render appropriate ambient effects throughout the users environment.

<CIT> discloses an additional data generation system which can produce an output based on additional data to impart an information conveying effect to an output based on output data.

<CIT> discloses a display mode that is determined for a two-dimensional light-emitting diode (LED) array located within a bezel of the display device outside of the display area of the display.

Accordingly, an aspect of the disclosure is to provide a display apparatus that identifies an area of interest for each game type selected by a user and controls a light-emitting state of a plurality of light emitting diodes (LEDs) based on red, green, and blue (RGB) grayscale data included in the area of interest of a game image and a controlling method thereof.

In accordance with an aspect of the disclosure, a display apparatus is provided according to claim <NUM>.

The processor may be configured to obtain RGB grayscale data of a pixel included in the area of interest in units of a predetermined first time section and control a light-emitting state of the plurality of LEDs for a predetermined second time section based on the obtained RGB grayscale data.

The processor may be configured to obtain an average value of an R grayscale value, an average value of a G grayscale value and an average value of a B grayscale value of respective pixels included the area of interest and control a light-emitting state of the plurality of LEDs based on the R average value, the G average value and the B average value.

The memory may be configured to store a representative light-emitting value for each of a plurality of pixel value ranges, and the processor may be configured to identify a range to which a pixel value of the area of interest belongs from among the plurality of pixel value ranges stored in the memory based on RGB grayscale data included in the area of interest and control a light-emitting state of the plurality of LEDs based on a representative light-emitting value corresponding to the identified range.

The plurality of LEDs may include a first LED provided on a bezel area of the display and a second LED provided on a rear side of the display, and the processor may be configured to identify a first range and a second range to which a pixel value of the area of interest belongs from among the plurality of pixel value ranges based on RGB grayscale data included in the area of interest, control a light-emitting state of the first LED based on a first representative light-emitting value corresponding to the first range, and control a light-emitting state of the second LED based on a second representative value corresponding to the second range.

The processor may be configured to obtain first RGB grayscale data included in an area of interest of a first fame included in the game image and second RGB grayscale data included in an area of interest of a second frame, and based on a difference between a pixel value included in the second frame and a pixel value included in the first frame being equal to or greater than a threshold value based on the first RGB grayscale data and the second RGB grayscale data, control a light-emitting state of the plurality of LEDs based on a pixel value included in the second frame.

The information regarding an area of interest for each game type may include information regarding different locations of an image for each game type, and the different locations of the image may include at least one of a center area of the image, a lower left area or a lower right area.

The processor may be configured to, based on a user command for changing an area of interest of a specific game type being input, update information regarding an area of interest corresponding to the specific game type stored in the memory based on the user command.

The processor may be configured to control at least one of a color or a brightness of the plurality of LEDs based on RGB grayscale data of a pixel corresponding to the identified area of interest.

ln accordance with another aspect of the disclosure, a controlling method is provided. The controlling method includes, based on information related to a game type being selected, identifying an area of interest corresponding to the selected game type based on information regarding an area of interest for each game type and driving a plurality of LEDs based on RGB grayscale data of a pixel corresponding to the identified area of interest in a game image provided through a display.

The driving a plurality of LEDs may include obtaining RGB grayscale data of a pixel included in the area of interest in units of a predetermined first time section and driving the plurality of LEDs for a predetermined second time section based on the obtained RGB grayscale data.

The driving a plurality of LEDs may include obtaining an average value of an R grayscale value, an average value of a G grayscale value and an average value of a B grayscale value of respective pixels included the area of interest and driving the plurality of LEDs based on the R average value, the G average value and the B average value.

The driving a plurality of LEDs may include identifying a range to which a pixel value of the area of interest belongs from among the plurality of pixel value ranges based on RGB grayscale data included in the area of interest and driving the plurality of LEDs based on a representative light-emitting value corresponding to the identified range.

The plurality of LEDs may include a first LED provided on a bezel area of the display and a second LED provided on a rear side of the display, and the driving a plurality of LEDs may include identifying a first range and a second range to which a pixel value of the area of interest belongs from among the plurality of pixel value ranges based on RGB grayscale data included in the area of interest, driving the first LED based on a first representative light-emitting value corresponding to the first range and driving the second LED based on a second representative value corresponding to the second range.

Meanwhile, the driving a plurality of LEDs may include obtaining first RGB grayscale data included in the area of interest of a first frame included in the game image and second RGB grayscale data included in the area of interest of a second frame, and based on a difference between a pixel value included in the second frame and a pixel value included in the first frame based on the first RGB grayscale data and the second RGB grayscale data being equal to or greater than a threshold value, driving the plurality of LEDs based on the pixel value included in the second frame.

In addition, the information regarding an area of interest for each game type may include information regarding different locations of an image for the each game type, and the different locations of the image may include at least one of a center area of the image, a lower left area or a lower right area.

In addition, the method may further include, based on a user command for changing an area of interest of a specific game type being input, updating information regarding an area of interest corresponding to the specific game type.

In addition, the driving a plurality of LEDs may include adjusting at least one of a color or a brightness of the plurality of LEDs based on RGB grayscale data of a pixel corresponding to the identified area of interest.

Meanwhile, in a non-transitory computer readable recording medium that stores computer instructions for a display apparatus to perform an operation when being executed by a processor of the display apparatus according to an embodiment, the operation may include, based on information regarding a game type being selected, identifying an area of interest corresponding to the selected game type based on information regarding an area of interest for each game type and driving a plurality of LEDs based on RGB grayscale data of a pixel corresponding to the identified are of interest in a game image provided through a display.

According to various embodiments of the disclosure, a display apparatus may provide a lighting effect based on RGB grayscale data included in an area of interest, thereby increasing a user sense of immersion in a game content.

Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the various embodiments described herein can be made without departing from the scope of the disclosure as defined by the claims.

General terms that are currently widely used were selected as terms used in embodiments of the disclosure based on functions in the disclosure, but may be changed depending on the intention of those skilled in the art or a judicial precedent, an emergence of a new technique, and the like. In addition, in a specific case, terms arbitrarily chosen by an applicant may exist. In this case, the meaning of such terms will be mentioned in a corresponding description portion of the disclosure. Therefore, the terms used in the disclosure should be defined based on the meaning of the terms and the contents throughout the disclosure rather than simple names of the terms.

In the disclosure, an expression "have", "may have", "include", "may include", or the like, indicates an existence of a corresponding feature (for example, a numerical value, a function, an operation, a component, such as a part, or the like), and does not exclude an existence of an additional feature.

The expression "at least one of A and/or B" should be understood to represent either "A" or "B" or any one of "A and B.

Expressions, such as "first," or "second," used in the disclosure may modify various components regardless of order and/or importance, and are used to distinguish one component from another component, and do not limit the corresponding components.

When it is mentioned that any component (e.g., a first component) is (operatively or communicatively) coupled with/to or is connected to another component (e.g., a second component), it is to be understood that any component is directly coupled to another component or may be coupled to another component through another component (e.g., a third component).

It should be further understood that the term "include" or "constituted" used in the application specifies the presence of features, numerals, operations, components, parts mentioned in the specification, or combinations thereof, but do not preclude the presence or addition of one or more other features, numerals, operations, components, parts, or combinations thereof.

In the disclosure, a 'module' or a 'unit' may perform at least one function or operation, and be implemented by hardware or software or be implemented by a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'units' may be integrated in at least one module and be implemented as at least one processor (not explaind) except for a 'module' or an 'unit' that needs to be implemented by specific hardware.

In the disclosure, a term "user" may be a person that receives a content through the display apparatus, but it is not limited thereto.

<FIG> is a view provided to schematically explain an operation of providing a lighting effect of a display apparatus according to an embodiment of the disclosure.

Referring to <FIG>, a display apparatus <NUM> may provide a user <NUM> with a content. For example, the display apparatus <NUM> may provide a game content, but is not limited thereto.

The display apparatus <NUM> may be implemented as various types of apparatuses, such as a digital television (TV), a digital versatile disc (DVD) player, a Blu-ray disc player, a game console, a network TV, a smart TV, an Internet TV, a web TV, an Internet protocol television (IPTV), signage, a personal computer (PC), a head mounted display (HMD), a wearable device, or the like, but is not limited thereto.

The display apparatus <NUM> may include a plurality of light emitting diodes (LEDs) on one side of the apparatus. Here, each of a plurality of LEDs (<NUM>, <NUM>, <NUM>, or the like) may include a plurality of sub-LEDs that emit light of different colors. For example, one LED <NUM> may include R LED <NUM>-<NUM> emitting red light, G LED <NUM>-<NUM> emitting green light and B LED <NUM>-<NUM> emitting blue light. Although <FIG> explains three types of sub-LEDs, the display apparatus <NUM> is not limited thereto. The display apparatus <NUM> may further include W LED emitting white light.

The display apparatus <NUM>, according to an embodiment of the disclosure, may control a light-emitting state of the plurality of LEDs (<NUM>, <NUM>, <NUM>, or the like) based on RGB grayscale data corresponding to a game content and as a result, the display apparatus <NUM> may provide the user <NUM> with a lighting effect <NUM> associated with the game content.

Meanwhile, when the display apparatus <NUM> provides the lighting effect <NUM> based on red, green, and blue (RGB) grayscale data included in the entire game image, the light-emitting period of the plurality of LEDs (<NUM>, <NUM>, <NUM>, or the like) becomes longer due to an excessive amount of data to be processed by the display apparatus <NUM> and accordingly, there is a problem that it becomes difficult for the display apparatus <NUM> to provide the lighting effect <NUM> that reflects a frame change of the game image in real time.

Thus, the display apparatus <NUM>, according to an embodiment of the disclosure, may identify an area of interest <NUM> corresponding to a game type selected by the user in the game image and provide the lighting effect <NUM> based on RGB grayscale data corresponding to the identified area of interest <NUM>. Here, the area of interest may be an area including at least one of an area that the user <NUM> watches in the game image for a long period of time or an area where important information regarding the game content is displayed, but is not limited thereto.

Hereinafter, various embodiments of the disclosure for identifying an area of interest for each game type selected by the user and providing a lighting effect based on RGB grayscale data included in the area of interest of the game image will be described.

<FIG> is a block diagram provided to explain a configuration of a display apparatus according to an embodiment of the disclosure.

Referring to <FIG>, the display apparatus <NUM> may include a display <NUM>, a user interface <NUM>, a memory <NUM>, a plurality of LEDs <NUM>, and a processor <NUM>.

The display <NUM> is configured for the display apparatus <NUM> to provide a user with an image related to a content. The display <NUM> may be implemented as displays in various forms, such as liquid crystal display (LCD), organic light emitting diodes (OLED) display, quantum dot light-emitting diodes (QLED) display, plasma display panel (PDP), or the like. The display <NUM> may also include a driving circuit, a backlight unit, or the like, that can be implemented in the form of a thin-film transistor (TFT), low temperature poly silicon (LTPS) TFT, organic TFT (OTFT), or the like. Meanwhile, the display <NUM> may be implemented as a flexible display, a three-dimensional (3D) display, or the like.

The display <NUM> includes a plurality of pixels, and the plurality of pixels may include R, G and B sub-pixels that emit red light, green light and blue light.

The user interface <NUM> is a component involved in the display apparatus <NUM> performing an interaction with the user. For example, the user interface <NUM> may include at least one of a touch sensor, a motion sensor, a button, a jog dial, a switch, or a microphone, but is not limited thereto.

In addition, when the user controls the display apparatus <NUM> remotely, the user interface <NUM> may include a receiver for receiving a control signal transmitted from a remote control device operated by the user.

The user may select information related to a game type through the user interface <NUM>. Here, the information related to a game type may include information regarding the type of game content provided through the display apparatus <NUM> or an area of interest corresponding to the type of game content, but is not limited thereto.

The memory <NUM> may store data necessary for various embodiments of the disclosure. The memory <NUM> may be implemented in a form of a memory embedded in the display apparatus <NUM> or in a form of a memory attachable to and detachable from the display apparatus <NUM>, depending on a data storing purpose. For example, data for driving the display apparatus <NUM> may be stored in the memory embedded in the display apparatus <NUM>, and data for an extension function of the display apparatus <NUM> may be stored in the memory attachable to and detachable from the display apparatus <NUM>. Meanwhile, the memory embedded in the display apparatus <NUM> may be implemented by at least one of a volatile memory (for example, a dynamic random-access memory (RAM) (DRAM), a static RAM (SRAM), or a synchronous dynamic RAM (SDRAM)), a non-volatile memory (for example, a one-time programmable ROM (OTPROM), a programmable ROM (PROM), an erasable and programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (for example, a NAND flash or a NOR flash), a hard drive, or a solid state drive (SSD). In addition, the memory attachable to and detachable from the display apparatus <NUM> may be implemented by a memory card (for example, a compact flash (CF), a secure digital (SD), a micro secure digital (micro-SD), a mini secure digital (mini-SD), an extreme digital (xD), or a multi-media card (MMC)), an external memory (for example, a universal serial bus (USB) memory) connectable to a USB port, or the like.

The memory, according to an embodiment of the disclosure, may store information regarding an area of interest for each game type. Here, the information regarding an area of interest for each game type may include information regarding different locations of an image for each game type, and the different locations of an image may include at least one of a center area, a lower left area or a lower right area.

The plurality of LEDs <NUM> may emit light of various colors. For example, the plurality of LEDs <NUM> may include R LED emitting red light, G LED emitting green light and B LED emitting blue light. In addition, the plurality of LEDs <NUM> may further include W LED emitting white light.

The processor <NUM> controls the overall operations of the display apparatus <NUM>. Specifically, the processor <NUM> may be connected to each component of the display apparatus <NUM> to comprehensively control the operations of the display apparatus <NUM>. For example, the processor <NUM> may be connected to the display <NUM>, the user interface <NUM>, the memory <NUM>, and the plurality of LEDs <NUM> and control the operations of the display apparatus <NUM>.

According to an embodiment of the disclosure, the processor <NUM> may be referred to as various names, such as a digital signal processor (DSP), a microprocessor, a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a neural processing unit (NPU), a controller, an application processor (AP), or the like, but in this disclosure, it will be referred to as the processor <NUM>.

The processor <NUM> may be implemented as system on chip (SoC) or large scale integration (LSI), and it may also be implemented in the form of a field programmable gate array (FPGA). In addition, the processor <NUM> may include a volatile memory, such as SRAM, or the like.

According to an embodiment of the disclosure, when information regarding a game type is selected through the user interface <NUM>, the processor <NUM> may identify an area of interest corresponding to the selected game type based on information regarding an area of interest for each game type stored in the memory <NUM>.

The area of interest may be an area corresponding to different locations of an image for each game type, and the area of interest, according to an embodiment of the disclosure, may be an area including at least one of a center area, a lower left area or a lower right area. The area of interest may be an area in the shape of at least one of a circle, an ellipse or a rectangle, but is not limited thereto.

In addition, the processor <NUM> may obtain RGB grayscale data of a pixel corresponding to the identified area of interest in a game image provided through the display <NUM>. Here, the RGB grayscale data may be data including grayscale values for driving R, G and B sub-pixels included in the display <NUM>. For example, if an image has <NUM> levels of gray level for each RGB color signal, the RGB grayscale data may include numerical values ranging from <NUM> to <NUM> corresponding to each of the R, G and B sub-pixels.

The processor <NUM>, according to an embodiment of the disclosure, may obtain RGB grayscale data included in an area of interest in units of a predetermined first time section. For example, the processor <NUM> may obtain RGB grayscale data included in the area of interest every <NUM> seconds. As a result, the processor <NUM> may obtain a set of RGB data including RGB data of a reference time point regarding the area of interest, RGB data when <NUM> second has elapsed from the reference time point, RGB data when <NUM> seconds have elapsed from the reference time point, or the like.

In addition, the processor <NUM> may control the light-emitting state of the plurality of LEDs <NUM> based on the obtained RGB grayscale data. Specifically, the processor <NUM> may control at least one of the color or the brightness of the plurality of LEDs <NUM> based on the RGB grayscale data of a pixel corresponding to the identified area of interest. Meanwhile, the processor <NUM> may further obtain brightness data regarding the area of interest of the image in addition to the RGB grayscale data to control the color and the brightness of the plurality of LEDs <NUM> based on the RGB grayscale data and the brightness data.

The processor <NUM>, according to an embodiment of the disclosure, may control the light-emitting state of the plurality of LEDs <NUM> for a predetermined second time section based on the obtained RGB grayscale data. Here, the second time may be a minimum unit of time during which each of the plurality of LEDs emits a constant color or light of constant brightness. For example, the processor <NUM> may adjust the color or the brightness of the light emitted by the plurality of LEDs every <NUM> second (the first time) based on the obtained RGB data set.

In addition, the processor <NUM> may obtain the average value of the R grayscale value, the average value of the G grayscale value and the average value of the B grayscale value of pixels included in the area of interest, and control the light-emitting state of the plurality of LEDs <NUM> based on the obtained RGB average values.

Meanwhile, the memory <NUM> may store a representative light-emitting value for each pixel value range. Here, the pixel value may include an RGB grayscale value for controlling a plurality of pixels included in the display <NUM>, but is not limited thereto.

The processor <NUM> may identify a range to which a pixel value of the area of interest belongs from among a plurality of pixel value ranges stored in the memory <NUM> based on the RGB grayscale data included in the area of interest, and control the light-emitting state of the plurality of LEDs based on the representative light-emitting value corresponding to the identified range.

Here, the plurality of LEDs <NUM> may include a first LED provided on a bezel area of the display <NUM> and a second LED provided on a rear side of the display <NUM>. The locations of the first LED and the second LED are not limited to the above, but in this disclosure, it is assumed that the first LED is provided on a bezel area of the display <NUM> and the second LED is provided on a rear side of the display <NUM> for convenience of explanation of the operation of the display apparatus <NUM>.

The processor <NUM> may identify each of a first range and a second range to which a pixel value of the area of interest belongs from among a plurality of pixel value ranges based on RGB grayscale data included in the area of interest. For example, the processor <NUM> may identify each pixel value range to which a plurality of pixels included in the area of interest belong, and identify a pixel value range to which the most pixels belong as the first range and a pixel value range to which the next most pixels belong as the second range.

In addition, the processor <NUM> may control the light-emitting state of the first LED based on the first representative light-emitting value corresponding to the first range and control the light-emitting state of the second LED based on the second representative light-emitting value corresponding to the second range. In other words, the processor <NUM> may provide two lighting effects related to the game content displayed through the area of interest. In addition, the plurality of LEDs <NUM> may further include additional LEDs, such as the third LED and the fourth LED provide on the other side, and the processor <NUM> may provide a plurality of lighting effects by identifying a plurality of pixel value ranges corresponding to each of the plurality of LEDs <NUM>.

Further, the processor <NUM> may obtain the first RGB grayscale included in the area of interest of the first frame included in the game image and the second RGB grayscale data included in the area of interest of the second frame. If a difference between a pixel value included in the second frame and a pixel value included in the first frame is equal to or greater than a threshold value based on the first RGB grayscale data and the second RGB grayscale data, the processor <NUM> may control the light-emitting state of the plurality of LEDs <NUM> based on the pixel value included in the second frame.

In addition, when a user command to change an area of interest of a specific game type, the processor <NUM> may update information regarding the area of interest corresponding to the specific game type stored in the memory <NUM> based on the user command. Here, the update may refer to an operation of storing information regarding the area of interest of which size or location has been changed according to the user command in the memory <NUM>.

<FIG> and <FIG> are views provided to explain an area of interest for each game type according to various embodiments of the disclosure.

The user may select information regarding the type of game he or she wants to play through the user interface <NUM> before playing the game.

Referring to <FIG>, it explains an area of interest <NUM> identified by the display apparatus <NUM> when a first person shooter (FPS) content <NUM> is provided. In the case of FPS, the user may react sensitively to a shooting effect generated from a muzzle located at the center of the screen. In addition, considering the characteristics of FPS in which an aiming point is located at the center of screen, it is common that effects, such as bleeding occur in the center area of the screen when a bullet hits a target.

Accordingly, the memory <NUM> may store information regarding the area of interest located at the center of the screen for the FPS type, and when the user selects information related to the FPS type through the user interface <NUM>, the processor <NUM> may identify the center area of the game image <NUM> as the area of interest <NUM>.

Meanwhile, other than the FPS type, as for other game types where the user's attention is concentrated on the center area of the screen, information regarding the area of interest located at the center area of the image may be stored in the memory <NUM>, and when such a game is selected, the processor <NUM> may identify the center area of the game image as the area of interest.

Referring to <FIG>, it explains an area of interest <NUM> identified by the display apparatus <NUM> when a multiplayer online battle arena (MOBA) content <NUM> is provided. In the case of MOBA, the user may react sensitively to a warning effect displayed on a mini map located in a lower area of the screen.

Accordingly, with respect to the MOBA type, the memory <NUM> may store information regarding an area of interest located in at least one of a lower left area or a lower right area of the screen, and when the user selects information regarding the MOBA type through the user interface <NUM>, the processor <NUM> may identify at least one of the lower left area or the lower right area of the game image <NUM> as the area of interest <NUM>.

Meanwhile, other than the MOBA type, as for other game types where the user's attention is concentrated on the lower area of the screen, information regarding the area of interest located at the lower area of the image may be stored in the memory <NUM>, and when such a game is selected, the processor <NUM> may identify a part of the lower area of the game image as the area of interest.

<FIG> is a view provided to explain an operation of providing a lighting effect based on an average value of an RGB grayscale value of a display apparatus according to an embodiment of the disclosure.

Referring to <FIG>, the display apparatus <NUM> may provide a content of the FPS type. The processor <NUM> may identify the center area of an image as the area of interest <NUM> and obtain RGB grayscale data of pixels included in the identified area of interest <NUM>.

For example, a first pixel <NUM> from among a plurality of pixels included in the area of interest <NUM> may have an RGB grayscale value of (<NUM>, <NUM>, <NUM>), and a second pixel to a fourth pixel (<NUM> to <NUM>) may have an RGB grayscale value of (<NUM>, <NUM>, <NUM>), (<NUM>, <NUM>, <NUM>) and (<NUM>, <NUM>, <NUM>), respectively. The processor <NUM> may obtain RGB grayscale values corresponding to a plurality of pixels in the area of interest <NUM> including the first to fourth pixels (<NUM> to <NUM>) and obtain the average value of the R grayscale value, the average value of the G grayscale value and the average value of the B grayscale value of each of the plurality of pixels.

The processor <NUM>, according to an embodiment of the disclosure, may obtain the average RGB grayscale value <NUM> of (<NUM>, <NUM>, <NUM>), and control the light-emitting state of the plurality of LEDs <NUM> based on the obtained average RGB grayscale value <NUM>.

As a result, the display apparatus <NUM> may provide the lighting effect <NUM> corresponding to the average value of at least one of a color or a brightness felt by the user through the content displayed on the area of interest <NUM>.

<FIG> and <FIG> are views provided to explain an operation of providing a lighting effect based on a representative light-emitting value of a display apparatus according to various embodiments of the disclosure.

Referring to <FIG>, the colors that can be represented through three colors of R, G and B may be divided into a plurality of sections according to a certain standard. For example, when the grayscale values of R, G and B are divided into <NUM> equal parts, the colors that can be represented through the three colors of R, G and B are divided into <NUM> sections.

Assuming that the X axis of the RGB color space corresponds to the R grayscale value, the Y axis corresponds to the G grayscale value, and the Z axis corresponds to the B grayscale value, the memory <NUM> may store information regarding the RGB color space which is divided into a plurality of sections according to a certain standard and representative light-emitting values corresponding to the R, G and B grayscale values of a point <NUM> in the color space having the largest R, G and B grayscale values in a corresponding section <NUM> in relation to a specific section <NUM> in the color space.

Referring to <FIG>, the display apparatus <NUM> may provide a content of an FPS type. The processor <NUM> may identify a center area of an image as the area of interest <NUM>, and obtain grayscale data of pixels included in the identified area of interest <NUM>.

For example, a first pixel <NUM> from among the plurality of pixels included in the area of interest <NUM> may have the RGB grayscale value of (<NUM>, <NUM>, <NUM>), second to fourth pixels (<NUM> to <NUM>) may have the RGB grayscale values of (<NUM>, <NUM>, <NUM>), (<NUM>, <NUM>, <NUM>) and (<NUM>, <NUM>, <NUM>), respectively. The processor <NUM> may obtain RGB grayscale values corresponding to the plurality of pixels in the area of interest <NUM> including the first to fourth pixels (<NUM> to <NUM>) and identify each of the sections to which the RGB grayscale values corresponding to the plurality of pixels belong based on the information stored in the memory <NUM>.

The processor <NUM> may identify a section including the most RGB grayscale values corresponding to the plurality of pixels included in the area of interest from among the plurality of sections dividing the color space as a first section, identify a section including the next most RGB grayscale values after the first section as a second section, and identify each of the representative light-emitting values of the first and second sections. For example, the processor <NUM> may identify a representative light-emitting value P1 (<NUM>) of the first section as (R= <NUM>/<NUM>, G= <NUM>/<NUM>, B= <NUM>/<NUM>) and a representative light-emitting value P2 (<NUM>) of the second section as (R= <NUM>/<NUM>, G= <NUM>/<NUM>, B= <NUM>/<NUM>), and control the light-emitting state of the plurality of LEDs <NUM> based on the identified representative light-emitting value <NUM> of the first section and the identified representative light-emitting value <NUM> of the second section.

Specifically, the display apparatus <NUM> may include the first LED <NUM>-<NUM> provided on a bezel area of the display <NUM> and the second LED <NUM>-<NUM> provided on a rear side of the display <NUM>, and the processor <NUM> may control the light-emitting state of the first LED <NUM>-<NUM> based on the representative light-emitting value <NUM> of the first section and the light-emitting state of the second LED <NUM>-<NUM> based on the representative light-emitting value <NUM> of the second section.

Through the above, the display apparatus <NUM> may provide two lighting effects <NUM>, <NUM> corresponding to two major color types felt by the user through the content displayed on the area of interest <NUM>.

<FIG> is a view provided to explain an operation of providing a lighting effect based on a change in an RGB grayscale value for each frame of a display apparatus according to an embodiment of the disclosure.

Referring to <FIG>, the processor <NUM> may obtain the first RGB grayscale data included in the area of interest <NUM> of a first frame <NUM> included in the game image of the FPS type and the second RGB grayscale data included in the area of interest <NUM> of the second frame <NUM>. In addition, the processor <NUM> may identify a difference between a pixel value included in the second frame <NUM> and a pixel value included in the first frame <NUM> based on the first RGB grayscale data and the second RGB grayscale data.

In the FTS-type game, when only the player's viewpoint is moved in a state in which shooting is not made, the difference between the RGB grayscale values included in the area of interest of the two adjacent frames (i.e., the first frame <NUM> and the second frame <NUM>) may not be large. However, when shooting is made, the difference between the RGB grayscale values included in the area of interest of the two adjacent frames (i.e., the first frame <NUM> and the second frame <NUM>) may increase rapidly due to a shooting effect <NUM> generated from the muzzle.

If the difference between the RGB grayscale values included in the area of interest <NUM> of the two adjacent frames (i.e., the first frame <NUM> and the second frame <NUM>) is equal to or greater than a threshold value, the light-emitting state of the plurality of LEDs <NUM> may be controlled based on the RGB grayscale values included in the area of interest <NUM> of the second frame <NUM>.

Through the above, the display apparatus <NUM> may provide a lighting effect corresponding to a frame in which an effect to which the user reacts sensitively, such as the shooting effect <NUM>, occurs, increasing the user's immersion in the game content.

<FIG> and <FIG> are views provided to explain an operation of changing an area of interest of a display apparatus according to various embodiments of the disclosure.

When the user <NUM> wishes to change at least one of the size or location of the area of interest for each predetermined game type, a user command to change the area of interest of a specific game type may be input through the user interface <NUM>.

Referring to <FIG>, when a game image <NUM> of the FPS type is provided through the display <NUM>, the processor <NUM>, according to an embodiment of the disclosure, may identify the center area of the image <NUM> as the area of interest <NUM>.

When a user command <NUM> to change the area of interest of the FPS type is input through the user interface <NUM>, the processor <NUM> may update information regarding the area of interest corresponding to the FPS type stored in the memory <NUM> based on the user command <NUM>.

If the user command <NUM> is a command to enlarge the size of the existing area of interest <NUM>, the processor <NUM> may store information regarding the area of interest <NUM> enlarged based on the user command <NUM> in the memory <NUM> as information regarding the area of interest corresponding to the FPS type.

As a result, the processor <NUM> may control at least one of the color or brightness of the plurality of LEDs <NUM> based on RGB grayscale data of pixels included in the area of interest of which size is enlarged compared to the previous size in a game image <NUM> provided after the update is performed.

Referring to <FIG>, when a game image <NUM> of the MOBA type is provided through the display <NUM>, the processor <NUM>, according to an embodiment of the disclosure, may identify a lower left area of the image <NUM> as the area of interest <NUM>.

When a user command <NUM> to change the area of interest of the MOBA type is input through the user interface <NUM>, the processor <NUM> may update information regarding the area of interest corresponding to the MOBA type stored in the memory <NUM> based on the user command <NUM>.

If the user command <NUM> is a command to move the existing location of the area of interest <NUM>, the processor <NUM> may store information regarding the area of interest <NUM> which is moved based on the user command <NUM> as information regarding the area of interest corresponding to the MOBA type.

As a result, the processor <NUM> may control at least one or a size or a brightness of the plurality of LEDs <NUM> based on RGB grayscale data or pixels included in the area of interest <NUM> which is moved to a location different from the previous location in a game image that is provided after update is performed.

<FIG> and <FIG> explain that the user command <NUM> inputs a user command through a touch input, but the present disclosure is not limited thereto. The user <NUM> may transmit a control signal corresponding to a user command for changing the area of interest to the display apparatus <NUM> by manipulating a remote control device (not explaind).

<FIG> is a block diagram provided to specifically explain functional configuration of a display apparatus according to an embodiment of the disclosure.

Referring to <FIG>, the display apparatus <NUM> may include the display <NUM>, the user interface <NUM>, the memory <NUM>, the plurality of LEDs <NUM>, the processor <NUM>, a communication interface <NUM>, and a speaker <NUM>. The detailed description of the components explaind in <FIG> which are overlapped with those explaind in <FIG> will be omitted.

The communication interface <NUM> may input and output data of various types. For example, the communication interface <NUM> may transmit/receive various types of data to and from the display apparatus <NUM> through a communication method, such as AP-based wireless LAN network (Wi-Fi), Bluetooth™, Zigbee, a wired/wireless local area (LAN), a wide area network (WAN), ethernet, institute of electrical and electronics engineers (IEEE) <NUM>, a high-definition multimedia interface (HDMI), a universal serial bus (USB), a mobile high-definition link (MHL), audio engineering society/ European broadcasting union (AES/EBU), optical, coaxial, or the like. More particularly, the processor <NUM> may control the communication interface <NUM> to receive information regarding a content provided through the display <NUM>. In addition, the processor <NUM> may control the communication interface <NUM> to transmit information regarding the provision of the lighting effect to a user terminal (not explaind).

The speaker <NUM> is a device for converting an electroacoustic signal corresponding to the audio generated from the processor <NUM> and provided by the display apparatus <NUM> into sound waves. The speaker <NUM> may include a permanent magnet, a coil and a diaphragm, and may output sound by vibrating the diaphragm by electromagnetic interaction between the permanent magnet and the coil. For example, the processor <NUM> may control the speaker <NUM> to output audio corresponding to a game image provided through the display <NUM>.

<FIG> is a flowchart provided to explain a controlling method according to an embodiment of the disclosure.

Referring to <FIG>, the controlling method, according to an embodiment of the disclosure, includes obtaining information related to a game type selected by the user at operation S910.

Subsequently, an area of interest corresponding to the selected game type is identified based on information regarding an area of interest for each game type at operation S920.

Then, RGB grayscale data of a pixel corresponding to the identified area of interest in a game image provided through the display is obtained at operation S930.

Lastly, a plurality of LEDs may be driven based on the obtained RGB grayscale data at operation S940.

Here, in an operation of obtaining RGB grayscale data at operation S930, RGB grayscale data of a pixel included in the area of interest may be obtained in units of a predetermined first time section, and in an operation of driving a plurality of LEDs at operation S940, the plurality of LEDs may be driven based on the obtained RGB grayscale data.

In addition, an operation of driving a plurality of LEDs at operation S940 may include obtaining an average value of an R grayscale value, an average value of a G grayscale value and an average value of a B grayscale value of pixels included in the area of interest and driving a plurality of LEDs based on the R average value, the G average value and the B average value.

In addition, an operation of driving a plurality of LEDs at operation S940 may include identifying a range to which a pixel value of the area of interest belongs from among a plurality of pixel value ranges based on RGB grayscale data included in the area of interest and driving a plurality of LEDs based on a representative light-emitting value corresponding to the identified range.

Here, the plurality of LEDs include a first LED provided on a bezel area of a display and a second LED provided on a rear side of the display, and an operation of driving a plurality of LEDs at operation S940 may include identifying a first range and a second range to which a pixel value of the area of interest belongs from among the plurality of pixel value ranges based on the RGB grayscale data included in the area of interest and driving the first LED based on a first representative light-emitting value corresponding to the first range and the second LED based on a second representative light-emitting value corresponding to the second range.

Meanwhile, an operation of obtaining RGB grayscale data at operation S930 may include obtaining first RGB grayscale data included in the area of interest of a first frame included in a game image and second RGB grayscale data included in the area of interest of a second frame, and an operation of driving a plurality of LEDs at operation S940 may include, based on a difference between a pixel value included in the second frame and a pixel value included in the first frame being equal to or greater than a threshold value based on the first RGB grayscale data and the second RGB grayscale data, driving the plurality of LEDs based on the pixel value included in the second frame.

In addition, information regarding an area of interest for each game type may include information regarding different locations of an image for each game type, and the different locations of the image may include at least one of a center area, a lower left area or a lower right area of the image.

In addition, the controlling method may further include, based on a user command to change the area of interest of a specific game type being input, updating information regarding the area of interest corresponding to the specific game type based on the user command.

Further, an operation of driving a plurality of LEDs at operation S940 may include adjusting at least one of a color or a brightness of the plurality of LEDs based on RGB grayscale data of a pixel corresponding to the identified area of interest.

Meanwhile, the methods according to the diverse embodiments of the disclosure described above may be implemented in the form of an application that may be installed in an existing display apparatus.

In addition, the methods according to the diverse embodiments of the disclosure described above may be implemented only by software upgrade or hardware upgrade for the existing display apparatus.

Further, the diverse embodiments of the disclosure described above may also be performed through an embedded server included in the display apparatus or at least one external server.

Meanwhile, the above-described various embodiments may be implemented in a recording medium that is readable by a computer or a similar device using software, hardware of a combination thereof. In some cases, the embodiments described in the disclosure may be implemented by the processor <NUM> itself. According to software implementation, the embodiments, such as procedures and functions described in the disclosure may be implemented by separate software modules. Each of the software modules may perform one or more functions and operations described in the disclosure.

The computer instructions for performing the processing operation of the display apparatus <NUM> according to the above-described various embodiments of the disclosure may be stored in a non-transitory computer-readable medium. The computer instructions stored in such a non-transitory computer-readable medium may cause a specific device to perform the processing operation of the display apparatus <NUM> according to the above-described various embodiments when they are executed by the processor of the specific device.

The non-transitory computer readable medium is not a medium that stores data for a while, such as a register, a cache, a memory, or the like, but means a medium that semi-permanently stores data and is readable by an apparatus. Specifically, the non-transitory readable medium may include a compact disc (CD), a digital versatile disc (DVD), a hard disc, a Blu-ray disc, a universal serial bus (USB), a memory card, a read only memory (ROM), or the like.

Claim 1:
A display apparatus (<NUM>) comprising:
a display (<NUM>);
a user interface (<NUM>);
a memory (<NUM>) configured to store information regarding an area of interest for each game type, and a representative light-emitting value for each of a plurality of pixel value ranges;
a plurality of light emitting diodes (LEDs) (<NUM>) provided on one area of the display and configured to emit light in various colors; and
a processor (<NUM>) configured to:
based on information related to a game type being selected through the user interface, identify an area of interest corresponding to the selected game type based on the information stored in the memory, and
control a light-emitting state of the plurality of LEDs based on red, green, and blue (RGB) grayscale data of a pixel corresponding to the identified area of interest in a game image provided through the display,
wherein the plurality of LEDs comprise a first LED and a second LED, each located in a different area of the display apparatus,
wherein the processor (<NUM>) is further configured to:
identify a first range and a second range to which a pixel value of the area of interest belongs from among the plurality of pixel value ranges based on RGB grayscale data included in the area of interest,
control a light-emitting state of the first LED based on a first representative light-emitting value corresponding to the first range, and
control a light-emitting state of the second LED based on a second representative value corresponding to the second range,
wherein the first range comprises a pixel value range to which most pixels belong, and
wherein the second range comprises a pixel value range to which next most pixels belong.