Patent Description:
In general, a display device displays an image on a screen. By using the display device, various functions may be embodied. One of the functions is a video wall. A function of the video wall refers to a function of recognizing a plurality of display devices as one screen and enlarging an image into 1X4, 2X2, 3X3, and 4X4 to display the image. The function of the video wall may be used to allow a user to visually recognize an image displayed on a screen at a glance by enlarging one image into the plurality of display devices to display. Such video wall function may be used at a conference room, a presentation, at an exhibition hall, in traffic condition, in securities businesses, or the like.

A video wall is configured in view of the number of display devices, a scenario desired to be displayed, a model of a displayed set, a locational configuration of the set, or the like. However, it is not easy for a user to configure the video wall in consideration of all of them. For example, there has been an inconvenience to set a video wall individually in view of a layout and identification information of a plurality of display devices configuring the video wall.

<CIT> describes multiple electronic displays arranged to define an ensemble of the user's choosing. <CIT> describes a system for identifying, placing and configuring a physical arrangement of a plurality of displays via image analysis of captured digital camera images depicting unique configuration images output to said displays to facilitate uniform operation of said plurality of displays as a single display area for example as a video wall. <CIT> describes moving and/or still image(s) aligned to multiple display devices. <CIT> describes systems and methods that allow a display device array to be used to present content to one or more users. <CIT> describes an automatic detection method of an arrangement of a video wall including a plurality of monitors and a video wall system.

Various embodiments of the disclosure provide an electronic device that automatically identifies layout and identification information of a plurality of display devices forming a video wall, thereby reducing a human error and increasing user convenience, and a control method thereof.

According to the various embodiments the layout and the identification information of the video wall based on a photographed image without any additional operation of a user, improves convenience and accuracy of the user.

Hereinafter, the present disclosure will be described more fully with reference to the accompanying drawings.

Terms used in the present specification will be briefly explained, and the present disclosure will be described in greater detail.

The terms used in embodiments of the present disclosure are selected as general terminologies currently widely used in consideration of the configuration and functions of the present disclosure, but can be different depending on intention of those skilled in the art, a precedent, appearance of new technologies, and the like. Further, in specific cases, terms may be arbitrarily selected. In this case, the meaning of the terms will be described in the description of the corresponding embodiments. Accordingly, the terms used in the description should not necessarily be construed as simple names of the terms, but be defined based on meanings of the terms and overall contents of the present disclosure.

The embodiments of the present disclosure may vary, and may be provided in different embodiments. Specific embodiments will be described with reference to accompanying drawings and be described in detail in the specific description. However, this does not necessarily limit the scope of specific embodiments forms. Instead, modifications, equivalents and replacements included in the disclosed concept and technical scope of this specification may be employed. While describing embodiments, if it is determined that the specific description regarding a known technology obscures the gist of the disclosure, the detailed description may be omitted.

In the present application, the terms "include" and "comprise" designate the presence of features, numbers, steps, operations, components, elements, or a combination thereof that are written in the specification, but do not exclude the presence or possibility of addition of one or more other features, numbers, steps, operations, components, elements, or a combination thereof.

The expression at least one of A and/or B represents any one of either "A" or "B" or "A and B".

The expression "<NUM>", "<NUM>", "first", or "second" as used herein may be used with a variety of elements and/or functions without limiting the elements and/or functions, irrespective of order and/or importance thereof, and only to distinguish one element and/or functions from another.

When an element (e.g., a first element) is "operatively or communicatively coupled with/to" or "connected to" another element (e.g., a second element), an element may be directly coupled with another element or may be coupled through the other element (e.g., a third element).

In the present disclosure, a 'module' or a 'unit' performs at least one function or operation and may be implemented as hardware or software or a combination of the hardware and the software. In addition, a plurality of 'modules' or a plurality of 'units' may be integrated into at least one module and may be at least one processor except for 'modules' or 'units' that should be realized in a specific hardware. Also, the term "user" may refer to a person who uses an electronic apparatus or an apparatus (e.g., an artificial intelligence (AI) electronic apparatus) that uses the electronic apparatus.

The embodiments of the present disclosure will be described in greater detail below in a manner that will be understood by one of ordinary skill in the art. However, the present embodiments may be realized in a variety of different configurations, and not limited to descriptions provided herein. Also, well-known functions or constructions are not described in detail since they would obscure the invention with unnecessary detail.

Hereinafter, the embodiments of the disclosure will be described more fully with reference to the drawings.

<FIG> is a diagram illustrating an electronic system according to an embodiment.

An electronic system <NUM> includes an electronic device <NUM> and a plurality of display devices <NUM> forming a video wall.

According to an embodiment, the electronic device <NUM> is a device that obtains layout information, or the like, of a video wall from a photographed image of the video wall including the plurality of display device <NUM>, and may be implemented as a device including, for example, and without limitation, a camera that may photograph the video wall including the plurality of display devices <NUM>. For example, the electronic device <NUM> may be implemented as various electronic devices including, for example, and without limitation, a smartphone, a tablet PC, a mobile phone, a desktop PC, a laptop PC, a netbook computer, a PDA, a portable multimedia player(PMP), a MP3 player, a camera, a wearable device, or the like. According to another embodiment, the electronic device <NUM> may be implemented as a device receiving a photographed image of the video wall from an external camera and obtaining layout information of the video wall from the received image.

The plurality of display devices <NUM> form a video wall. The video wall is a system that recognizes the plurality of display devices as one screen, and may divide an image into a plurality of images, enlarge and display the divided images to display on the screen.

For example, as illustrated in <FIG>, the plurality of display devices (<NUM>-<NUM> to <NUM>-<NUM>) are arranged in the form of <NUM> by <NUM> (2x2). That is, the plurality of display devices are arranged such that there are two display devices horizontally and two display devices vertically. This is merely an example for convenience of description, and a total number and an arrangement of display devices forming the video wall may be variously changed.

In order to control the video wall including the plurality of display devices <NUM>, obtaining layout information of arranged plurality display devices <NUM> and identification information of the plurality of display devices <NUM> is required. Hereinafter, various embodiments will be described in detail with reference to figures of the present disclosure.

<FIG> is a block diagram illustrating an operation of an electronic device according to an embodiment.

Referring to <FIG>, the electronic device <NUM> includes a storage <NUM> and a processor <NUM>.

The storage <NUM> stores various data necessary for operating the electronic device <NUM>.

The storage <NUM> may be implemented as an internal memory such as a ROM (e.g., electrically erasable programmable read-only memory (EEPROM)), a RAM, or the like, included in the processor <NUM>, or may be implemented as a separate memory from the processor <NUM>. In this case, the storage <NUM> may be implemented in a form of a memory embedded in the electronic device <NUM> or a detachable memory from the electronic device <NUM> depending on a purpose of data storage. Meanwhile, the memory embedded in the electronic device <NUM> may be implemented in a form of a non-volatile memory, a volatile memory, a hard disk drive (HDD), a solid state drive (SSD), or the like.

For example, the storage <NUM> may store mapping information in which identification information and an identification image of the plurality of display devices <NUM> are mapped. The identification information may include information of a product name, a model name, a Mac Address, and the like of each of the plurality of display devices <NUM>. In addition, the identification image may be an image displayed in one area of the display devices <NUM> as an image representing an ID of the display devices <NUM>. For example, the identification image may include at least one of a QR code, a corner symbol, a border symbol, or a bar code, and this will be described in detail below.

The storage <NUM> may also store information of a screen shape, a screen size, and a bezel size of the display devices <NUM>. In addition, the storage <NUM> may store a photographed image of the display devices <NUM>.

The storage <NUM> may receive mapping information where identification information and identification image of the plurality of display devices <NUM> are mapped from the plurality of display devices <NUM> and store the mapping information, or may receive the mapping information from an external server (not shown), and store the same.

The processor <NUM> controls overall operations of the electronic devices <NUM>.

According to an embodiment, the processor <NUM> may be implemented as a distal signal processor (DSP) which processes a digital signal, a microprocessor, or a time controller (TCON), but this is not limited thereto. The processor <NUM> may include, for example, and without limitation, one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), or a communication processor (CP), an advanced reduced machine (ARM) processor, or the like, or may be defined as a corresponding term. Also, the processor <NUM> may be implemented as a system on chip (SoC) or a large scale integration (LSI) with a processing algorithm therein, or as in a form of a field programmable gate array (FPGA). The processor <NUM> may perform various functions by executing computer executable instructions stored in the storage <NUM>.

According to an embodiment, the processor <NUM> may obtain a photographed image of a video wall including the plurality of display devices <NUM> displaying an identification image. The video wall may be a system that recognizes the plurality of display devices <NUM> as one screen. The video wall may divide an image into a plurality of images, enlarge and display the divided plurality of images to display. The processor <NUM> may obtain the photographed image of the video wall through a camera (not shown) included in the electronic device <NUM>, or may obtain the photographed image by receiving it from the video wall, or from an external camera (not shown).

The identification image displayed by each of the plurality of display devices <NUM> is an image representing an ID of the display device <NUM>, and may be an image displayed in one area of each of the plurality of display devices <NUM>. For example, the identification image may include at least one of a QR code, a corner symbol, a border symbol, or a bar code, and this will be described in <FIG>.

<FIG> is a diagram illustrating an identification image according to an embodiment.

Each of the plurality of display devices <NUM> may display an identification image based on a predetermined event. The predetermined event may be at least one of an event that the plurality of display devices <NUM> enter into an identification image display mode, an event that the plurality of display devices <NUM> are connected to an external server, an event that a predetermined button of the electronic device <NUM> is pressed and operated, or an event that a power of the plurality of display devices <NUM> is turned on. When the predetermined event occurs, the plurality of display devices <NUM> may display the identification image in one area of each screen for a predetermined time.

<FIG> is a diagram illustrating a case in which an identification image is implemented as a QR code.

As shown in <FIG>, each of the plurality of display devices <NUM> may display QR codes which are different from each other in one area of a screen based on a predetermined event. The QR code refers to a plaid code that may include various data.

The processor <NUM> may obtain a QR code corresponding to each of the plurality of display devices <NUM> from a photographed image, and may obtain identification information of each of the plurality of display devices based on the obtained QR code. For example, the processor <NUM> may obtain a product name, a model name, a Mac address of each of the plurality of display devices <NUM> based on the obtained QR code. Also, the processor <NUM> may obtain information including a screen shape, a screen size, and a bezel size of the plurality of display devices based on the obtained QR code. Also, the processor <NUM> may identify whether the plurality of display devices <NUM> are in a regular arrangement state or an irregular arrangement state based on the obtained QR code. The regular arrangement may be a display configuration having a rectangular shape of a predetermined aspect ratio (e.g., 2x2, 3x1 and 3x2), and the irregular arrangement may not be a rectangular shape, but may be a display configuration configured arbitrarily by a user, or a display configuration that the plurality of display devices <NUM> are superimposed.

<FIG> is a diagram illustrating a case that an identification image is implemented as a corner symbol.

The corner symbol, as shown in <FIG>, may be a symbol displayed in a corner area of each of the plurality of display devices <NUM>. That is, the corner symbol may be a predetermined image displayed in the corner area of a screen of the display devices. For example, in case of a rectangular display device, a corner symbol may be displayed on four corner areas.

The corner symbol may be distinguished based on at least one of size, shape or arrangement location. That is, the corner symbol may be mapped to display devices which are different from each other based on at least one of size, shape or arrangement location.

A shape of the corner symbol may be implemented in various shapes such as a crook shape, a straight line shape, a triangle shape, a square shape, or the like. For example, a crook-shaped corner symbol may refer to a display device having a model name of Q1, and a triangle-shaped corner symbol may refer to a display device having a model name of Q2. The corner symbol may be distinguished based on its length or size, even if it is a symbol having the same shape.

For example, a model name of Q3 may be referred to as a display device having corner symbols of upper left and upper right are <NUM> in width and <NUM> in length as a straight line, and corner symbols of lower left and lower right are <NUM> in width and <NUM> in length. A model name Q4 may be referred to as a display device having corner symbols of upper left and upper right are <NUM> in width and <NUM> in length, and corner symbols of lower left and lower right are <NUM> in width and <NUM> in length. As such, a predetermined identification image may be mapped to represent a specific display device.

The processor <NUM> may identify whether the plurality of display devices <NUM> are in a regular arrangement state or an irregular arrangement state based on an identification image obtained from a photographed image. For example, if four corner symbols are not identified in one rectangular display device, the processor <NUM> may identify one area of the display device is superimposed on the other display device, and may identify the plurality of display devices <NUM> as the irregular arrangement state. The processor <NUM> may identify the plurality of display devices <NUM> as the regular arrangement state if all of the four corner symbols are identified and if a screen configuration having a rectangular shape with a predetermined aspect ratio (e.g., 2x2, 3x1, 3x2) is identified.

<FIG> is a diagram illustrating a case that an identification image is implemented with a border symbol.

The border symbol, as described in <FIG> may be a symbol displayed in a border area of each of the plurality of display devices <NUM>. That is, the border symbol may be a predetermined image displayed in the border area of a screen of the display device. For example, in a case of a rectangular shape of a display device, the border symbol of the rectangular shape may be displayed.

The border symbol may be distinguished based on at least one of size, shape, or arrangement location of a display device. That is, the border symbol may be mapped to display devices which are different from each other based on at least one of size, shape, or arrangement location. For example, the border symbol may be distinguished according to a size (thickness) of symbols.

A shape of the border symbol may be determined based on a shape of a display device. Since the display device is generally implemented with a rectangular shape, the border symbol may be implemented with a rectangular shape. However, even if the display device is implemented with the rectangular shape, the border symbol may be implemented with various shapes such as a circular shape.

The processor <NUM> may identify whether the plurality of display devices <NUM> are in a regular arrangement state or an irregular arrangement state based on the border symbol obtained from a photographed image. For example, when a disconnected border symbol is identified on one rectangular display device, the processor <NUM> may identify one area of one display device is superimposed on another display device, and may identify the plurality of display devices <NUM> as the irregular arrangement state. The processor <NUM> may identify the plurality of display device <NUM> as the regular arrangement state if a border symbol without disconnection and if a screen configuration having a rectangular shape with a predetermined aspect ratio (e.g., 2x2, 3x1, 3x2) is identified.

<FIG> describes a QR code, a corner symbol and a border symbol as an example of an identification image, but this is not limited thereto. An image representing an ID of the display devices, such as a barcode, may be implemented as various shapes.

Referring to <FIG>, the processor <NUM> may obtain layout information of the video wall from a photographed image.

The layout information may include the number and arrangement information of the display devices <NUM>. The arrangement information may include a regular arrangement and an irregular arrangement. The regular arrangement may be a screen configuration having a rectangular shape with a predetermined aspect ratio (e.g., 2x2, 3x1, 3x2), and the irregular arrangement may not be a rectangular shape but be a screen configuration configured arbitrarily by a user, or a screen configuration in which the plurality of display devices <NUM> are superimposed.

For example, the processor <NUM> may obtain layout information of the video wall from a photographed image through an image recognition technique. For example, the processor <NUM> may explore an entire area of the photographed image through a window sliding technique and obtain the layout information of the video wall. For instance, the processor <NUM> may divide the entire area of the photographed image into n*m blocks. The processor <NUM> may scan each block using a window with a predetermined size to obtain a feature value of each block. The processor <NUM> may compare the obtained feature value of each block to obtain layout information including the number, arrangement information, and the like, of the display devices <NUM>. For example, the processor <NUM> may obtain layout information in which the number of the plurality of display devices <NUM> are four and the devices are in a regular arrangement of <NUM> by <NUM><NUM> (2x2). The window sliding technique may be an example of the image recognition technique, and use various embodiments that obtain layout information of the video wall using an artificial neural network.

The processor <NUM> may obtain an identification image corresponding to each of the plurality of display devices <NUM> and obtain identification information of each of the plurality of display devices <NUM> based on mapping information and the identification image.

For example, when the identification image is implemented as a QR code, the processor <NUM> may obtain identification information based on the identification image through a QR code reader. When the identification image is implemented as a corner symbol, the processor <NUM> may obtain the identification image based on at least one information of size, shape, and display position of the corner symbol, and then the processor <NUM> may obtain the identification information of each of the plurality of display devices <NUM> by comparing mapping information to which the identification image is mapped and information of the obtained identification image. The identification information may include a product name, a model name, and a Mac address of each of the plurality of display devices.

For example, it is assumed that an identification image having a feature that an upper left and upper right corner symbols are <NUM> in width and <NUM> in length, and a lower left and lower right corner symbols are <NUM> in width and <NUM> in length, is mapped to a display device having a model name of Q1. Such mapping information may be stored in the storage <NUM>.

When an identification image obtained from a photographed image has a corner symbol in which an upper left and upper right symbols are <NUM> in width and <NUM> in length, and a lower left and lower right symbols are <NUM> in width and <NUM> in length, the processor <NUM> may identify, based on the mapping information mapped to such identification image, that a corresponding display device is a display device having the model name of Q1.

The processor <NUM> may obtain arrangement state information of the plurality of display devices <NUM> included in the video wall based on the obtained identification information and layout information. The arrangement state information may refer to information including layout information and identification information of the plurality of display devices <NUM>. For example, it is assumed that the plurality of display devices <NUM> are formed as <NUM> by <NUM> (2x2). The arrangement state information refers to information including not only layout information that an arrangement of the video wall is formed as <NUM> by <NUM> (2x2), but also identification information that an upper left of the display device is a display device having a model name of Q1.

According to an embodiment, the processor <NUM> may obtain information including a screen shape, a screen size, and a bezel size of a corresponding display devices based on the obtained identification information, and may obtain an arrangement state information of the plurality of display devices based on the obtained information and the layout information.

For example, the processor <NUM> may receive information including a screen shape, a screen size, and a bezel size of a display device corresponding to an identified model name based on the obtained identification information. When information including a screen shape, a screen size and a bezel size of various display devices is stored in the storage <NUM>, the processor <NUM> may obtain information including a screen shape, a screen size and a bezel size of a corresponding display device from the storage <NUM>, based on the obtained identification information. The processor <NUM> may obtain information including a screen shape, a screen size, and a bezel size to obtain accurate arrangement state information of the plurality of display devices <NUM>.

For example, it is assumed that the arrangement state information of the plurality of display devices <NUM> is obtained from a photographed image. In this case, if the video wall including the plurality of display devices <NUM> is photographed from the side and not being photographed at the front, a size information of the display device may be in accurate. Accordingly, the processor <NUM> may obtain accurate arrangement state information of the plurality of display devices <NUM> based on information including a screen shape, a screen size and a bezel size, and layout information.

The processor <NUM> may control a display (not shown) to display a UI for setting contents of the video wall based on the arrangement state information of the plurality of display devices <NUM>. The UI for setting contents of the video wall will be described with reference to <FIG> and <FIG>.

<FIG> and <FIG> are diagrams illustrating a UI for setting contents of a video wall according to an embodiment.

<FIG> is a diagram illustrating a plurality of display devices forming a video wall arranged on one side, and <FIG> is a diagram illustrating a UI for setting contents of a video wall based on arrangement state information of the plurality of display devices <NUM> arranged in <FIG>.

As illustrated in <FIG>, it is assumed the plurality of display devices <NUM> are regularly arranged in the form of <NUM> by <NUM> (3x2).

The processor <NUM> may obtain identification information based on layout information and an identification image from a photographed image of the plurality of display devices <NUM>, illustrated in <FIG>, to obtain arrangement state information of the plurality of display devices <NUM>. Since such process has been described, a detailed description may be omitted.

The processor <NUM> may display the UI for setting contents of the video wall based on the obtained arrangement state information. For example, the processor <NUM> may display the UI reflected a regular arrangement of 3x2 as the plurality of display devices arranged on one side. In addition, the processor <NUM> may display the identification information of the display device on the UI. For example, the processor <NUM> may display identification information such as a product name, a model name, a Mac address, and the like, on an upper left of the display device UI. For example, as illustrated in <FIG>, information that a model name of an upper left of a display device is Q1 may be displayed. Accordingly, a user may easily recognize not only layout information that the display devices are regularly arranged in the form of <NUM> by <NUM> (3x2), but also identification information of each of the display devices according to an arrangement state.

The UI for setting contents of the video wall may display a video wall setup window, a source selection window for selecting data source to reflect on the video wall system, and a file explorer for searching a corresponding file. Accordingly, users may select data source they want and reflect it on the video wall system.

<FIG> is a diagram illustrating a method of applying a selected data source or file to a video wall setup window according to an embodiment.

<FIG> is a diagram illustrating a UI for setting contents of a video wall including a plurality of display devices <NUM> which are regularly arranged. <FIG> is a diagram illustrating a UI for setting contents of a video wall including a plurality of display devices <NUM> which are irregularly arranged.

When the UI for setting contents of the video wall based on an arrangement state information of the plurality of display devices <NUM>, users may apply a source or file that they want to a UI window for setting contents of the video wall using a drag & drop method. Accordingly, the source or file selected by the user may be applied to the UI window for setting the video wall, so that a scenario may be confirmed in advance, and the source or file selected by the user may be displayed on the video wall system when it is actually applied to the video wall system.

Accordingly, the user may easily control the video wall system through the UI window that the arrangement state information is reflected.

Referring to <FIG>, the processor <NUM> may identify whether the plurality of display devices <NUM> are in a regular arrangement state or an irregular arrangement state, and provide candidate contents corresponding to the identified arrangement state on the UI.

According to an embodiment, the processor <NUM> may identify a state of the plurality of display devices <NUM> whether they are arranged regularly or irregularly based on at least one of the obtained layout information or identification image. For example, if four corner symbols are not identified in one rectangular-shaped display device, the processor <NUM> may identify one area of one display device is superimposed on the other display device, and identify the plurality of display devices <NUM> as an irregular arrangement state. When all of the four corner symbols are identified and a screen configuration having a rectangular shape as a predetermined aspect ratio (e.g., 2x2, 3x1, 3x2) is identified, the processor <NUM> may identify the plurality of display devices <NUM> as a regular arrangement state.

Then, the processor <NUM> may provide candidate contents corresponding to the identified arrangement state. The plurality of display devices arranged regularly are appropriate for displaying an entire image. So, when it is identified that the display devices are in a regular arrangement state, the processor <NUM> may provide one image or a plurality of images related to each other as the candidate contents. In addition, the plurality of display devices arranged irregularly are appropriate for displaying an individual image, the processor <NUM> may provide the plurality of images as the candidate contents if it is identified that the devices are irregularly arranged.

<FIG> is a block diagram illustrating a detailed configuration of an electronic device <NUM>.

According to <FIG>, the electronic device <NUM> includes a storage <NUM>, a processor <NUM>, a communicator <NUM>, a display <NUM>, and a camera <NUM>. Regarding <FIG>, a detailed description regarding parts which are overlapped with <FIG> are omitted.

The storage <NUM> may be implemented in a form of a memory embedded in the electronic device <NUM> or a removable memory from the electronic device <NUM> depending on a purpose of data storage. For example, data for operating the electronic device <NUM> may be stored in the memory embedded in the electronic device <NUM> and data for an expanded function of the electronic device <NUM> may be stored in the removable memory from the electronic device <NUM>. The memory embedded in the electronic device <NUM> may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one-time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard driver, solid state drive (SSD), or the like, and the removable memory in the electronic device <NUM> may be implemented as a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC)), an external memory (e.g., USB memory) that can be connected to a USB port, or the like.

The processor <NUM> controls overall operations of the electronic device <NUM> using various programs stored in the storage <NUM>.

For example, the processor <NUM> includes a random access memory (RAM) <NUM>, a read only memory (ROM) <NUM>, a main central processing unit (CPU) <NUM>, first through nth interfaces (<NUM>-<NUM> to <NUM>-n), and a bus <NUM>.

In this case, the RAM <NUM>, the ROM <NUM>, the main CPU <NUM>, the first to nth interfaces <NUM>-<NUM> to <NUM>-n, and so on may be concatenated with each other through the bus <NUM>.

The ROM <NUM> stores a set of instructions for system booting. When a turn on instruction is input to supply power, the main CPU <NUM> copies an O/S stored in the storage <NUM> to the RAM <NUM> according to the instruction stored in the ROM <NUM> and executes the O/S to boot the system. When the booting is completed, the main CPU <NUM> copies various application programs stored in the storage <NUM> into the RAM <NUM>, and executes the application programs copied into the RAM <NUM> to perform various operations.

The main CPU <NUM> may access to the storage <NUM> to perform booting using an O/S stored in the storage <NUM>. In addition, the CPU <NUM> may perform various operations using various programs, content, data, and the like, which are stored in the storage <NUM>.

The first to nth interfaces (<NUM>-<NUM> to <NUM>-n) may be concatenated with the aforementioned various components. One of the interfaces may be network interface which is connected to an external device via a network.

The communicator <NUM> may communicate with an external device (not shown) or with the plurality of display devices <NUM> forming the video wall. For example, the communicator <NUM> may perform communication with an external device or external server according to a wired or wireless manner, and may perform communication using various communication methods such as Bluetooth (BT), Wireless Fidelity (WI-FI), Zigbee, Infrared (IR), Serial Interface, Universal Serial Bus (USB), NFC (Near Field Communication), V2X (Vehicle to Everything), mobile communication (Cellular), etc..

The communicator <NUM> may receive identification information of the plurality of display devices <NUM> from the external device or the external server. In addition, the communicator <NUM> may receive information including a screen shape, a screen size, and a bezel size of the plurality of display devices <NUM> based on the identification information according to a control of the processor <NUM>. Also, the communicator <NUM> may receive a photographed image of the video wall from an external camera.

The display <NUM> is a configuration for displaying various contents. Particularly, the display <NUM> may display a UI for setting the video wall contents. For example, the display <NUM> may display a UI window referring to arrangement state information of the plurality of display devices actually arranged based on the identification information and the layout information according to the control of the processor <NUM>.

The display <NUM> may be implemented as various forms such as liquid crystal display (LCD), organic light-emitting diode (OLED), Liquid Crystal on Silicon (LCoS), Digital Light Processing (DLP), quantum dot (QD), Micro light-emitting diode (Micro LED) display, and the like. For example, the display <NUM> may be implemented as a touch screen having a mutual layer structure with a touch pad. In this case, the display <NUM> may be used as a user interface (not shown) in addition to an output device. The touch screen may be configured to detect a touch input pressure as well as a touch input position and size.

The electronic device <NUM> may not include the display <NUM> separately, and may be connected to the external device through the interface (not shown) to transmit a display signal to the external display device.

The camera <NUM> may photograph an object according to a user command to obtain an image. For example, the camera <NUM> may photograph the video wall including the plurality of display devices <NUM> and may obtain an image. The user command may be various such as a touch input, a button input, a voice input, a motion input, and the like.

When the object is photographed through the camera <NUM>, the object may be converted into an electrical image signal through semiconductor optical element, Charge Coupled Device (CCD) or Complementary Metal Oxide Semiconductor (CMOS), and the converted image signal is converted from an analog signal processor (not shown) to an amplified or a digital signal. The converted digital signal may be subjected to digital signal processing in a digital signal processing unit (not shown), and may be displayed through the display <NUM> by adjusting its color and brightness according to a control of the processor <NUM>.

The displayed image may be a still image or a moving image. The camera <NUM> may photograph the still image at a specific point of time or may continuously photograph the still image.

The electronic device <NUM> may not include the camera <NUM> separately, and may receive the photographed image from an external camera.

<FIG> is a diagram illustrating a relation between a plurality of display devices and an external device according to various embodiments.

According to an embodiment, an electronic system <NUM>, as illustrated in <FIG> may include an electronic device <NUM> and the plurality of display device <NUM>. The electronic device <NUM> may be a device capable of photographing, including the camera <NUM>, the plurality of display devices <NUM> forming the video wall by itself. For example, the electronic device <NUM> may be implemented as a smartphone, a tablet PC, a mobile phone, a desktop PC, a laptop PC, a netbook computer, a PDA, a portable multimedia player (PDA), a MP3 player, a camera, a wearable device, or the like. The electronic device <NUM> may receive a photographed image of the plurality of display devices <NUM> forming the video wall from the external camera, and may be implemented as a device obtaining the layout information of the video wall from the received image. For example, the electronic device <NUM> may be implemented as a PC, a laptop, a smartphone, a table, or the like. Although the electronic device <NUM> is described as a smartphone in <FIG>, this is merely an embodiment.

According to another embodiment, the electronic system <NUM> may include the electronic device <NUM>, the plurality of display devices <NUM>, or the external device <NUM>, as described in <FIG>.

The plurality of display devices <NUM> may transmit the identification information of each of the display devices to the external device. Then, the electronic device <NUM> may receive the identification information of each of the plurality of display devices <NUM> from the external device <NUM> to store the identification information. The electronic device <NUM> may obtain the arrangement state information of the plurality of display devices <NUM> based on the photographed image of the plurality of display devices and the stored identification information. Then, the electronic device <NUM> may transmit the arrangement state information to the external device <NUM>. That is, the processor <NUM> may control the communicator <NUM> in order to transmit the obtained arrangement state information to the external device <NUM> controlling an operation of the video wall. The external device <NUM> may display a UI for setting the video wall contents based on the received arrangement state information of the plurality of display devices. The external device <NUM> may control the video wall including the plurality of display devices <NUM>, such as displaying a specific content on the plurality of display devices <NUM> based on an input user command.

In addition, the electronic device <NUM> may photograph an image of the plurality of display devices <NUM> and may transmit the photographed image to the external device <NUM>. Then, the external device <NUM> may obtain the arrangement state information based on the identification information of the plurality of display devices <NUM> and the layout information of the video wall. That is, the electronic device <NUM> may perform simply as a camera device photographing an image of the plurality of display devices, and may be performed the operation of the processor <NUM>, described in <FIG>, in the external device <NUM>.

<FIG> is a flowchart illustrating a control method of an electronic device according to an embodiment.

The electronic device <NUM> may store mapping information that identification information and an identification image of each of a plurality of display devices <NUM> are mapped. The identification information may include information of a product name, a model name, a Mac address of the plurality of display devices <NUM>, and the identification image may include at least one of a QR code, a corner symbol, a border symbol, or a barcode as an image representing an ID of the display devices <NUM>.

The electronic device <NUM> may obtain the photographed image of the video wall including the plurality of display devices <NUM> displaying the identification image (S720). When the electronic device <NUM> includes the camera <NUM>, the electronic device <NUM> may obtain an image by photographing the video wall directly. When the electronic device <NUM> does not include the camera <NUM>, the electronic device <NUM> may obtain the photographed image of the video wall from the external camera.

The electronic device <NUM> may obtain an identification image corresponding to the layout information of the video wall and each of the plurality of display devices <NUM> from the photographed image (S730).

The electronic device <NUM> may obtain the layout information of the video wall from the photographed image through an image recognition technique. For example, the electronic device <NUM> may explore an entire area of the photographed image through the window sliding technique and obtain the layout information of the video wall. For example, the electronic device <NUM> may divide the entire area in the photographed image into n*m blocks. The electronic device <NUM> may scan each block using a window of a predetermined size to obtain a feature value of each block. The electronic device <NUM> may compare the obtained feature value of each block to obtain the layout information including the number, arrangement state information, etc. of the display devices <NUM>. For example, the electronic device <NUM> may obtain layout information that the number of the plurality of display devices <NUM> are four and the devices are regularly arranged in the form of <NUM> by <NUM> (2x2). The window sliding technique may be an example of an image recognition technique, and may use various embodiments for obtaining layout information of the video wall using an artificial neural network.

The electronic device <NUM> may obtain the identification information of each of the plurality of display devices based on the mapping information and the identification image (S740). For example, the electronic device <NUM> may obtain the identification image through the image recognition technique. For example, when the identification image is implemented as a QR code, the electronic device <NUM> may obtain the identification image through a QR code reader. In addition, when the identification image is implemented as a corner symbol, the electronic device <NUM> may obtain the identification image based on at least one information of a size, a shape, display position, etc. of the corner symbol through the image recognition technique such as the window sliding technique.

The electronic device <NUM> may compare the mapping information that the identification is mapped and the obtained information of the identification image to obtain identification information of each of the plurality of display devices <NUM>.

The electronic device <NUM> may obtain the arrangement stat information of the plurality of display devices <NUM> including the video wall based on the obtained identification information and the layout information. The arrangement state information may refer to information including both the layout information and identification information of the plurality of display devices <NUM>. For example, it is assumed that the plurality of display devices <NUM> are formed as <NUM> by <NUM> (2x2). The arrangement state information may refer to information including not only layout information that the arrangement of the video wall is formed as <NUM> by <NUM> (2x2), but also in the case of an upper left display device, identification information that the display devices have a model name of Q1.

The electronic device <NUM> may obtain information including a screen shape, a screen size and a bezel size of a corresponding display device based on the obtained identification information, and may obtain the arrangement state information of the plurality of display devices <NUM> based on the obtained information and the layout information. The electronic device <NUM> may identify whether the plurality of display devices <NUM> are in a regular arrangement state or an irregular arrangement state based on the identified image obtained from the photographed image.

The electronic device <NUM> may display a UI for setting a content of the video wall based on the arrangement state information of the plurality of display devices <NUM>. In addition, the electronic device <NUM> may identify whether the plurality of display devices <NUM> are in a regular arrangement state or an irregular arrangement state, and provide a candidate content corresponding to the identified arrangement state in the UI. The electronic device <NUM> may provide the candidate content corresponding to the identified arrangement state. Since the plurality of display devices arranged in a regular manner are appropriate for displaying one complete image, when the devices are identified as a regular arrangement state, the electronic device <NUM> may provide one image or a plurality of images related to each other as candidate contents. Also, since the plurality of display devices arranged in an irregular manner are appropriate for displaying an individual image, when the devices are identified as an irregular arrangement state, the electronic device <NUM> may provide a plurality of images as candidate contents.

The electronic device <NUM> may control an operation of the video wall based on the obtained arrangement state information. For example, the electronic device <NUM> may transmit image signals to the video wall so as to display specific contents in the plurality of display devices forming the video wall. The electronic device <NUM> may transmit the obtained arrangement state information to an external device <NUM> that controls the operation of the video wall. Thereafter, the external device <NUM> may transmit the image signals to the video wall so as to display the specific contents in the plurality of display devices <NUM>.

Since detailed operations of each step have been described above, a detailed description thereof may be omitted.

At least some configurations of the methods according to various embodiments described above may be able to be installed in the existing electronic devices, and may be implemented in a form of an application which is software that may be used by a user on an operating system (OS).

At least some configurations of the methods according to the embodiments described above may be implemented by upgrading the software or hardware of the existing electronic devices.

The various embodiments described above may be executed through an embedded server in the electronic device or through at least one external server among the electronic device and the display devices.

According to an embodiment, the various embodiments described above may be implemented as software including instructions stored in a machine-readable storage media which is readable by a machine (e.g., a computer). The device may include the electronic device according to the disclosed embodiments, as a device which calls the stored instructions from the storage media and which is operable according to the called instructions. When the instructions are executed by a processor, the processor may directory perform functions corresponding to the instructions using other components or the functions may be performed under a control of the processor. The instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage media may be provided in a form of a non-transitory storage media. The 'non-transitory' means that the storage media does not include a signal and is tangible, but does not distinguish whether data is stored semi-permanently or temporarily in the storage media.

In addition, according to an embodiment, the methods according to various embodiments described above may be provided as a part of a computer program product. The computer program product may be traded between a seller and a buyer. The computer program product may be distributed in a form of the machine-readable storage media (e.g., compact disc read only memory (CD-ROM) or distributed online through an application store (e.g., PlayStore <IMG>). In a case of the online distribution, at least a portion of the computer program product may be at least temporarily stored or provisionally generated on the storage media such as a manufacturer's server, the application store's server, or a memory in a relay server.

In addition, according to an embodiment, various embodiments described above may be implemented in a recording media that may be read by a computer or a similar device to the computer by suing software, hardware, or a combination thereof. In some cases, the embodiments described herein may be implemented by the processor itself. In a software configuration, various embodiments described in the specification such as a procedure and a function may be implemented as separate software modules. The software modules may respectively perform one or more functions and operations described in the present specification.

According to various embodiments described above, computer instructions for performing processing operations of a device according to the various embodiments described above may be stored in a non-transitory computer-readable medium. The computer instructions stored in the non-transitory computer-readable medium may cause a particular device to perform processing operations on the device according to the various embodiments described above when executed by the processor of the particular device. The operations may include obtaining a photographed image of a video wall including the plurality of display devices displaying an identification image, obtaining layout information of the video wall and an identification image corresponding to the plurality of display devices, respectively, from the photographed image, obtaining identification information of each of the plurality of display devices based on the mapping information and the identification image, and obtaining arrangement state information of the plurality of display devices included in the video wall based on the obtained identification information and the layout information.

The non-transitory computer-readable medium does not refer to a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is available of reading by the device. For example, the non-transitory computer-readable medium may be CD, DVD, a hard disc, Blu-ray disc, USB, a memory card, ROM, or the like.

According to an embodiment, the methods according to the various embodiments may be provided as a part of the computer program product. The computer program product may be traded between a seller and a buyer. The computer program product may be distributed in a form of the machine-readable storage media (e.g., compact disc read only memory (CD-ROM) or distributed online through an application store (e.g., PlayStore <IMG>). In a case of the online distribution, at least a portion of the computer program product may be at least temporarily stored or provisionally generated on the storage media such as a manufacturer's server, the application store's server, or a memory in a relay server.

Further, each of the components (e.g., modules or programs) according to the various embodiments described above may be composed of a single entity or a plurality of entities, and some subcomponents of the above-mentioned subcomponents may be omitted or the other subcomponents may be further included to the various embodiments. Generally, or additionally, some components (e.g., modules or programs) may be integrated into a single entity to perform the same or similar functions performed by each respective component prior to integration. Operations performed by a module, a program, or other component, according to various embodiments, may be sequential, parallel, or both, executed iteratively or heuristically, or at least some operations may be performed in a different order, omitted, or other operations may be added.

Claim 1:
A control method of an electronic device which accesses stored mapping information in which identification information of a plurality of display devices is mapped with an identification image of the plurality of display devices, respectively, the control method comprising:
obtaining a photographed image of a video wall including the plurality of display devices displaying a respective identification image;
obtaining layout information of the video wall and the respective identification image corresponding to the plurality of display devices, from the photographed image;
obtaining identification information of the plurality of display devices, respectively, based on the mapping information and the respective identification image;
receiving screen shape and screen size of the plurality of display devices based on the obtained identification information; and
obtaining arrangement state information of the plurality of display devices included in the video wall based on the obtained identification information and the layout information;
characterized by:
displaying a user interface, UI, comprising a plurality of screen images corresponding to shapes and sizes of the plurality of display devices and a candidate content, for a content setting of the video wall based on the arrangement state information of the plurality of display devices; and
identifying whether the plurality of display devices are in a regular arrangement state or an irregular arrangement state, and providing the candidate content corresponding to the identified arrangement state on the UI;
when the identified arrangement state is regular, the candidate content comprises one image or a plurality of images related to each other, and when the identified arrangement is irregular, the candidate content comprises a plurality of individual images; and
wherein the plurality of screen images includes a portion of the candidate content corresponding to the relative arrangement position of each of the plurality of display devices.